Slashdot Mirror


UN Makes Its Statistical Data Free and Searchable

NorseWolf writes "Since its foundation, the United Nations system has been collecting statistical information from member states on a variety of topics. The information thus collected constitutes a considerable information asset of the organization. However, these statistical data are often stored in proprietary databases, each with unique dissemination and access policies. As a result, users are often unaware of the full array of statistical information that the UN system has in its data libraries. The current arrangement also means that users are required to move from one database to another to access different types of information. UNdata addresses this problem by datapooling major UN databases and those of several other international organizations into one single Internet environment. The innovative design allows a user to access a large number of UN databases either by browsing the data series or through a keyword search."

79 comments

  1. YERRSS!!! by AndGodSed · · Score: 4, Funny

    *does victory dance*

    I love that things like this happen. Free, open and searchable - Bill Gates must be turning in his... Oh, wait...

    1. Re:YERRSS!!! by neonmonk · · Score: 5, Funny

      Turning in his deckchair on his billion dollar yaught?
      Turning in his feather soft mattress on his million dollar gold plated four poster bed?
      Turning in his 1988 Porsche 959 Coupe?
      Turning in his 1999 Porsche 911 Convertible??
      Turning in his wife to the authorities???

      The suspense is killing me!!

    2. Re:YERRSS!!! by Mark3eb · · Score: 1

      I am also doing my victory dance. It's about time!

    3. Re:YERRSS!!! by AndGodSed · · Score: 4, Funny

      ...turning in his Vista laptop for a Dell/Ubuntu offering.

      TADAAAAAAHHH! *drrrrummmrrroolllll*

    4. Re:YERRSS!!! by rabbit994 · · Score: 2, Informative

      I'm not really sure how he's turning in his whatever since UNData is written in ASP.Net 2 powered by Windows 2003. He's probably laughing all the way to bank though.

    5. Re:YERRSS!!! by will_die · · Score: 1

      It may of been written in asp.net but whoever modified thier scrollbars to act the way they do should have thier hands removed with a dull spoon just to make sure they never do a web page ever again.

    6. Re:YERRSS!!! by baldass_newbie · · Score: 1, Offtopic

      I wonder how the Americans are planning on undermining this UN initiative ?

      Typically it's the other way around. Al Baradei has been far more interested in showing he can stand up to the UN than in actually finding nuclear development like in say Libya or Syria. I'm not even going to mention Iran because since the US has backed off the EU realizes that they better stop whining to the US and start acting like they have a hide to preserve.
      --
      The opposite of progress is congress
    7. Re:YERRSS!!! by Anonymous Coward · · Score: 0

      All data and metadata provided on UNdata's website are available free of charge and may be copied freely, duplicated and further distributed provided that they are not put up for sale or otherwise commercially exploited and that UNdata is cited as the reference.
      Unusable in Wikipedia because Wikipedia can be republished. Unusable for analysis with commercial data so less chance of people benefiting from large business decisions ("Who needs clean water? We don't know. Sell it to suburbanites.").
    8. Re:YERRSS!!! by Anonymous Coward · · Score: 0

      may HAVE been ... not "may of been"

  2. Hmm by Anonymous Coward · · Score: 1, Funny

    I just ran a Query. As it turns out, people DO prefer food or death. Thanks UN! *high fives*

  3. Innovation? by pembo13 · · Score: 4, Insightful

    Not to knock this applaudable achievement, but what exactly makes this solution innovative? Or has the meaning of this word simply been diluted more than I thought.

    That aside, interesting project

    --
    "Thanks for all the money you paid to us. We've used it to buy off ISO among other things" -Microsoft
    1. Re:Innovation? by zappepcs · · Score: 4, Insightful

      Innovative? Well, to get multiple departments, countries, people to agree on a single thing is amazing if not innovative. To get them to agree on a database, and data formats as well? I've not seen to much of that in the world of governments or big business. Perhaps there was some innovation going on there? It may well have been just innovation in how to politically leverage a size 10 shoe into a size 2 ass, but it does sound like they have done something different. :)

    2. Re:Innovation? by baboonlogic · · Score: 5, Insightful

      This kind of statistics that I can actually link to while making a point... That's about as innovative in my book as wikipedia was. This will forever change how geeks discuss things.

    3. Re:Innovation? by pembo13 · · Score: 1

      Those emissions of China and India in 2004 at a lot relatively lower than I expected.

      --
      "Thanks for all the money you paid to us. We've used it to buy off ISO among other things" -Microsoft
    4. Re:Innovation? by TapeCutter · · Score: 1

      Add a graphing tool that plots statistics over time and it will also be easy to point to collapsing fisheries, diminishing harvests, etc.

      --
      And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
    5. Re:Innovation? by baboonlogic · · Score: 4, Informative

      Like this?

      Gapminder is the tool. I hope they incorporate these fresh stats soon!

    6. Re:Innovation? by richlv · · Score: 1

      could you, please, tell how can one choose which data goes into rows, and which into columns ? :)
      i'd like to see other stats in a layout similar to your link, but can't grasp that one.

      --
      Rich
    7. Re:Innovation? by sumdumass · · Score: 4, Interesting

      I don't think they are in as much agreement as you might think. The UN requires individual countries to record their own data and sets guidelines but doesn't expect a country to duplicate efforts if they are already collecting similar data.

      What this will lead to is information that is useful withing a well defined set of parameters but on the whole can't be directly compared between countries. Crime rates and infant mortality are a couple of prime examples on how reporting differences can change the entire outlook on things. So at least keep that in mind when looking at it.

    8. Re:Innovation? by baboonlogic · · Score: 1

      Interesting! Some of these tables have a "select pivot column" while others don't. Luckily the ones I first looked for turned out to be pivot-enabled!

      Anyway, if there is a select pivot column above your chosen table, you can make the data of that column be used as a field.

      I can't seem to find any pattern so far that tells us whether a particular table will be pivot-enabled or not. Anyone got that one figured out?

    9. Re:Innovation? by LakeSolon · · Score: 1

      Those emissions of China and India in 2004 at a lot relatively lower than I expected. China:

      4 in 2004
      2 in 1994
      1 in 1981

      Lower, but roughly doubling each decade and accelerating.
    10. Re:Innovation? by sumdumass · · Score: 2, Insightful

      That's because China has 5 times the population as we do or more. Here is one on usage without the per capita BS. Something else to remember, the data stops at 2004 for some reason. A lot has been going on in 4 years. I doubt any of those numbers are close to accurate today.

      Personally, I'm not sure why the per capita really comes into play without population density.But either way, the problem is supposedly Co2 not Co2 per person. Take a look at Australia when I add it to the ops chart. Notice how AU is listed at 15 or so and produces less Co2 then the UK as to the previous chart. Well hell, even India is misleading. It is the lowest with 1 on the per capita chart and they produce more Co2 then the UK and AU put together.

      Now I am going to suggest something that most people want to ignore, look at the countries on the lists with a low per capita rating and think about the standard of living compared to the higher ones. And I don't mean how rich people charter choppers to goto their kids little league softball game. I mean the person at the poverty line who has a car, TV, cell phone, Air conditioning, Cable TV in some cases, compared to people living in those low emission per capita countries.

    11. Re:Innovation? by inode_buddha · · Score: 1

      Pretty much true, It's just a pity that I had to wait most of my life for the UN to do it instead of my own gov't (USA). FWIW now that I'm getting a tad older, I'm enjoying the health and nutrition info.

      --
      C|N>K
    12. Re:Innovation? by the_one(2) · · Score: 1

      wow! looks really useful. And the facts are interesting as well. had no idea that china and india was realeasing so little (relatively)

    13. Re:Innovation? by OptimusPaul · · Score: 2, Insightful

      I have to agree, there in nothing innovative about that database. Perhaps if they had described the techniques used to "convince" the maintainers of the various databases to combine the data then maybe we'd see some innovation. But even then I'm suspecting it's nothing that many IT departments of merging companies have not already thought of, or nothing that the CIA hasn't already dreamed up. I think the right word here is incredible or perhaps unbelievable.

    14. Re:Innovation? by Roofus · · Score: 1

      Dude, look at the footnotes! The US figure includes American Samoa. That explains why our values are so high. Those Somoan fuckers eat, sleep and fart CO2.

    15. Re:Innovation? by bangthegong · · Score: 2, Informative

      Love the gapminder, figured someone would post that. If anyone is not familiar, this presentation from TED should shed some light on why this UN development is important.
      http://www.ted.com/index.php/talks/view/id/92
      I also encourage you to check out their podcast, just search "gapminder" on iTunes.

    16. Re:Innovation? by unlametheweak · · Score: 1

      Now I am going to suggest something that most people want to ignore, look at the countries on the lists with a low per capita rating and think about the standard of living compared to the higher ones. My first response when people bring up the "standard of living" argument is to say to myself "yeah so what. Who cares? What's the point of bringing this up?" Standard-of-living is a nice statistical tool for economists, but is too general and brings up Western (financial) market biases. Since SoL is based on goods and services consumed, it's inaccuracy at measuring quality of life is seen since it is based on Gross Domestic Product; for example spending on man-made disasters and natural disasters will create a higher Standard of Living for the US (i.e. spending on Iraq, 9/11, Hurricane Katrina, federal prisons, etc). Note that Standard of Living does not measure (what I call the "happiness factor", and others call "quality of life" factors), but instead rather inaccurately measures wealth, as you glibly seem to undermine.

      From Wikipedia: "The standard of living refers to the quality and quantity of goods and services available to people, and the way these goods and services are distributed within a population." And Standard of Living is a per capita measure (as you called it "per capita BS"). For example, SoL does not take into account whether a person owns their means of production (like peasant farmers), or whether a person has to do monotonous work in a dark factory all day with supervisors and Bean Counters looking over their shoulder's so that they can afford to use a car to take them to work. I'm sure the SoL would be rather low for Quakers and Mennonites, but Quality of Life (the happiness factor again) would be higher. Living in "poverty" for some people is an ideal. Which brings up another point.

      Poverty is also a highly political term, and has everything to do with comparative wealth, and not with the general wealth of a nation. A person living in poverty in the US is different from a person living in poverty in India. And a person living underneath the unofficial poverty line in Canada is different from that in the US and other countries. I remember at one time in Canada the politicians decreased it's unofficial poverty line because of lobbying from the business sector (ref: http://www.ccsd.ca/pr/lico00aj.htm [Note that this article does not discuss the politics, just the statistical change used by Statistics Canada]).
    17. Re:Innovation? by thomas.craig · · Score: 1

      Here are a couple of talks/demos by Hans Rosling - who I think (but I could be wrong) was the developer of gapminder. Very interesting analyses of poverty and development based on the UN databases. http://www.ted.com/index.php/talks/view/id/92 http://www.ted.com/index.php/talks/view/id/140

    18. Re:Innovation? by Kelbear · · Score: 1

      I heard they even exhale CO2.

    19. Re:Innovation? by sumdumass · · Score: 1

      Well, first, I was specific about the standard of living that revolves around the poverty line which is often defined by a percentage of the median income levels compared to the income distribution among the people (per capita). So for a comparison in this case, it is quite appropriate. The poor are much richer in the higher per capita countries. They not only seem to have more money, they also have more goods and possesions which you seem to think skews the comparisons. That fact is, that is the comparison I was attempting to make, so it is possible I just used the wrong terminology.

      As for canada, You can compare the differences with America a lot easier then you can with China for example. Lets look at the per capita with canada. You see, your about right when you say Canada has as high if not hirer SoL as the US. But when you look at the actual production, you will see they are slightly more then the UK's production. You can say what you want but you proved my point.

      I was going to put together another little calculation that showed that actual increase Co2 emissions withing a given country and how it parallels with population growth and standards of living withing a country. Unfortunately, I can't find my links that shows internal Sol within each country compared and the formula breaks down quickly when you compare India and China. However it seems accurate with Canada, the UK, AU, and US. adding the percentage of increased SoL to the percentage of population growth seems awfully close to the amount of Co2 increases since 1990 (non-per capita measurements).

  4. Libaration by spatialguy · · Score: 3, Informative

    I wish that every organization and government would do this. It is a great tool for research. In the Netherlands "public" data is still regarded as property and our government charges us for this.

    1. Re:Libaration by Rashdot · · Score: 3, Informative

      Translated from cbs.nl:

      http://www.cbs.nl/nl-NL/menu/cijfers/statline/default.htm

      "StatLine is the free electronic database of the CBS (Central Bureau of Statistics). You can create your own tabels and graphs. The information is free and easy to print and download."

      "StatLine is de elektronische databank van het CBS. U kunt in StatLine zelf tabellen en grafieken samenstellen.
      De informatie is gratis en gemakkelijk te printen en te downloaden."

      --
      This is not the sig you're looking for.
    2. Re:Libaration by vozome · · Score: 1

      there's an enormous amount of free stuff on CBS though. as for the rest... it makes sense that only people who need it pay for it, instead of every taxpayer. there's no such thing as a free government service.

  5. Maybe by TubeSteak · · Score: 5, Insightful

    Data is worthless unless you know how it was collected.

    Without such information, you cannot ascertain the accuracy of the data & you cannot compare it to any other data sets.

    Where are the links to the source reports?

    --
    [Fuck Beta]
    o0t!
    1. Re:Maybe by kmarshallbanana · · Score: 4, Informative

      Its there for anyone who cares to look, eg. http://unstats.un.org/unsd/methods.htm

    2. Re:Maybe by pembo13 · · Score: 1

      Fair point. Good question. But before tossing the relevance of the data away, I think one should consider that yours is a high standard to which most data collection made public may not meet -- the CIA (of the USA) publishes a lot of data on their website, but I don't think I've seen links to the documentation on how the data was collected. Still, having that information would be superb.

      --
      "Thanks for all the money you paid to us. We've used it to buy off ISO among other things" -Microsoft
    3. Re:Maybe by 216pi · · Score: 5, Informative

      If you really would have been interested in the source, you would have seen the BIG BOX below the data that says 'SOURCE' with a short description and a link ORIGINAL DATA that links to the organisation that provided the data. and after 2 minutes of browsing, I found this: http://mdgs.un.org/unsd/mdg/SeriesDetail.aspx?srid=749 where you can find information how the data was collected.

      stop whining, start looking. thanks.

    4. Re:Maybe by houghi · · Score: 1, Funny

      Obb: You must be new here.

      --
      Don't fight for your country, if your country does not fight for you.
    5. Re:Maybe by Anonymous Coward · · Score: 0

      God damn it. The word 'data' is plural.

      "Data are worthless unless you know how they were collected."

      I shudder every time I hear a singular verb used with 'data'. Ugh, how can you people speak and write like that? Where did you go to school?

  6. Hans Rosling must be a happy man! by baboonlogic · · Score: 1

    He asked for this and it's finally here!

    1. Re:Hans Rosling must be a happy man! by miruku · · Score: 1

      i'm wondering how long it'll be until we see this data integrated with gapminder. either that, or a gapminder-esq interface on the UNdata site.

      --
      MilkMiruku
  7. Invalid column name 'eValue'. by hsdpa · · Score: 1
    When searching and trying to sort by a column that isn't there, you get an error message.
    In my case, while searching for greenhouse gasses in the world and sorting by -value-, i got this result:

    Invalid column name 'eValue'. at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
    at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
    at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
    at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
    at System.Data.SqlClient.SqlDataReader.HasMoreRows()
    at System.Data.SqlClient.SqlDataReader.ReadInternal(Boolean setTimeout)
    at System.Data.SqlClient.SqlDataReader.NextResult()
    at Unsd.Drs.Components.Services.DataMartService.LoadData(IDataReader reader, QueryRequest request, Boolean getMetadata) in C:\Development\Unsd\DRS\deploy\Data Retrieval System\Components.Web\Services\DataMartService.cs:line 144
    at Unsd.Drs.Components.Services.DataMartService.GetData(QueryRequest request, Boolean getMetadata) in C:\Development\Unsd\DRS\deploy\Data Retrieval System\Components.Web\Services\DataMartService.cs:line 105
    at Unsd.Drs.Web.Handlers.DataHandler.Query(QueryRequest request)
    at Unsd.Drs.Web.Handlers.DataHandler.Query()
    at Unsd.Drs.Web.Handlers.AbstractFilteredDataHandler.ServiceRequest()
    at Unsd.Drs.Web.Handlers.DataHandler.ServiceRequest()
    at Unsd.Drs.Web.Handlers.AbstractFilteredDataHandler.ProcessRequest()
    at Unsd.Drs.Web.Handlers.AbstractHttpHandler.ProcessRequest(HttpContext context)
    Fun!
    --
    :(){ :|:& }:;
  8. Drugs by Threni · · Score: 2, Insightful

    So now we can see how much money it spends trying to force its futile prohibitionist American-style anti-drugs policy on the world?

  9. Example query by sweet_petunias_full_ · · Score: 1

    select * from countries where cameras == 0 and wiretaps == 0 and privacy > 'NONEXISTING';

    No records found.


    Maybe, just maybe, in an alternate reality, this might have been useful.

    --
    You can't send a takedown notice to an already printed newspaper.
  10. Funny you should say that by mveloso · · Score: 4, Insightful

    I remember one of my professors mentioning that he was in the office of the president of some African country assisting them with "determining" the value of various financial (and other) metrics for large, unnamed NGOs like the UN.

    For most countries, statistical information is really wishful thinking. If you can't control your borders, tax your citizens effectively, or provide infrastructure, you can't collect accurate statistics. Indeed, even for developed countries statistics may be suspect, especially trade data.

    However, as people like to say, even bad data is better than no data.

    1. Re:Funny you should say that by penix1 · · Score: 4, Insightful

      However, as people like to say, even bad data is better than no data.


      Whoever says that deserves the bad policy they get that was based on that bad data. You can never achieve 100% accuracy but it is a goal that still should be attempted. To accept otherwise is not only foolish but also dangerous. It leads to such stupidity as the US is currently experiencing with global warming and evolution. Screwing up the data bad enough gives the opposition to proper policy the ammunition to call "junk science" on that policy. So no, it isn't better to have bad data over no data.
      --
      This is a sig. This is only a sig. Had this been an actual sig you would have been informed where to tune for more sigs.
    2. Re:Funny you should say that by Whiney+Mac+Fanboy · · Score: 1

      However, as people like to say, even bad data is better than no data.

      It depends how bad (inaccurate) the data is. For instance, I'd rather have no data on violent crime in a particular area then inaccurate data if I was deciding to buy a house there.

      --
      There are shills on slashdot. Apparently, I'm one of them.
    3. Re:Funny you should say that by fondacio · · Score: 2, Insightful

      large, unnamed NGOs like the UN Sorry to nitpick, but the UN is not an NGO. "NGO" stands for non-governmental organizations and examples of NGOs are Greenpeace, Amnesty International, Human Rights Watch, Oxfam, Cordaid, the International Red Cross etc., which operate independently from governments. The UN is very much a governmental organization, since it is composed of member states represented by their governments - in some circles they refer to these kinds of organizations (UN, NATO, EU, OSCE, OAS, ASEAN) as IGOs or international governmental organizations.

      However, as people like to say, even bad data is better than no data. As some of the previous posters have said, no data may be preferable to bad data in many cases as well. However, in the cases that you mentioned I think the bad data may also be interesting for a completely different analysis: to see how governments believe they have to manipulate their data to look as good as possible to IGOs and NGOs. When you study this, you can adjust practices, standards and supervisory mechanisms in those organisations to make it more difficult for unreliable governments to rig the system.
    4. Re:Funny you should say that by Eighty7 · · Score: 1

      However, as people like to say, even bad data is better than no data.
      Only to the extent that you know how bad it is & are able to compensate.
    5. Re:Funny you should say that by vozome · · Score: 1

      computing the GDP of the larger developed nations is a very large calculation which requires a lot of guessing... take for instance variables like the size of the underground economy (which is included in GDP). funny how these numbers are then treated as an absolute truth. for a large set of countries (like, all the un countries) you cannot have comparable data. even with standards like the system of national accounts which theoretically defines how you compute macro aggregates, there are always variations - the US being one of the countries interpreting the SNA rules the most liberally. the only thing you can hope to get are time series for one single countries consistent over time.

    6. Re:Funny you should say that by sydbarrett74 · · Score: 1

      However, as people like to say, even bad data is better than no data. Given no data, people will hopefully acknowledge the fact and tread cautiously. Bad data gives one false confidence and leads to disastrous outcomes.
      --
      'He who has to break a thing to find out what it is, has left the path of wisdom.' -- Gandalf to Saruman
  11. What about all the others? by kmarshallbanana · · Score: 2, Insightful

    Now if only they will be followed in this by the World Bank, IMF, OECD... Not to mention all those national level organisations.

  12. MOD parent up. by TapeCutter · · Score: 1

    Touche!

    --
    And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
  13. Great project, pity about the name by sapphire+wyvern · · Score: 1

    A laudable project indeed. However everytime I look at that "UNdata" project name, I can't help but think of it as a data source for Uncyclopedia.

    1. Re:Great project, pity about the name by Cokeisbomb · · Score: 1

      Agreed! I assume most of the data in Un-data is from Oscar Wilde himself. I can't believe they called this "un-data". Then again - about to the NGO/IGO discussion above - this must be a govermental organzation - only an oversized committee could have the cajones to come up with a name like that.

  14. no comment by Anonymous Coward · · Score: 0

    Comment

  15. Re:CmdrTaco the Hot Bottom ESCORT Dude! - m4m -29 by Anonymous Coward · · Score: 0

    How much for Cowboy Neal with the irrational waist size and gravitational force?

  16. Public submission by Twinbee · · Score: 1

    All very good, but in the true spirit of the idea, anyone should be able to submit data. The site could rank data by 'authoritiveness', but in many cases it's better to have slightly questionable data than none at all (especially if it matches up with other questionable data).

    For example, in the energy usage section I might want to create metadata to see which energy type has grown the quickest etc.

    --
    Why OpalCalc is the best Windows calc
  17. If you like this sort of stuff... by QJimbo · · Score: 1

    Go to http://www.nationmaster.com/ . I use it often to convince people about the problems we have in the UK =p

  18. Even sourced: beware of BS by natmakarvitch · · Score: 1

    Sourcing if of paramount importance. Some UN agencies, for example, spread pure BS

  19. One DB to rule them all!!!!! by Pepebuho · · Score: 1

    Yes!!!!!

  20. figures... by drnkjunglist · · Score: 1

    Attention! We did not find any results for: Iraq Nuclear Weapons. Please try the suggestions below to help refine your search. Suggestions: * Try more general keywords. * Try fewer keywords. * Make sure all words are spelled correctly. * Try different keywords.