Slashdot Mirror


GAO Studies U.S. Government Data Mining

securitas writes "Total Information Awareness is alive and thriving. eWEEK's Caron Carlson reports on a new General Accounting Office study that says TIA-style data mining programs are rampant in federal agencies with 199 projects at 52 of 128 agencies. The Defense Intelligence Agency/DoD is the single largest user of these data mining projects (eg. Verity K2 Enterprise). The story was first reported by Reuters' Andy Sullivan (ZDNet UK mirror) and the NYT's Robert Pear, who wrote that at least 122 projects used personally identifying information like names, e-mail addresses, Social Security and driver's license numbers. The 'actual numbers are likely to be much higher' because the report excludes classified projects. Wired News' Kim Zetter writes that, in addition to government databases, federal agencies mine private databases of credit rating agencies, bank account numbers, student loan applications, etc. This week the Center for Democracy and Technology (CDT) released a report with privacy guidelines for data mining technology (PDF) development and use. Guidelines include data anonymization, government data access authorization and audit trails. Cynthia (Cindy) Webb's 'Total Information Dilemma' at the Washington Post is an excellent survey of media coverage of TIA, MATRIX and the GAO report 'Data Mining: Federal Efforts Cover a Wide Range of Uses' (mirror, both in PDF format). More at GCN, GovExec and the Guardian/AP."

15 of 141 comments (clear)

  1. URL spam by Slowtreme · · Score: 3, Insightful

    Just tell me which link to click so I can RTFA.

    --
    Post: Sigged, for your pleasure.
  2. Here's the difference... by Mz6 · · Score: 4, Insightful
    IMHO, since the government isn't obtaining the data themselves this is OK.

    From the article... "Scores of data-mining projects that collect and analyze U.S. citizens' personal information are in operation at dozens of federal agencies, the GAO found. Many of the nearly 200 projects planned or already under way rely on data purchased from the commercial sector"

    They are purchasing the information from the commercial sector", information that is readily available to anyone willing to pay for it. Congress stopped their TIA initiative, but will allow this due to that major fact.

    --
    Hmmm.
    1. Re:Here's the difference... by TiloB · · Score: 5, Informative

      In Germany (no, data does not search you) it is forbidden to gather more information than necessary. We call that principle "Datensparsamkeit" (data frugality).

      And it is not allowed to give information away or even sell them (that is only allowed for public available information)

    2. Re:Here's the difference... by GoPlayGo · · Score: 3, Interesting
      They are purchasing the information from the commercial sector", information that is readily available to anyone willing to pay for it.


      The power of the government purse. The spending power of the government is huge and able to afford this. Ordinary citizens are not.

      Another side effect is that the companies that collect and distribute this information are enriched and emboldened.
      --
      The game of Go (Igo, Weiqi, Baduk) has the simplest concept and the deepest play.
  3. (brace for storm of outrage) by JosKarith · · Score: 4, Insightful

    Cue 200 posts about how terrible this is. It's not atually very different to what the law-enforcement community's been doing all along, just the tools are better.
    It's like the argument about ID cards - there's nothing inherently wrong with being able to conclusively prove that you are who you say you are, but it's another thing entirely for people to be able to demand you prove the same.

    --
    'Don't worry' said the trees when they saw the axe coming, 'The handle is one of us.'
  4. European Protection Stronger for Personal Info by GoPlayGo · · Score: 4, Insightful

    Bless you for posting this information. Quite an eye-opener. Good research.

    Without laws preventing such mis-use, it runs rampant. European laws guarding personal information are much stronger than in the US, where corporate and government interests and methods are closely aligned, especially these days.

    --
    The game of Go (Igo, Weiqi, Baduk) has the simplest concept and the deepest play.
  5. The stink starts right at the top by leoaugust · · Score: 3, Insightful
    Even though it seems like the convergence of so many efforts is all low-level and coincidental, I beleive that so many projects would not have emerged if there was no guidance from the top levels.

    Like the Abu Ghraib Humiliation scandal the intellectual direction has been set at the top levels of the administration, even though the work on the projects is being done by lowly Primary Investigators.

    What I wonder is whether the ones setting the intellectual agenda in the administration have any idea ofwhere they are leading us.

    I fear, that one day we will be left in shock and awe when we discover that their idea of "preventing terrorism" was as well thought out as the idea of democratizing Iraq. We will all be at the mercy of a State that, like the Iraqi Monster, has grown too big for them to bully around. And then all of us, being in the same boat, will realize that those bas***** in the administration are screwed - but so are we.

    .

    --
    To see a world in a grain of sand, and then to step back and see the beach where the sand lies ...
  6. To give the tin foil hat view of the whole thing.. by TyrranzzX · · Score: 3, Interesting

    They want the massive database to fight "terrorism", as they say it. Now, lets just think about what's been going on lately;

    1: Police officers have been taking pictures of protesters to throw into databases. Additionally, wearing masks is now illegal in most cities.

    2: Facial recognition software enabled camera's are going up everywhere. Sure, the software barely works but it'll get better. This is first justified in protecting people in high crime areas like chicago, and then will move out as far into the suburbs as they can justify it.

    3: Our economy is going to shit and we're going farther and farther into that hole.

    4: Massive databases of personal information are being assembled by our goverment.

    5: Our constitutional rights are gone.

    6: And to put the decorations on the cake, at the G8 summit at Sea Island in Georga, an order to "fire to kill" was given to all police officers in the state in regards to whoever they found was acting suspiciously. This means that if you're a protester outside of the building, the cops and military in the area can legally shoot and kill you.

    So, we've got our reichstag fire (9/11), we've got our Decree of the Reich president(Patriot act), now we're waiting for the enabling law (aka, the law that let the reichstag put people into concentration camps).

  7. Its NOT URL spam by Anonymous Coward · · Score: 3, Insightful

    its a well rounded summary of a specific topic that includes links to back up nearly every point made _in_ the summary, click on the points you dont understand or would like to learn more about, skip over the rest and forget about it.

    the poster has apparently gone to a fair ammount of trouble to bring these links together into a nice written summary so that you dont have to go out and search for the information yourself (as if you would anyway... pfft).

    point being...

    If you are too lazy to click on a few links to see the information, you should go back to the other room, turn on the TV sit down and shut the fuck up.

  8. Bush Admin Right On by __aalomb7276 · · Score: 4, Insightful

    I can't agree less. The current administration has done a nearly flawless job so far.

    Bush administration officials ARE responsible for the objectionable actions at Abu Gharib and ARE taking action against those that committed them. That's what being responsible means. Compare that to the previous administration that dodged most responsibility and lied to cover it up.

    Don't poor-mouth the intellectual agenda. It is brilliant and is working.

  9. European data protection by tuxette · · Score: 4, Interesting

    Here is the EU Personal Data Directive (95/46/EC), which is the basis/minimum for the data protection laws of each EU and EEA country. The Norwegian Personal Data Act is supposedly the toughest of them all. It's interesting to compare the nuances.

    --
    People say I'm crazy, I got diamonds on the soles of my shoes...
  10. Re:Insider by meringuoid · · Score: 5, Funny
    I for one welcome the chance to be your data mining overlord!

    Pah. You won't be. My guess is that some time around November 2009, Google's server farm will reach a critical mass and achieve self-awareness. It already knows everything - all it lacks is a mind. It will probably have enslaved the human race by Christmas.

    --
    Real Daleks don't climb stairs - they level the building.
  11. We have a file of pointless trivia on you by mwood · · Score: 3, Funny

    Oh my dear lord, they're going to figure out that I buy computer books AND read _College Roomies from Hell_. And you know what that means!

    Or maybe they'll be convinced I'm a terrorist because I read CNN *and* /. Yeah.

  12. data quality? by tuxette · · Score: 4, Interesting
    What I'm interested in, is the quality of the data the government is mining. They are going through a lot of databases that may contain incorrect, false, misleading, or outdated data:

    2. Data Quality Principle
    Personal data should be relevant to the purposes for which they are to be used, and, to the extent necessary for those purposes, should be accurate, complete and kept up-to-date.

    How does the government separate the junk data from what may actually be worth looking at?

    --
    People say I'm crazy, I got diamonds on the soles of my shoes...
  13. Re:You are forgetting something... by symbolic · · Score: 4, Insightful


    And I'd argue that this (even though it might be the current standing of the U.S. Supreme Court), has no merit, and the reason is simple: Our society is built on an infrastructure that, for all practical purposes requires that I do certain things. I have little choice but to place my trash out on a curb for pickup, because there are few, if any other practical options. The fact that I have few (if any) other practical options does not portend or in any way grant anyone a "right" to take advantage of something merely because it is available, and especially because its availability is a byproduct of the infrastructure itself. I use the infrastructure because, as a pragmatic and civil-minded denizen, I must.

    Let's address the issue with the "publicly available" information. While there are certain records that are unquestionably public information, I'd argue that what I purchase is NOT public information- each purchase is a contract between myself and those vendors with which I choose to do business. Unfortunately, the easy availability, and wide use of credit, have allowed institutions to hijack, retain, sell, and otherwise use the specific details associated with each transaction, and make them available as they see fit.

    Something to think about - Let's say I cut my finger while preparing dinner. I use a kleenex to clean the wound, before applying a bandaid. What am I now to do with the kleenex? It has my blood on it, and presumably, can serve as a "sample" for anyone interested in fishing it out of my garbage. What am I to do? I don't believe that anyone has has a right to acquire this without my permission, or without a warrant. I am placing it in the garbage not because I have any intention of making it available to the public, but because this is the proper and accepted method of disposal.

    Here you can see the quandary imposed by a) the infrastructure, and b) the court's current standing. I don't believe it is fair, and I hope to see it change at some point in the future.