Slashdot Mirror


GAO Studies U.S. Government Data Mining

securitas writes "Total Information Awareness is alive and thriving. eWEEK's Caron Carlson reports on a new General Accounting Office study that says TIA-style data mining programs are rampant in federal agencies with 199 projects at 52 of 128 agencies. The Defense Intelligence Agency/DoD is the single largest user of these data mining projects (eg. Verity K2 Enterprise). The story was first reported by Reuters' Andy Sullivan (ZDNet UK mirror) and the NYT's Robert Pear, who wrote that at least 122 projects used personally identifying information like names, e-mail addresses, Social Security and driver's license numbers. The 'actual numbers are likely to be much higher' because the report excludes classified projects. Wired News' Kim Zetter writes that, in addition to government databases, federal agencies mine private databases of credit rating agencies, bank account numbers, student loan applications, etc. This week the Center for Democracy and Technology (CDT) released a report with privacy guidelines for data mining technology (PDF) development and use. Guidelines include data anonymization, government data access authorization and audit trails. Cynthia (Cindy) Webb's 'Total Information Dilemma' at the Washington Post is an excellent survey of media coverage of TIA, MATRIX and the GAO report 'Data Mining: Federal Efforts Cover a Wide Range of Uses' (mirror, both in PDF format). More at GCN, GovExec and the Guardian/AP."

9 of 141 comments (clear)

  1. Re:Here's the difference... by GoPlayGo · · Score: 3, Interesting
    They are purchasing the information from the commercial sector", information that is readily available to anyone willing to pay for it.


    The power of the government purse. The spending power of the government is huge and able to afford this. Ordinary citizens are not.

    Another side effect is that the companies that collect and distribute this information are enriched and emboldened.
    --
    The game of Go (Igo, Weiqi, Baduk) has the simplest concept and the deepest play.
  2. To give the tin foil hat view of the whole thing.. by TyrranzzX · · Score: 3, Interesting

    They want the massive database to fight "terrorism", as they say it. Now, lets just think about what's been going on lately;

    1: Police officers have been taking pictures of protesters to throw into databases. Additionally, wearing masks is now illegal in most cities.

    2: Facial recognition software enabled camera's are going up everywhere. Sure, the software barely works but it'll get better. This is first justified in protecting people in high crime areas like chicago, and then will move out as far into the suburbs as they can justify it.

    3: Our economy is going to shit and we're going farther and farther into that hole.

    4: Massive databases of personal information are being assembled by our goverment.

    5: Our constitutional rights are gone.

    6: And to put the decorations on the cake, at the G8 summit at Sea Island in Georga, an order to "fire to kill" was given to all police officers in the state in regards to whoever they found was acting suspiciously. This means that if you're a protester outside of the building, the cops and military in the area can legally shoot and kill you.

    So, we've got our reichstag fire (9/11), we've got our Decree of the Reich president(Patriot act), now we're waiting for the enabling law (aka, the law that let the reichstag put people into concentration camps).

  3. Sharing Info by Anonymous Coward · · Score: 2, Interesting

    I work for an electrical company in Florida and the local Police agency has access to our customer records whenever they want. Must make it easier for them to track people. - This also reminds me of the time I spent in a hotel for a few weeks. During my stay I noticed police cars in the front once in a while. I wonder if hotels share their customer info also. Hmmm. Makes ya think doesn't it?

  4. European data protection by tuxette · · Score: 4, Interesting

    Here is the EU Personal Data Directive (95/46/EC), which is the basis/minimum for the data protection laws of each EU and EEA country. The Norwegian Personal Data Act is supposedly the toughest of them all. It's interesting to compare the nuances.

    --
    People say I'm crazy, I got diamonds on the soles of my shoes...
  5. Re:Here's the difference... by tuxette · · Score: 2, Interesting
    "Datensparsamkeit" (data frugality).

    This is called the collection limitation principle - There should be limits to the collection of personal data and any such data should be obtained by lawful and fair means and, where appropriate, with the knowledge or consent of the data subject., cf. OECD Guidelines for privacy/data protection.

    --
    People say I'm crazy, I got diamonds on the soles of my shoes...
  6. data quality? by tuxette · · Score: 4, Interesting
    What I'm interested in, is the quality of the data the government is mining. They are going through a lot of databases that may contain incorrect, false, misleading, or outdated data:

    2. Data Quality Principle
    Personal data should be relevant to the purposes for which they are to be used, and, to the extent necessary for those purposes, should be accurate, complete and kept up-to-date.

    How does the government separate the junk data from what may actually be worth looking at?

    --
    People say I'm crazy, I got diamonds on the soles of my shoes...
    1. Re:data quality? by tuxette · · Score: 2, Interesting
      It chills me to think that in this age of terrorism paranoia, this kind of approach will be repeated when searching for "terrorists".

      I read an article a while ago that painted an interesting scenario. A person living on "Lebanon Street" is put on the no-fly-list due to connections to Lebanon. And of course, the poor sod has no way in getting his situation rectified. I don't have any URLs, unfortunately; if anyone here read the same article and has an URL, I'd greatly appreciate seeing it again.

      --
      People say I'm crazy, I got diamonds on the soles of my shoes...
  7. Re:You are forgetting something... by symbolic · · Score: 2, Interesting


    This is the government. We have laws, and a Constitution that (purportedly) protects us from the government by limiting its power through a series of checks and balances. Yes, this information may be available to the general public, but John Q. Public doesn't have military or police force that come beating in your front door and taking you into custody because your personal information matches a certain pattern - whatever that may be.

    Herein lies, I'd argue, at least one reason behind the 4th Amendment to the U.S. Constitution. It basically says to the government, "If you don't have a reason to be looking at John Q. Public, you shouldn't be looking at John Q. Public." These projects constitute a massive fishing expedition, and we're all suspect.

  8. Look who doesn't do data mining by Aidtopia · · Score: 2, Interesting

    The GAO report that surveyed government departments to find out how much data mining they're doing and planning is interesting. In particular, the appendix that lists which departments don't do or plan to do any data mining has a few notable inclusions:

    • National Agricultural Statistics Service
    • Bureau of the Census
    • Defense Advanced Research Projects Agency (DARPA!?)
    • U.S. Geological Survey

    You'd expect some of those to have data mining as their primary function. Others are just hard to believe.