Slashdot Mirror


AT&T Invents Surveillance Programming Language

An anonymous reader writes "AT&T has long been associated with advances in the programming arts as well as communications. They've recently brought those disciplines together to create a powerful datamining language called Hancock. Hancock is a C variant developed to mine gigabytes of the company's telephone and internet records for surveillance purposes. 'The manual for the language includes a Hello World variant that shows you how to write a program that will parse logs of IP addresses and record them into permanent hashes. The program for parsing millions of records as they flow into permanent data farms sounds oddly close to the data mining the NSA performed after 9/11 to find targets for its warrantless spying on American citizens calls and emails."

30 of 119 comments (clear)

  1. Hancock.. worst name ever. by EveryNickIsTaken · · Score: 5, Funny

    What, was Palmdong taken?

    1. Re:Hancock.. worst name ever. by ByOhTek · · Score: 5, Insightful

      No, they thought Orwell would be too obvious.

      --
      Self proclaimed typo king, and inventor of the bear destroying coffee table (patent not pending).
    2. Re:Hancock.. worst name ever. by djasbestos · · Score: 5, Funny

      Eh, it looks close enough to C that it can, in the vein of C++ and C#, be referred to as C====>

    3. Re:Hancock.. worst name ever. by everphilski · · Score: 2, Funny

      see++ is what Google web clip called it this morning :P

    4. Re:Hancock.. worst name ever. by DavidHumus · · Score: 2, Funny

      How about "ICU"?

  2. Heard near Massachusetts... by UncleTogie · · Score: 2, Insightful

    "Hey, what's that whirring sound?"

    "It's the founding father this programming language is named after...spinning in his grave..."

    --
    Don't tell me to get a life. I'm a gamer; I have LOTS of lives!
  3. And what do facebook use? by ztransform · · Score: 2, Interesting

    Monitoring communities of interest is no doubt something of interest there..

  4. Variations by WED+Fan · · Score: 5, Funny

    We are already working on:

    • Hancock++ - Because a single + was not enough
    • H# - .NET version of the language
    • GNU/Hancock - Returns the results as an open source document and publishes it to the freakin' world
    • GoogleHancock - Datamines Chinese citizens and returns the results to party headquarters and the People's 9mm Ammunition Billing System
    • HancockScript - Great for client side mining
    --
    Politics is the art of looking for trouble, finding it everywhere, diagnosing it incorrectly and applying the wrong fix.
    1. Re:Variations by Anonymous Coward · · Score: 2, Funny

      pCock - Python variant

    2. Re:Variations by morgan_greywolf · · Score: 3, Funny

      Don't forget JCock - the J2EE version being promoted by IBM and Sun. IBM has also announced a version of WebSphere optimized for JCock and middleware called CockSphere.

      Finally, the Mozilla Foundation has announced a datamining extension for it's popular Web browser called Firecock.

    3. Re:Variations by Just+Some+Guy · · Score: 2, Funny

      Don't forget:

      • hancocK - the KDE version
      • Data Mining Language - the Gnome version
      • Diptheria - Miguel's version of H#
      • HerbieHancock - automated music librarian that tags 99% of your music as "pop crap" and deletes it. Also detects audiophile owners and scrubs their drives (to give them "more danceable sound").
      --
      Dewey, what part of this looks like authorities should be involved?
  5. !constitution by The+Iso · · Score: 5, Informative

    Hancock signed the Declaration of Independence.

    --
    "You don't need a weatherman to know which way the wind blows." - Bob Dylan
  6. Ummm.... by Otter · · Score: 5, Informative

    This is at least a decade old, was published in 2000 (I like the breathless "unearthed today", like it was some sort of secret -- the original Hancock paper is listed as having 29 cites) and has rather obvious applications for marketing, billing and security. The "oddly close to the data mining the NSA performed after 9/11" seems a bit excessive.

  7. Re:Ironic Name by jhsiao · · Score: 5, Funny

    Even more ironic that someone so focused on the rights in the Constitution would mistake it for the Declaration of Independence.

  8. Don't worry! by Peter+Trepan · · Score: 5, Insightful

    If you haven't done anything wrong, then you have nowhere to hide!

    Whoops - I mean nothing. Nothing to hide.

    --

    Step into a huge movement. Don't Tread In Me.

    1. Re:Don't worry! by Elyscape · · Score: 2

      Correction: if you have done nothing ***the goverment considers wrong*** you have nothing to hide.
      No, that's not how it works. In reality, if you've done nothing wrong, you have nothing to hide. The government will helpfully make something up and "hide" it for you, then pretend to be shocked when it "finds" it.
      --
      I own itburns.net. What should I put there?
  9. Hello world by $RANDOMLUSER · · Score: 4, Funny

    update Users set Status = 'suspicious' where Username in (SELECT Username, ipAddress, MissleAddress from IncomingCalls ic, OutgoinCalls oc where Volume = 'whispering' and Username not in (select Username from RepublicanDonors));

    --
    No folly is more costly than the folly of intolerant idealism. - Winston Churchill
  10. not a new language by roman_mir · · Score: 4, Informative

    this is a collection of libraries and some domain specific keywords/structures, but to say that this is a new language is a stretch of imagination.

  11. Re:That's the last thing we need! by ByOhTek · · Score: 5, Interesting
    While normally I'd quite agree with you, straight from the article (and not Zonk), right at the start:

    From the company that brought you the C programming language comes Hancock, a C variant developed by AT&T researchers to mine gigabytes of the company's telephone and internet records for surveillance purposes.


    less inflamitory, later it states:

    The system was built in the late 1990s to develop marketing leads, and as a security tool to see if new customers called the same numbers as previously cut-off fraudsters -- something the paper refers to as "guilt by association."


    It seems to have been created with slightly better intent (fraud detection, as well as, unfortunately, marketing - your phone company is spyware!).

    A tool may not necessarily be bad, but it can have more bad uses than good, and may be been intended for rathern malevolent purposes. The rack comes to mind (although this language certainly isn't in that league).
    --
    Self proclaimed typo king, and inventor of the bear destroying coffee table (patent not pending).
  12. *AFTER* 9-11? by erroneus · · Score: 2, Informative

    I think we've been seeing a trickling of stories and evidence showing that Bush/Cheney/Addington were ALREADY doing many 'questionable' things prior to 9-11. At the speed of government, doesn't it make you ask how they were able to cobble together the DHS?! And if I recall, some of the surveillance activities declined by Qwest were requested prior to 9-11.

    Bottom line? 9-11 is irrelevant to their intent... 9-11 helped provide some justification in the eyes of some, but the evidence shows that this stuff has been planned WELL in advance of 9-11 and this is not a reaction or over-reaction.

  13. Hello World in Surveillance Language by Lemming+Mark · · Score: 2, Insightful

    The manual for the language includes a Hello World variant

    Never has that program name been so fitting.

  14. John Hancock by Speare · · Score: 3, Interesting

    Jokes aside, is this related to John Hancock?

    John Hancock was an American Revolutionary, one of the signers of the Declaration of Independence. He signed it as largely and boldly as possible, much larger than any of the other signatures on that document, so that the King of England would have NO trouble identifying him in the face of his (and his compatriots) clear act of treason. His name is now synonymous with autograph or signature, as in, "Can I have your John Hancock here, please?"

    If the AT&T technical staff called their data mining "language" Hancock, it may have been a poetic choice: AT&T is signaling their actions, and/or the actions of the government agents, are akin to treasonous. Yes, the charge of 'treason' is nearly moot in modern US law, but the fact remains that any sensible reading of the Constitution would not indicate any authority for what the government is doing with our communications.

    --
    [ .sig file not found ]
    1. Re:John Hancock by IndustrialComplex · · Score: 3, Insightful

      Actually, I would think that by calling it Hancock, they are referring to the fact that people monitored are supplying their own Hancock simply through their actions.

      In other words, there would be no doubt as to who was behind the words coming from the machines. An involuntary Hancock as it were.

      --
      Out of modpoints but really liked a post? 1BDkF6TtmmeZ3yqXbz9yhdYVqRYnwFoXDj
  15. Re:Ironic Name by Jah-Wren+Ryel · · Score: 2, Funny

    Even more ironic that someone so focused on the rights in the Constitution would mistake it for the Declaration of Independence. We hold these truths to be self-evident, that all documents are created equal, that they are endowed by their Creators with certain identical Rights, that among these are Life, Liberty and the pursuit of Happiness
    --
    When information is power, privacy is freedom.
  16. Did anyone read up on the language? by Weslee · · Score: 4, Informative

    Its basically just C with some generic structures thrown on top of it.

    Also, it was created in 2000.
    Its intent, as some have mentioned, was marketing.
    Basically it does what Google Analytics or WebTrends does for the web.

    It actually seems like a nice language, for those who want to quickly run through gigs of data.

    I see nothing evil about the language itself.
    It, like C, perl, PHP, or any other language you chose to use - Can be used for whatever purpose the programmer chooses.
    Its intent was marketing, and almost every company in existence wants to know more about their customers.

  17. Hancock Written Before 2001 by squidguy · · Score: 3, Insightful

    Gee, can you conspiracy theorists take a break for a second and consider that, just perhaps, this was written for commercial telecom management, marketing and fraud detection purposes? It was written and in the public domain before 9-11.
    The US Government uses Linux, so are we to presume that Linus Torvalds is an agent of George Bush and the broad conspiracy to spy on you?

  18. AT&T may not have invented it entirely.... by Algorithmnast · · Score: 2, Interesting

    If you look here and research the case a bit, you'll find that a Maryland company may have actually been more responsible for ATT's abilities than ATT would like to admit. That company is now defunct, unfortunately, and so it's now safe for ATT to pretend that they've done work in the area without answering to more law suits.

    It was a very technically challenging job. We helped to index records for these guys until mid-2005. We did it in effectively O(n) time - the cool factor was higher than the say-nothing factor.

    And yes - I know that academia will claim that it's not possible, that data correlation must be O(n^2). For the decade that we did it, we were sure glad that academia held to that position.

    Enough reminiscing.

  19. Hancock source code by FleaPlus · · Score: 2, Informative

    Additionally, one can easily download the Hancock source code (for non-commercial use), manuals, and various research papers here:

    http://www.research.att.com/~kfisher/hancock/

    Conspiracy!

  20. You're almost right by roystgnr · · Score: 4, Funny

    But bear in mind, this programming language was invented by people who are so insecure that they're willing to shred the Fourth Amendment to try and assuage their fear of terrorists. I think C=> might be more accurate.

  21. Nm. We'll just keep our heads in the sand... by Anonymous Coward · · Score: 2, Informative

    Oh, good god.

    Either you must be new to this whole inter-tubes thing, or you're a right-wing apologist who's been assigned to ./.

    How about you go through the huge mass of stories reference here on Slashdot alone before whining about what everyone else is up to speed on, that you personally have been ignoring all this time. That link points to a large number of articles that touch on the subject (and several more showing that sadly, the US isn't the only government attempting to bloom into full-blown fascism using any possible excuse).

    Or, if you just want a very simple primer to get you started, how about these three, related to the original exposure of the ILLEGAL NSA wiretap program, additional evidence supporting the allegations, and the federal circuit ruling clearly declaring it to be ILLEGAL:
    The AT&T Whistleblower's Evidence
    Wired Releases Full Text of AT&T NSA Document
    Judge Rules NSA Wiretapping Unconstitutional

    This isn't FUD. This is the real deal smoking gun. The only conspiracy here is the one this administration is engaged in to circumvent any and all legal protections intended to, for very good reason, explicitly limit the power of the executive to do exactly what they're doing.