Slashdot Mirror


Twitter Blocks Feds From Data Mining Service (usatoday.com)

An anonymous reader cites a report on USA Today: Online social media company Twitter has reportedly blocked U.S. intelligence agencies from access to a widely used data mining service it partly owns. Twitter told Dataminr, the business partner that sifts through and provides access to the full output of the San Francisco-based firm's social media postings known as tweets, that it didn't want the service provided to government investigators, The Wall Street Journal reported Monday. Twitter made the decision because the company did not like the "optics" of appearing too close to U.S. spy agencies, the Journal reported, citing an unidentified intelligence official. The issue could further escalate the public privacy vs. government security tensions between high tech firms and the federal government as investigators seek access to social media and other electronic data in an effort to detect and avert suspected terrorist plots. Newsweek's Kenneth Li said: "This makes no sense. So, dataminr's hedge fund customers are ok, but not the government?"

60 comments

  1. Hmmm.... What to believe? by KGIII · · Score: 4, Insightful

    Do they really mean what they say or did they "block them" from this service while giving them an all you can drink tap right at the source? What's to stop the Feds from accessing the service under a fictitious name or via a legitimate company?

    I really am turning into a conspiracy theorist. :/

    It's hard to tell these days.

    --
    "So long and thanks for all the fish."
    1. Re:Hmmm.... What to believe? by ArylAkamov · · Score: 5, Insightful

      What's to stop the Feds from accessing the service under a fictitious name or via a legitimate company?

      Nothing, it's just a PR stunt. Like the summary said:

      "Twitter made the decision because the company did not like the "optics" of appearing too close to U.S. spy agencies"

      It's all about appearances.

    2. Re:Hmmm.... What to believe? by Anonymous Coward · · Score: 1

      Do they really mean what they say or did they "block them" from this service while giving them an all you can drink tap right at the source? What's to stop the Feds from accessing the service under a fictitious name or via a legitimate company?

      I really am turning into a conspiracy theorist. :/

      It's hard to tell these days.

      Anybody worried about "the Feds" snooping on their Twitter account is doing it wrong.

      "I want to publish information publicly, but I only want people who I want to have the information to be able find it. Also, I don't want to answer queries about if person X or person Y should have it, the computer should just know if I want them to have it or not. And, it should also figure out if I don't want that person to have that information in the future, and refuse to give it to them in the present."

      Yeah, neither The Internet nor The World works that way.

    3. Re: Hmmm.... What to believe? by Anonymous Coward · · Score: 0

      Dave, welcome to the dark side :P

      A place where the unthinkable happens. Make
      Yourself at home, we are glad to have you. Hehe

    4. Re:Hmmm.... What to believe? by Locke2005 · · Score: 1

      Pretty much my thought... they claim they are "blocking" the Feds, when the Feds can just start up a "private" company and let it access the database for them (as if they don't already have plenty of fake companies they use to provide spies with resumes). Twitter keeps positive deniability about protecting users privacy, despite the fact that they are effectively allowing ANYONE to access the data! The only question is, does twitter know about the 3rd party company the Feds are going through for access or not?

      --
      I've abandoned my search for truth; now I'm just looking for some useful delusions.
    5. Re:Hmmm.... What to believe? by Flavianoep · · Score: 1

      They are completely right. The only acceptable use of data analysis is to serve tailored ads to costumers. Way to go, Twitter, Inc.! Keep our data safe from the boogeyman government of evil.

      --
      Linux is for people who don't mind RTFM.
    6. Re:Hmmm.... What to believe? by Anonymous Coward · · Score: 0

      If you reject the anti-government madness that's so popular on this conspiracy blog, you'll see the absurdity in blocking people who would use the publicly available twitter data to catch criminals, which is a useful part of government work, while allowing access to marketing jerks who want to monitor people who have done nothing wrong, other than post comments via Twitter.

    7. Re:Hmmm.... What to believe? by TheCarp · · Score: 1

      > Do they really mean what they say or did they "block them" from

      Right there is where the doublespeak starts.

      The thing is, everybody knows the intelligence agencies use front companies. So, if the data sharing is available to everyone else, they can easily get it by just....not disclosing who they really are. They just, get access through a front. Problem solved.

      This is 100% CYA and misdirection. The only barrier they want to create is one around the truth of what they share and wan to keep sharing with "businesses" which may or may not just happen to contain fronts for intelligence services.... but....not them directly....because that may provoke scrutiny.

      --
      "I opened my eyes, and everything went dark again"
    8. Re:Hmmm.... What to believe? by JustAnotherOldGuy · · Score: 1

      Lol, they think they've blocked the Feds, but that's like blocking an unpopular opinion or winning the War On Drugs (or Terror, or Knitting, or whatever).

      This sounds like a little kid hiding under a blanket and going, "You can't see me!"

      --
      Just cruising through this digital world at 33 1/3 rpm...
    9. Re: Hmmm.... What to believe? by KGIII · · Score: 1

      LOL I *know* who you are Mr. AC... :P

      --
      "So long and thanks for all the fish."
    10. Re:Hmmm.... What to believe? by KGIII · · Score: 2

      I wonder if they even believe it themselves? Seriously, I'm turning into quite a conspiracy kook or something. I mean, yeah, I fully expected what Snowden released but what more is there?

      As for this? It's well known that the Three Letter Agencies use front companies. So, a company called New Standard Aggregates INC is now just buying the data. They get the PR boost and they people actually believe that the feds are having to revert to scraping the site with scripts. Or, maybe, they have no idea that the Feds can just scrape the site - seeing as it's public. Hell, I can scrape the site - though I might need to use multiple connections to keep up with it. Okay, so I'd need lots of fat pipes to keep up with all the data going to them but I can order that and just use VPNs. I wouldn't even have to leave my house. I doubt I'd even have to script it - I'd just use HTTrack and a bunch of VPNs and scoop until my heart's content.

      No, I won't get GEO IP location and things like that but I can probably do something to automate locating the posters. More so if I were the NSA and had access to the pipes.

      --
      "So long and thanks for all the fish."
    11. Re:Hmmm.... What to believe? by KGIII · · Score: 1

      > The only question is, does twitter know about the 3rd party company the Feds are going through for access or not?

      Plausible deniability. I guess it's a thing for companies too. I was mentioning below, it's public data - posted on a public server. Give me a handful of VPNs so that I can get enough bandwidth into it and I can scrape the site in real time. On top of that, this is the Feds - they've got access to the pipes and probably have more aggregate data than even Twitter has.

      --
      "So long and thanks for all the fish."
    12. Re:Hmmm.... What to believe? by KGIII · · Score: 1

      Yeah, I don't think they can really stop 'em. In a reply below, I indicated a couple of ways to just grab the damned data even if they don't give me permission. Given that the Feds almost certainly have lots of bandwidth and raw access to the pipes via the providers, I'm thinking they don't really need permission. I've got three disparate DSL connections in Maine and one cable connection here in Florida - I could saturate my lines and pull down nothing but text and probably scrape quite a bit of it without even needing to rely on a handful of VPS instances or spinning up something at Amazon. That won't get me IP addresses and other data but it'd get me quite a bit.

      Now that I think about it a bit more - they've got machine learning down pretty well. I'm not familiar with it (but I'm a little interested in learning more about it) but it could probably be set up to just grab certain types of feeds and to ignore those from everyone from Aunt Jenny to the movie theater announcements. It could probably be set to just grab the more juicy feeds and reduce the bandwidth and compute cycles needed. Aggregated with other public information, I could probably pull a bunch of stuff down and narrow things down quite nicely - even if I don't have much else for starting information.

      --
      "So long and thanks for all the fish."
    13. Re:Hmmm.... What to believe? by Anonymous Coward · · Score: 0

      You assume that the only information available to them is what is posted on the website. Its not crazy to assume that behind the curtains they also log IP addresses, GPS coordinates, device IDs, etc. In some cases with that kind of information the government could create tracking logs for peoples daily lives. One of the reasons I get really touchy when phone apps demand all kinds of additional permissions that seem to be in no way necessary for their outward operation (device ID, photos, call log & address book access for a weather app? Please).

    14. Re:Hmmm.... What to believe? by s.petry · · Score: 1

      I wonder if they even believe it themselves? Seriously, I'm turning into quite a conspiracy kook or something. I mean, yeah, I fully expected what Snowden released but what more is there?

      Evaluation from the perspective of "Government is potentially evil" is not "kook", and does not make you one. There has been a huge amount of propaganda which makes one think that, but it's a psychological war. Go back to the 1970s and read Gary Allen and Milton Friedman, and read what people wrote about them. Or perhaps consider what was not said about them in US media, while other talking heads became main stream.

      Government does not have morality on it's own and can be neither "good" or "evil". The people controlling government however can be good or evil.

      I generally laugh at people who claim "conspiracy" as though such a thing is impossible. Imagine a world where several people wielding power refused to speak to each other and plan to gain more power. It would never happen, but you could imagine it.

      Questioning does not make one a kook, in fact I'll argue that it takes more sanity to question everything than it does to simply accept what you are told. It's amazing how many people become manic about protecting their belief and try to shut down your questions. That latter part is insanity.

      --

      -The wise argue that there are few absolutes, the fool argues that there are no probabilities.

    15. Re: Hmmm.... What to believe? by Anonymous Coward · · Score: 0

      It's not a theory when it's true.

      The USA I was propaganda-raised to love doesn't exist ... wonder if it ever did.

    16. Re: Hmmm.... What to believe? by Anonymous Coward · · Score: 0

      Lol. The number of Gov apologist who think big brother is there 'for the people' is staggering. Pull the shit out of your eyes, the cotton balls out of your ears & wake the fuck up.

    17. Re: Hmmm.... What to believe? by KGIII · · Score: 1

      I doubt it ever really did. I'm pretty old and the lies seem to be fewer now than they were when I was younger. I'm mixed racially and lived in the American South East at first. I was born in 57.

      --
      "So long and thanks for all the fish."
    18. Re:Hmmm.... What to believe? by Coren22 · · Score: 1

      The National Student Association? The Culinary Institute of America?

      Where does it stop!

      --
      APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
    19. Re:Hmmm.... What to believe? by cavreader · · Score: 1

      " appearing too close to U.S. spy agencies" Are they applying the same rules for non-US spy agencies?

  2. So you get a subpoena... by mlw4428 · · Score: 1

    ...and hit up the consumers of the data for that information. "Give us all of the information about this Twitter account that you have and tell no one." Meanwhile it'll be 3rd party advertising firms who don't care/have an image to maintain and are incompetent enough to hand the Feds the keys to ALL of the information. Twitter at least could siphon what information it releases.

    It's a PR stunt, it literally does nothing to curtail information flow. If you want to be anonymous, quit using the internet.

    1. Re:So you get a subpoena... by Anonymous Coward · · Score: 0

      If you want to be anonymous, quit using the internet.

      No, go to your local hackerspace and ask for some help. If they don't know anything, do the research yourself and then school them (give a talk). That's how hackerspaces work. That's what hacking is.

      Peace be with you.

    2. Re:So you get a subpoena... by Anonymous Coward · · Score: 0

      When you think about it advertising third parties are the perfect ones to collect the information and to launch the hack attack as well.

    3. Re:So you get a subpoena... by mlw4428 · · Score: 1

      "Hackerspace" is this the millennial term for computer clubs?

    4. Re:So you get a subpoena... by Locke2005 · · Score: 1

      Hackerspace is the millenial term for the place that the guys that aren't getting laid hang out... (and I should know!)

      --
      I've abandoned my search for truth; now I'm just looking for some useful delusions.
    5. Re:So you get a subpoena... by jeffmflanagan · · Score: 1

      It has some aspects of a computer club, but it's more like a shared workshop. A hackerspace has the tools you need to build physical objects.

    6. Re:So you get a subpoena... by Anonymous Coward · · Score: 0

      A hackerspace has the tools you need to build physical objects.

      That's a makerspace.

    7. Re:So you get a subpoena... by Anonymous Coward · · Score: 0

      It's a 2016 term for "computer club", regardless of age. If you think about it, calling everything with electronics in a it a "computer" is silly and imprecise. Even the RaspberryPi isn't a computer. It's a microcontroller, with significant computing capability.

  3. the real reason... by Lead+Butthead · · Score: 2

    "pay us. we're not doing this for free."

    --
    ELOI, ELOI, LAMA SABACHTHANI!?
    1. Re:the real reason... by i.r.id10t · · Score: 2

      Indeed. And just how enforceable are the terms of service for a service like this? IE, if the terms include "using your real business name" - ie, allow folks who are DBA'ing as Foo Corp to use Foo Corp even though ti is really an individual - and "not reselling or allowing access by others" - so Foo Corp can't allow his drinking buddy Bar Corp to use his account "to check on something" - woudl that be enough to prevent the feds from using a corporation, etc? Because the service can certainly say "oh, we won't sell an account/access to any government agency" - after all, that isn't discrimination based on race, religion, etc.

      --
      Don't blame me, I voted for Kodos
    2. Re:the real reason... by Anonymous Coward · · Score: 0

      http://brightplanet.com/bluejay/

    3. Re:the real reason... by JustAnotherOldGuy · · Score: 1

      "Without BlueJay, we would not have had the situational awareness to effectively act upon such a time-sensitive situation."

      TRANSLATION:

      "Without BlueJay, we would not have been able to keep tabs on all of these citizens."

      And they bill themselves as a "Law Enforcement Crime Scanner". Yippee.

      --
      Just cruising through this digital world at 33 1/3 rpm...
    4. Re:the real reason... by KGIII · · Score: 1

      I think you and I should sign up for our free 7 day trial!

      I don't think you need a license to call yourself a private investigator. It's easy enough to incorporate so we can hide our names. I kind of want to see what's on the other side of that site. Where's HumpWumpus? He'd probably be game for this with us.

      --
      "So long and thanks for all the fish."
    5. Re:the real reason... by JustAnotherOldGuy · · Score: 1

      I think you and I should sign up for our free 7 day trial!

      Oh yeah, no way that would get us put on any list. lol

      Just knowing it's out there raises all sorts of evil possibilities, though. Think about it...what would it take to trigger some police agency's button and make them respond. It'd be like swatting, more or less.

      --
      Just cruising through this digital world at 33 1/3 rpm...
    6. Re:the real reason... by KGIII · · Score: 1

      Great minds think alike. I mean, we're just raising awareness for a cause, right? Right? Right...

      *whistles innocently*

      We can even get credit cards in the corporation's name. Have it held by lawyers so we get an added degree of protection from disclosure.

      Yeah, we're going on a list. I doubt it's a crime but we're gonna have to fly charter everywhere we go and our stops at customs are going to be extra long and have a few extra questions. But hey, we'll be famous!

      --
      "So long and thanks for all the fish."
  4. LOL...."block them" by Anonymous Coward · · Score: 0

    ...um, Twitter....lol

  5. The "optics" of helping enemies are better? by mi · · Score: 2

    Twitter made the decision because the company did not like the "optics" of appearing too close to U.S. spy agencies

    So, ISIS using Twitter is tolerable, but US government — no, that's just wrong?

    Ah, well, they started to go after "violent extremism" too now, finally. The "optics" must've gotten really bad...

    Unfortunately, they don't distinguish between terrorists and, for example, Ukrainians defending their country.

    --
    In Soviet Washington the swamp drains you.
    1. Re:The "optics" of helping enemies are better? by Nutria · · Score: 1

      And what's twitter doing to stop China and Russia from using it's APIs?

      --
      "I don't know, therefore Aliens" Wafflebox1
    2. Re:The "optics" of helping enemies are better? by Anonymous Coward · · Score: 0

      I would have up-modded you, but I can't approve of the deranged wingnut meme in your sig. You need to find better friends.

    3. Re:The "optics" of helping enemies are better? by Anonymous Coward · · Score: 0

      I would have up-modded you, but I can't approve of the deranged wingnut meme in your sig

      And I would've donated your upmod to charity, asshole.

      That meme you denounce is much classier than the original, which it parodies...

  6. Hmmm by Hognoxious · · Score: 3, Funny

    I take it the cheque bounced?

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    1. Re:Hmmm by Anonymous Coward · · Score: 0

      Yeah, this. Strongarm negotiation tactic. The Twitter bosses got annoyed with a beaurocrat's sense of entitlement and decided to remind him that their company controls the public sentiment which decides the re-electibility of his boss's boss.

    2. Re:Hmmm by Anonymous Coward · · Score: 0

      More like they're shaking down the feds for more money.

  7. What's to stop them? by Anonymous Coward · · Score: 0

    Newsweek's Kenneth Li said: "This makes no sense. So, dataminr's hedge fund customers are ok, but not the government?"

    Plus, what's to stop the gov't from hiring some university or industrial researchers and telling them "go mine Twitter, here a few pointers to the sorts of things that interest us, and let us know if you find anything"?

    It doesn't even have to be that obvious. There are plenty of more sublte (devious?) ways of accomplishing the same thing.

  8. What's to stop them? by Anonymous Coward · · Score: 0

    Newsweek's Kenneth Li said: "This makes no sense. So, dataminr's hedge fund customers are ok, but not the government?"

    Plus, what's to stop the gov't from hiring some university or industrial researchers and telling them "go mine Twitter, here are some pointers on the sorts of things that interest us, tell is if you find anything, and if anyone asks we were never here"?

    It doesn't even have to be that obvious. There are plenty of other sublte (devious?) ways of getting the information.

  9. B-b-but... by Anonymous Coward · · Score: 0

    How will the Feds know when I take my next poo, now?

    1. Re:B-b-but... by Locke2005 · · Score: 1

      So, you're a "twitter shitter", then?

      --
      I've abandoned my search for truth; now I'm just looking for some useful delusions.
    2. Re:B-b-but... by JustAnotherOldGuy · · Score: 1

      So, you're a "twitter shitter", then?

      He really needs to get with the times and buy himself an internet-enabled toilet. Manual poo-alerts are so 2006!

      --
      Just cruising through this digital world at 33 1/3 rpm...
  10. Hey by Kierthos · · Score: 2

    At least the corporations using this data-mining are being honest about what they're using it for. The government? "Hey, we need to look at this. For reasons. And you can't tell anyone."

    --
    Mr. Hu is not a ninja.
    1. Re:Hey by Anonymous Coward · · Score: 1

      The US government actually has rules on how they can use and store the data - corporations can do whatever they want with it. It amazes me how people have no problem giving corporations access to everything in their lives, but get upset when the government gets a peak. While it is BS for the government to have access to private data without a warrant, it is idiotic to think it is OK provide corporations with the data to a public service but not the US government. Meanwhile foreign spy agencies have full access to the data...

  11. bleeding money, twitter investors respond. by zlives · · Score: 1

    hey big gov... pay us like all the other clients for our data.

  12. that's okay by Anonymous Coward · · Score: 0

    they can just ask the library of congress. they keep every single tweet.

  13. Makes No Sense by Anonymous Coward · · Score: 0

    Newsweek's Kenneth Li comment that: "This makes no sense. So, dataminr's hedge fund customers are ok, but not the government?" Itself makes no sense.

    Is Mr. Li living in a cave? Does he work under a rock? Is he unaware of the current security environment and the tension between the Three Letter Agencies and the tech community?

    Maybe it makes no sense to Mr. Li but it makes perfect sense to me.

    And yes, this could be pure optics and PR for Twitter. Or it could be an entirely real effort to limit the scope of government snooping (the effectiveness of that would be in question).

    The TLA's did this to themselves. They are reputationally damaged and under suspicion of constitutional violations. The whole "don't worry, we are experts, trust us, we'll never betray you" line they have been subliminally broadcasting has worn thin and lots of people no longer believe it.

    1. Re:Makes No Sense by Anonymous Coward · · Score: 0

      It also makes sense because: (1) hedge fund customers are paying for the services and operations and (2) government is expecting free access while also charging taxes. Democratic government encourages capitalism yet expects a free ride at the same time.

  14. Black listing like spammers? by Okian+Warrior · · Score: 1

    I've often wondered if someone could set up a black-list of government-owned computers.

    This could be set up and managed much like the SPAM black lists or the AdBlock lists - managed by an interested party, using information submitted by the public. Execute "sudo apt-get install govblock", and your system automatically sends a 404 response to requests from government computers.

    Now, anyone with an inkling of how the net works will realize that this is trivial to get around, but consider it from the point of view of the (for example) FBI: you are the IT director for the building, and you need a way to route these requests through an external computer somewhere not in the building.

    That's an enormous amount of work for the FBI, and it could come to naught if someone figures it out and puts the external computers on the black list. It's easy for an individual to do, not so much for an organization.

    You could automatically block all access within, say, 35 miles of Pennsylvania Ave in Washington. That would cover the FBI and pretty-much *all* of its employees. This means that an employee can't even browse from their home and send the results to the office.

    A handful of 35-mile blocked geolocated areas would put a big damper on government intrusions. The loss in viewership would be minimal.

    Just a thought.

    It's only a matter of time before the public steps in and solves the surveilance problems once and for all.

    1. Re:Black listing like spammers? by KGIII · · Score: 1

      They have had block lists for the P2P file systems for ages. i don't know how well they work or anything but they exist. They're supposed to stop you from sharing with people who work for the companies that find people who are violating copyright laws - including some companies that specialize in that.

      I imagine it'd be marginally effective but it's pretty easy for them to get a new IP address and just pretend it's located anywhere in the world.

      Hmm... Do a Google search for:

      "block federal government IP addresses"

      That turns up some interesting results - including a data dump of IP addresses. I guess we could set up a honey pot aimed at attracting the feds. "Free bribes and donuts. Click here!" Then just assume they're all police or government representatives.

      --
      "So long and thanks for all the fish."
  15. Ask me about LSIE and a mountain by Anonymous Coward · · Score: 0

    The feds already have at least two scraping services extant. The old one was called Large Scale Internet Extraction (LSIE), the current one is K2, Everest, Ranier, or Kilimanjaro. They don't need dataminr

  16. Why is this so hard to understand? by Anonymous Coward · · Score: 0

    Newsweek's Kenneth Li said: "This makes no sense. So, dataminr's hedge fund customers are OK, but not the government?"

    Yeah, Ken, let me see if I can break it down for you a little bit ... hedge funds don't put people in jail ... does that help?

  17. Sense by Anonymous Coward · · Score: 0

    "This makes no sense. So, dataminr's hedge fund customers are ok, but not the government?"

    It makes perfect sense, the worse hedge fund customers can do is try to sell you something. The government can send armed people to your door who can shoot you for next to no reason and suffer no meaningful consequences. And before someone says "well they're going after bad people" I suggest you look up SWATing, misuse of tactical teams (Berwyn Heights assault on mayors home) and police overreactions (Boston "bomb" scare).

  18. Assuming by Anonymous Coward · · Score: 0

    ... issue could further escalate the public privacy vs. government security tensions ...

    How? The NSA is obviously allowed to spy on US soil. Assuming they've got the raw feed (via mass surveillance) and don't want to do their own analytics, a classic intelligence operation is in the offing: Find an insider, persuade/pay/blackmail him to install spyware, business as usual. The NSA doesn't need to attack Twittr directly, spying on 3 or 4 of their customers will provide the same data.

    Once again, the intelligence organisations want to suck in more data for their push-button answers. This lot is pre-processed, which is a step in the right direction but it's still worthless without human analysts to filter it.