Slashdot Mirror

← Back to Stories (view on slashdot.org)

Twitter To Open Source Streaming Data Analyzer

Posted by timothy on from the right-sporting dept.

splitenz writes "Expanding the field of complex event process software with another offering, Twitter will release as open source its software for analysing live large-scale data streams, called Storm. Although the software has been compared to Hadoop, Storm is best suited for analysing live data streams, such as millions of Twitter feeds."

11 comments

  1. Netflow by Anonymous Coward · · Score: 0

    Hmm , I wonder if this would be good for Netflow analysis instead of using Silk.

  2. Why the link to secondary info? by La+Camiseta · · Score: 2

    The original blog post is here.

  3. Fifth post by Anonymous Coward · · Score: 0

    This is the lowest numbered post I've ever made on /. ... what's going on? Noone gives a crap about twitter?

  4. Yes by improfane · · Score: 1

    Nobody really cares about Twitter. It's a fad.

    You could code a crude Twitter in one night.

    --
    Slashdot needs Geekcode | Can anyone recommend any good SCIFI? My tastes: Foundation, Startide Rising, CITY, Ringworld,
    1. Re:Yes by fuzzytv · · Score: 1

      Except that the post is not about Twitter. It's about a tool they use they developed and use to analyse the stream of data. And they're dealing with a lot of data, so the tool might be really interesting.

      And yes, you could code a crude Twitter in one night, the only problem is it'd support about 3 users while Twitter is used by millions. So this goes to the same drawer like "I can run Google on a single LAMP box" and other similar ideas.

  5. Yet nobody cares by improfane · · Score: 1

    Even so, it's still about Twitter and nobody actually cares. Have you noticed we're not really talking about it and having a metadiscussion?

    Of course it would scale, my point is Twitter is such a trivial application of technology. The scaling technologies used for Twitter would work for other applications. Hence, Twitter is nothing special or significant.

    --
    Slashdot needs Geekcode | Can anyone recommend any good SCIFI? My tastes: Foundation, Startide Rising, CITY, Ringworld,
    1. Re:Yet nobody cares by improfane · · Score: 1

      would not scale*

      --
      Slashdot needs Geekcode | Can anyone recommend any good SCIFI? My tastes: Foundation, Startide Rising, CITY, Ringworld,
    2. Re:Yet nobody cares by marmotte · · Score: 1

      however trivial twitter may look, it's a perfect huge stream of data for the netflow software TFA is about. btw twitter is valued $7 Billion, are you coding something significant tonight ?

    3. Re:Yet nobody cares by improfane · · Score: 1

      We are in a bubble. It's not actually worth that. Yes I am :-)

      --
      Slashdot needs Geekcode | Can anyone recommend any good SCIFI? My tastes: Foundation, Startide Rising, CITY, Ringworld,