Slashdot Mirror


Web Analytics Databases Get Even Larger

CurtMonash writes "Web analytics databases are getting even larger. eBay now has a 6 1/2 petabyte warehouse running on Greenplum — user data — to go with its more established 2 1/2 petabyte Teradata system. Between the two databases, the metrics are enormous — 17 trillion rows, 150 billion new rows per day, millions of queries per day, and so on. Meanwhile, Facebook has 2 1/2 petabytes managed by Hadoop, not running on a conventional DBMS at all, Yahoo has over a petabyte (on a homegrown system), and Fox/MySpace has two different multi-hundred terabyte systems (Greenplum and Aster Data nCluster). eBay and Fox are the two Greenplum customers I wrote in about last August, when they both seemed to be headed to the petabyte range in a hurry. These are basically all web log/clickstream databases, except that network event data is even more voluminous than the pure clickstream stuff."

15 of 62 comments (clear)

  1. Re:Web Analytics Databases Get Every Larger? by Rosco+P.+Coltrane · · Score: 0, Offtopic

    Actual, yes there was. It's a very subtly new rule on the properly use of adverbs and adjectives.

    --
    "A door is what a dog is perpetually on the wrong side of" - Ogden Nash
  2. Re:"Every larger"? by Anonymous Coward · · Score: -1, Offtopic

    I'd prefer "every lager" - but then again, I may be a bit strange.

  3. Re:from the who-edits-the-oh-never-mind dept. by Rosco+P.+Coltrane · · Score: -1, Offtopic

    CmdrTaco is a plain white-bread murriken who has had a couple of decades to practice the language.

    So are you saying he was mute (or spoke native Klingon) until 13 years of age? No wonder he has hard times with english today...

    --
    "A door is what a dog is perpetually on the wrong side of" - Ogden Nash
  4. Re:from the who-edits-the-oh-never-mind dept. by fbjon · · Score: 0, Offtopic

    CmdrTaco is a plain white-bread murriken

    It's a little known fact that he's actually multi-grain.

    --
    True confidence comes not from realising you are as good as your peers, but that your peers are as bad as you are.
  5. FAIL by ZwJGR · · Score: 0, Offtopic

    Slow news day alert!

    The topic in question is blindingly obvious to anyone who has heard of this newfangled "Internet" thing, and frankly is not worth an article in the first place.
    Furthermore, such a blatant error in the headline and summary is simply ridiculous. Do the submitters or editors not reread text prior to submission? This is sloppy /. reporting at it's finest... For shame.

    --
    There is no psychiatrist in the world like a puppy licking your face - Ben Williams
    1. Re:FAIL by hoover · · Score: 0, Offtopic

      OTOH, you fail at "its" and "it's". ;-)

      --
      Ever wondered whats wrong with the world? http://www.ishmael.org/
  6. All your Gramar checker are belong to us! by edwardd · · Score: -1, Offtopic

    Take off every 'ZIG'!!

    Seriously, did anyone read this before posting?

  7. Analytic DBs are also not cheap by Anonymous Coward · · Score: -1, Offtopic

    Teradata is getting a run for it's money from Vertica - started by the guy who wrote PostgreSQL.

  8. I accidentally the every larger database... by magic_fyodor · · Score: 1, Offtopic

    is this ok?

  9. Hmmmm by Zouden · · Score: -1, Offtopic

    Slashdot Editors Get Every Lazier.

    --
    "A week in the lab saves an hour in the library"
  10. Re:"Every larger"? by Maclir · · Score: -1, Offtopic

    No - I want "every lager".

  11. Re:"Every larger"? by value_added · · Score: -1, Offtopic

    What's "every larger"?

    The sum total of "each larger"?

    Seriously, kids, if we're going to call a typo ("every" instead of "ever") a grammatical error, I'd suggest a critique of the rest of the submission is in order. Bonus points for finding real errors. And the usual mod points for everyone else contributing hand-wavy cliches like "language evolves" to justify things.

    Me, I'm still choking on the "enormous metrics" construct. I wonder how well complimenting a woman on the size of her metrics would go over.

  12. Every breath you take... by Anonymous Coward · · Score: -1, Offtopic

    Every search you take
    Every click you make
    Every connection you break
    Every ad you take
    I'll be logging you

    By the cyber-police, of course.

  13. Help with the Fractions by bigdaisy · · Score: 0, Offtopic

    2/12 can be expressed more simply as 1/6.

  14. They are watching YOU by aggles · · Score: 0, Offtopic

    If you have ever touched one of their Web sites and caught their cookie, your tracks can be followed into unexpected places. This data is a gold mine for them, if they can figure out how to sell it without pissing off users with how much they know.