Slashdot Mirror


Slashdot Posting Bug Infuriates Haggard Admins

Last night we crossed over 16,777,216 comments in the database. The wise amongst you might note that this number is 2^24, or in MySQLese an unsigned mediumint. Unfortunately, like 5 years ago we changed our primary keys in the comment table to unsigned int (32 bits, or 4.1 billion) but neglected to change the index that handles parents. We're awesome! Fixing is a simple ALTER TABLE statement... but on a table that is 16 million rows long, our system will take 3+ hours to do it, during which time there can be no posting. So today, we're disabling threading and will enable it again later tonight. Sorry for the inconvenience. We shall flog ourselves appropriately. Update: 11/10 12:52 GMT by J : It's fixed.

262 comments

  1. Only one thing to say by bernywork · · Score: 5, Funny

    *Clap clap clap*

    --
    Curiosity was framed; ignorance killed the cat. -- Author unknown
    1. Re:Only one thing to say by sH4RD · · Score: 1

      Hah. I win.

      --
      WASTE - The Secure P2P
    2. Re:Only one thing to say by LiquidCoooled · · Score: 2, Interesting

      Update: 11/10 12:52 GMT by J : It's fixed.

      Nothing like a 3 hour update taking 18 hours.
      (though I suppose the + can mean 15hours... :P)
      Are we gonna find out what happened to the time space continuum?

      You should call in Hiro Nakamura.

      --
      liqbase :: faster than paper
    3. Re:Only one thing to say by trupoet · · Score: 0

      LOL reminds me of SOE downtimes

    4. Re:Only one thing to say by Pneuma+ROCKS · · Score: 1

      Well, the post claims that it would take 3+ hours to execute the statement. It didn't say anything about how long it would take to put those changes in the production site. I mean, I would assume that the site was running on a mirror database while the reconstruction happened. Doing the switch is not so trivial in a website as big as Slashdot...

      18 hours is a pretty good response time, considering that this is not a banking site or anything of the sort.

      And yes, I know you were just being funny. :P

      --
      Favorite quote: "
    5. Re:Only one thing to say by larry+bagina · · Score: 1

      considering it would take 46 minutes to reindex with postgresql... and postgresql wouldn't have had the problem in the first place... and postgresql 8.2 can do the reindex with no downtime, that's not a good response time.

      --
      Do you even lift?

      These aren't the 'roids you're looking for.

    6. Re:Only one thing to say by WilliamSChips · · Score: 1

      Actually I think Mikah(whom we just learned can do things to machines) would be more able to figure out what's happening with Slashdot's server than Hiro.

      --
      Please, for the good of Humanity, vote Obama.
    7. Re:Only one thing to say by WilliamSChips · · Score: 1

      Considering that postgresql didn't exist when Slashdot was invented, and Slashdot has quite a few MySQLisms in its code now, and Slashdot also has a custom version of MySQL, that's not a viable option.

      --
      Please, for the good of Humanity, vote Obama.
  2. Sorry, could not resist. by Noryungi · · Score: 2, Insightful
    we shall flog ourselves appropriately


    Please do.
    --
    The right to offend is far more important than the right not to be offended. (Rowan Atkinson)
  3. So does a first post ... by AppHack · · Score: 5, Funny

    ... roll over to be a last post?

  4. D'oh. by NeuralAbyss · · Score: 5, Insightful

    Anyone could have made the mistake.. good to keep us all in the loop though :)

    And let this be a reminder to the kids - RTFM, twice!

  5. Disable posting!!11oneone by vogon+jeltz · · Score: 1

    Oh, ...... never mind.

  6. fantastic by kook44 · · Score: 1

    d'oh

  7. I for one by MrBulwark · · Score: 5, Funny

    welcome our 2 to the power of X overlords.

    1. Re:I for one by shoolz · · Score: 1

      I for one welcome the death of that used-up meme.

  8. Last post! by buro9 · · Score: 5, Funny

    Last post!

  9. who we should REALLY blame by admdrew · · Score: 5, Funny

    Alright, who's the joker who posted the 16,777,216th comment?

    Thanks for breaking slashdot, jerk :D

  10. Nice by Anonymous Coward · · Score: 0

    Great work.

  11. Oh Noes! by The+Mysterious+X · · Score: 5, Funny

    Its like y2k, only worse!

    1. Re: Oh Noes! by PFI_Optix · · Score: 4, Funny

      "it's like y2k but worse"

      I know what you mean. Y2K was supposed to put an end to civilization, but at least we'd have been able to post on slashdot.

      --
      120 characters for a sig? That's bloody useless.
    2. Re: Oh Noes! by Anonymous Coward · · Score: 0

      Blah. This is stupid text. Blah blah. Mod me offtopic, kthx.
      Blah. This is stupid text. Blah blah. Mod me offtopic, kthx.
      Blah. This is stupid text. Blah blah. Mod me offtopic, kthx.
      Blah. This is stupid text. Blah blah. Mod me offtopic, kthx.
      Blah. This is stupid text. Blah blah. Mod me offtopic, kthx.

    3. Re:Oh Noes! by 2078 · · Score: 0

      More like, "It's like y2k, only real!" ;-)

  12. Oops by Irish-DnB · · Score: 2, Funny

    As Nelson Muntz would say "HA HA"

    --
    If it's too difficult, I can't understand it !
  13. Congrats taco by LiquidCoooled · · Score: 5, Interesting

    Does this mean that comment id#16777215 has the longest thread in history?

    Can anyone actually find it to see - I tried but could only get to 16777217, its likely to be in a journal or just a reply to an older article.

    --
    liqbase :: faster than paper
    1. Re:Congrats taco by The_Wilschon · · Score: 2, Informative
      Does this mean that comment id#16777215 has the longest thread in history?
      Not likely. The parent pointer doesn't just max out (I would think, but I don't know how SQL handles things like this), but rather roll over. So many comments would point at random other comments as their parent. Except that nearly all of these would in fact be in a different article, and would therefore not form a thread.
      --
      SIGSEGV caught, terminating

      wait... not that kind of sig.
    2. Re:Congrats taco by LiquidCoooled · · Score: 2, Informative

      Before they did the fix the parents were pointing at 16777215 (which is why clicking parent displayed a dodgy template.

      The reason why the thread for comment 16777215 is not massive is because the comments now use a double key, ParentID(cid) and StoryID (sid) - displaying a thread is now "select ..... where cid=yourparent and sid=yourstory"

      --
      liqbase :: faster than paper
    3. Re:Congrats taco by Bastard+of+Subhumani · · Score: 1, Insightful
      Except that nearly all of these would in fact be in a different article, and would therefore not form a thread.
      Like anyone would notice.

      To get back on topic, my heart say's perl, but my head says .net
      --
      Only three things are certain; death, taxes, and apocryphal quotations - Ben Franklin.
    4. Re:Congrats taco by The_Wilschon · · Score: 1

      Interesting. I hadn't noticed that. I had seen the dodgy template, but didn't notice its CID. That's very odd that the integer values clamp to the max, rather than rolling over. I wonder why it would be implemented that way.

      --
      SIGSEGV caught, terminating

      wait... not that kind of sig.
  14. I sense a disturbance in the force by Anonymous Coward · · Score: 5, Funny

    As if a thousand geeks all made the same damn "last post!" joke at once. . . . . .

  15. Better make it longer by The_Wilschon · · Score: 3, Funny

    I mean, look how quick we got to 16M comments. 4.1 Gigacomments will come in hardly any time at all. I predict we'll be doing all this again in merely a few weeks!

    --
    SIGSEGV caught, terminating

    wait... not that kind of sig.
    1. Re:Better make it longer by alx5000 · · Score: 1

      In my humble opinion, 640K should be enough for anyone...

      --
      My 0.02 cents
  16. So who's the killer? by Rob+T+Firefly · · Score: 5, Insightful

    I wonder who posted comment #16777216. That person should win some sort of "I borked Slashdot!" award.

  17. seems strange by jihadi_schwartz · · Score: 5, Funny

    ...why wasn't this problem discovered on the dev system in advance?

    1. Re:seems strange by [Lizard] · · Score: 1

      Uhm, what dev system?

  18. Dupe! by Anonymous Coward · · Score: 0, Insightful

    Given the amount of duplicate articles, why not just let it overflow and we can roll the same stories around again. Saves all the hassle of making submissions.

    GSM phones to monitor traffic problems, anyone ?

  19. It's true that... by 0racle · · Score: 5, Funny
    Anyone could have made the mistake
    But it's so much funnier when that anyone is not you.
    --
    "I use a Mac because I'm just better than you are."
  20. Point 2.4 of Resign Patterns: Detonator by Smoking · · Score: 2, Informative

    Taken from http://franksworld.com/blog/archive/2005/01/04/600 .aspx

    Chapter 2: Destructional Patterns

    2.4 Detonator

    The Detonator is extremely common, but often undetected. A common
    example is the calculations based on a 2 digit year field. This bomb
    is out there, and waiting to explode!

  21. Check out... by BJH · · Score: 3, Interesting

    ...comment 16777215.
    Mmmm... CT, are you sure the parent index was your only problem?

  22. 2^24 by Anonymous Coward · · Score: 5, Funny

    "2^24 comments ought to be enough for anyone" -- CmdrTaco

    1. Re:2^24 by twotommylong · · Score: 1

      Slashdot.
      No threading. Less comments than Usenet. Lame

  23. Comment 16,777,216 does not exist by jamie · · Score: 5, Informative

    Some of you are asking which comment it was that got the cid 16,777,216. The answer is that none did. For redundancy, Slashdot is now running multiple-master replication which skips values for auto-increment. Our db-1 assigns odd-numbered primary key IDs, and db-2 assigns even-numbered. Right now writes are going to db-1 so newly created rows will have only odd IDs.

    The comment that got 2**24-1 was this one, if anyone cares :)

    Sorry about the inconvenience, everyone.

    1. Re:Comment 16,777,216 does not exist by Anonymous Coward · · Score: 0

      Well there's *another* thing Bush and Rumsfeld have managed to screw up!!! :-)

    2. Re:Comment 16,777,216 does not exist by Gr8Apes · · Score: 1

      I still think /. ought to give them a 1 year subscription (or even lifetime subscription) bonus. After all, how often do you get to break /. merely with a post?

      --
      The cesspool just got a check and balance.
    3. Re:Comment 16,777,216 does not exist by Megane · · Score: 1

      Our db-1 assigns odd-numbered primary key IDs, and db-2 assigns even-numbered.

      I also recall that when Slashdot switched over to the current database, they arbitrarily started the new message IDs at one million, to leave room for pulling the archived topics back in. Still, that means at least 8 million comments in the four or so years (I don't remember exactly how long) since then.

      --
      #naabhaprzrag, #sverubfr-000, #agi-fcbafberq, negvpyr[pynff*=' negvpyr-ary-'] { qvfcynl: abar !vzcbegnag; }
    4. Re:Comment 16,777,216 does not exist by duguk · · Score: 1

      2**24+1 was this one, if you're interested.

  24. Digg? by Afrosheen · · Score: 5, Funny

    That's cool, I'll just pretend I'm on Digg, with its 1981 Commodore 64 BBS-style threading.

      Wait..sorry Commodore fans. I know it had better threading than Digg.

  25. OMG!!!! by toonworld · · Score: 1

    Posting comments is my entire life!! What will I do?? :-(

    --
    It's not the destination that matters, but rather the journey.
  26. Haggard? by Anonymous Coward · · Score: 5, Funny

    Haggard admins? Does this mean that the Admins will go buy some meth and get a massage?

  27. My Reply to the Funny Comment Above This by eldavojohn · · Score: 4, Insightful

    Uh, this is a reply to the 8th post down from the top (remember to use this like an array and zero reference). Yes, I'm talking to you, admdrew.

    You claim that the 16,777,216th comment would have broke it but I contest that actually the 16,777,217th comment poster would be the culprit. Since it should be able to handle that many comments if it is zero referenced, and it would actually be the one after that one that would break it. You laugh but these kinds of problems plague a lot of coders?

    If you don't agree with me, please respond below and reference my comment ID.

    --
    My work here is dung.
    1. Re:My Reply to the Funny Comment Above This by up2ng · · Score: 1

      test

      --
      Success is not the result of spontaneous combustion, you must set yourself on fire.
  28. What will i do?? by Anonymous Coward · · Score: 0

    If I can't post comments??

  29. 16 million posts ... by DrJimbo · · Score: 5, Funny

    ... should have been enough for anyone.

    --
    We don't see the world as it is, we see it as we are.
    -- Anais Nin
  30. Holy Chit! by RedCard · · Score: 5, Funny

    No threading? Welcome to Farkdot.

  31. Old discussions by DeadCatX2 · · Score: 1

    So let me guess...the parent index has been lost forever?

    Hopefully it just rolled over, and you can add 2^24 to every value to get the parent links back.

    Though I somehow doubt that will work.

    --
    :(){ :|:& };:
    1. Re:Old discussions by Control+Group · · Score: 1

      So let me guess...the parent index has been lost forever?

      Hopefully it just rolled over, and you can add 2^24 to every value to get the parent links back.

      Though I somehow doubt that will work.


      Or they could just use a DB backup. Does MySQL support point-in-time recovery?

      Parent

      --

      Reality has a conservative bias: it conserves mass, energy, momentum...
    2. Re: Old discussions by Control+Group · · Score: 1

      So let me guess...the parent index has been lost forever?

      Hopefully it just rolled over, and you can add 2^24 to every value to get the parent links back.

      Though I somehow doubt that will work.


      Or they could just use a DB backup. Does MySQL support point-in-time recovery?

      Parent

      --

      Reality has a conservative bias: it conserves mass, energy, momentum...
    3. Re:Old discussions by 42forty-two42 · · Score: 1

      The indices don't actually store the 'real' copy of the data - that's in the table. The index is just a fast lookup method. Rebuilding the index from the original data in the table is, of course, simple (an ALTER TABLE statement as the story says) but it takes quite a while as it requires a sort of the entire table.

    4. Re:Old discussions by DeadCatX2 · · Score: 2, Informative

      Sorry, I think index was a bad choice of words.

      Whenever a post is made and it has a parent cid, that number must be stored in the table.

      If MySQL saturates instead of rolling over (see this comment), then all replies after comment 16,777,215 will have the wrong parent cid, and I don't think there's any way to fix it.

      --
      :(){ :|:& };:
  32. Feature missing in MySql by cucucu · · Score: 1

    to filter out comments by mod

  33. Re:OMG by jZnat · · Score: 2, Funny
    Posting comments is my entire life!! What will I do?? :-(
    I know how you feel; reading them is my life, too.
    --
    'Yes, firefox is indeed greater than women. Can women block pops up for you? No. Can Firefox show you naked women? Yes.'
  34. we've come a long way since VAXclusters... by Anonymous Coward · · Score: 1, Funny

    ...and the philosophy of zero downtime.

    Oh wait, we haven't.

    But at least we can use processors several orders of magnitude faster to produce sufficient eye candy to catch what little attention span is left in today's users.

    1. Re:we've come a long way since VAXclusters... by WilliamSChips · · Score: 1

      You can take your bullshit "zero downtime" and stuff it up your ass. Oh wait, they're still trying to implement zero downtime on that without making everything corrupted.

      --
      Please, for the good of Humanity, vote Obama.
  35. And? by Lars+T. · · Score: 5, Funny
    Sorry for the inconvenience. We shall flog ourselves appropriately.
    And post the YouTube link?
    --

    Lars T.

    To the guy who modded me down from perfect to terrible Karma - Apple haters still suck

  36. Disclosure by diersing · · Score: 0

    Its a conspiracy, the truth is Natalie Portman poured hot grits on the beowulf /. cluster. In Soviet Russia, all your threads belong to our table altering overlords.

  37. Ok.. by Awod · · Score: 1

    I admit it, it was me.. all your slashdot are belong to me.

  38. It's Like Digg without the nesting. Where's the by Anonymous Coward · · Score: 0

    thumb?

    We just have to use the @dimwit syntax.

  39. It's a joke, kids by Temuar+Skylari · · Score: 5, Funny

    Dupe! I TOTALLY posted this story like, last WEEK man! (I laugh, but I betcha someone might post this in seriousness)

    --
    USE colorful confetti ON heavily-armed clown
  40. Arbitrary Limits by RAMMS+EIN · · Score: 0

    And this is why you should not have arbitrary limits in your programs, ladies and gentlemen. Not even limits on the values your numbers can represent - unless you have _proven_ that no values outside the representable range will ever occur.

    --
    Please correct me if I got my facts wrong.
    1. Re: Arbitrary limits by LunaticTippy · · Score: 1
      And this is why you should not have arbitrary limits in your programs, ladies and gentlemen. Not even limits on the values your numbers can represent - unless you have _proven_ that no values outside the representable range will ever occur.
      If you don't have limits, performance suffers. I suppose you could have keys be arbitrary-length with some databases, but it is a huge performance hit.
      --
      Man, you really need that seminar!
  41. Did somebody say... by camusflage · · Score: 4, Funny

    Flogging and Haggard in the same sentence? If we can get "crystal meth" in, we'll hit the trifecta!

    --
    The truth about Scientology, Xenu, and you: Operation Clambake
  42. Sounds Familiar by old_skul · · Score: 5, Informative

    I used to work at Comair. Remember, that airline that stranded about 10,000 people in the airport a couple of Christmases ago? Same deal. Program was capable of handling only a certain number of changes. Hopefully your president won't have to resign.

  43. Gay meth orgies by pHatidic · · Score: 1

    Did anyone else read the headline and think that's what it was about?

  44. So was it fixed in Slash? by tlhIngan · · Score: 4, Interesting

    So is the bug still in the CVS revision of Slash, or was it fixed 5 years ago and Slashdot never applied the patch?

  45. Re: Can't count by LiquidCoooled · · Score: 1

    Its not a problem with counting, its the fact he used the lower case c for comments.

    16777216 comments = 16 million rows.
    16777216 Comments = nearly 17million rows.

    Also, he could have used mibicomments to get the proper units and would have totally avoided this confusion.

    --
    liqbase :: faster than paper
  46. Give Slashdot Subscriptions to the borkers by davidwr · · Score: 5, Interesting

    Give a 2^0-year Slashdot subscription to the guy who hit the limit and one to the the first non-administrator guy who successfully posted after the fix.

    If you can find the first guy who COULDN'T reply due to the limit, give him one too. He deserves something for his trouble.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  47. EldavoJohn cid=16786251 reply by DeadCatX2 · · Score: 4, Informative

    Actually, comment 16,777,217 couldn't break it, because that comment's parent cid could have only been 16,777,215. Up until then, there wouldn't have been an overflow value put into the db.

    There's no telling which comment it is, because (16,777,217 + 2n) might not have been a reply, meaning it would come up correctly.

    --
    :(){ :|:& };:
  48. Fark? by Anonymous Coward · · Score: 0

    Suddenly Slashdot seems more like Fark.com.

  49. Dorks. by morgan_greywolf · · Score: 3, Funny

    Does this mean that Slashdot is going to denegrate into Digg now?

  50. Thanks by arun_s · · Score: 1

    I'd like to extend a big thanks for letting us know, and also for explaining how the problem arose in the first place.
    (I'm not smart enough to jump into slashcode and feel at home there, so its pretty interesting to see the kinda stuff you people have to face every now and then)

    --
    I can explain it for you, but I can't understand it for you.
  51. Reply to 16786251 by RAMMS+EIN · · Score: 4, Informative

    Reply to comment number 16786251:

    ``You claim that the 16,777,216th comment would have broke it but I contest that actually the 16,777,217th comment poster would be the culprit. Since it should be able to handle that many comments if it is zero referenced'' ...but it's probably not zero-referenced. Typically, ids in SQL start at 1.

    --
    Please correct me if I got my facts wrong.
  52. Re: Can't count. by brunascle · · Score: 1
    comment id 16786329:
    > Last night we crossed over 16,777,216 comments [snip] > .. but on a table that is 16 million rows long

    That's nearer 17 million YTC
    i'd be willing to bet it's much below 16 million actual comments, since the first few were probably tests, and then deleted. he means the comment with a primary key of 16777216; that doesnt necessarily mean there are that many comments in the table.
  53. 16777217 GET by Anonymous Coward · · Score: 0
    1. RE: 16777217 GET by Stalyn · · Score: 5, Funny

      mod parent up

      --
      The best education consists in immunizing people against systematic attempts at education. - Paul Feyerabend
    2. RE: 16777217 GET by 8ball629 · · Score: 1
      congrats you broke slashdot

      http://hardware.slashdot.org/comments.pl?sid=20559 5&cid=16777217
      Mod parent up and mod cid #16777217 flamebait!
  54. Today is the first day I've had to type subjects. by admdrew · · Score: 3, Interesting
    @eldavojohn, #16786251 (god, this feels like digg now)
    Uh, this is a reply to the 8th post down from the top (remember to use this like an array and zero reference). Yes, I'm talking to you, admdrew.

    You claim that the 16,777,216th comment would have broke it but I contest that actually the 16,777,217th comment poster would be the culprit. Since it should be able to handle that many comments if it is zero referenced, and it would actually be the one after that one that would break it. You laugh but these kinds of problems plague a lot of coders?

    If you don't agree with me, please respond below and reference my comment ID.

    I certainly admit I wasn't thinking 0-based when I wrote that. The question is, though, should we blame the person who wrote the last valid comment (therefore ruining the fun for the rest of us), or whoever wrote the first broken comment?

    Also, is everyone going to add the obligatory 'parent' link on their posts today?


    [ Parent ] - [ Reply to this ]
  55. Like, Dude! by Anonymous Coward · · Score: 0
    Unfortunately, like 5 years ago we changed our primary keys..
    Who knew that CmdrTaco was 12 years old?
  56. Access to the Database? by Shadow+Wrought · · Score: 5, Interesting

    Any thoughts on making the DB publicly accessable other than through teh Dot? Not sure what I'd do with all that data, but I'm sure these's a grad student somewhere who'd love the opportunity...

    --
    If brevity is the soul of wit, then how does one explain Twitter?
  57. When I Saw "Haggard" In The Title... by Anonymous Coward · · Score: 0

    I thought some Slashdot bug had taken down an evangelical website or something.....duh.

  58. Only on slashdot... by beavt8r · · Score: 1

    would a story like this actually be posted. And with such hilarity. But really, it seems many times we computer people give us more room for future expansions and inevitably end up hitting it (y2k 'bug', this, 128K should be enough for everybody, that kinda thing). Yes i know, we hit limits eventually. But, you would think that we'd prepare better for this and increase beforehand. (the admins did as mentioned, just missed the other part) Or are we lazy? Or all have A.D.D.? Perhaps we just do this "OOhh...a new piece of hardware/software/whatever. Um....yeah, we can wait to raise that limit."

  59. 16777216 by Little+Brother · · Score: 1
    eldavojohn (898314)

    (http://slashdot.org/~eldavojohn/journal/ | Last Journal: Tuesday April 04, @01:06PM) Uh, this is a reply to the 8th post down from the top (remember to use this like an array and zero reference). Yes, I'm talking to you, admdrew. You claim that the 16,777,216th comment would have broke it but I contest that actually the 16,777,217th comment poster would be the culprit. Since it should be able to handle that many comments if it is zero referenced, and it would actually be the one after that one that would break it. You laugh but these kinds of problems plague a lot of coders? If you don't agree with me, please respond below and reference my comment ID.

    Yes, but you forgot to start counting with 0

    /Hey, this whole no threading thing reminds me of something.
    //Obscure?

    --

    Little Brother, watching the watchers

  60. reply to comment 16786251 by lazarusdishwasher · · Score: 1

    You seem to be thinking like I was when I first read about this problem. but I think I have a better way of addressing who we are replying to http://slashdot.org/comments.pl?sid=205731&cid=167 86251 hyperlinks are easier to follow than trying to count as the number of comments rise.

    1. Re:reply to comment 16786251 by Thansal · · Score: 1

      > #16786493

      Exactly, just link to their comment, and if you want you can even follow the standard "Re:" format if you want :D

      --
      Do Or Do Not, There Is No Spoon, There Is Only Zuul. Everything in the above post is probably opinion.
  61. May i be the first to say... by zepo1a · · Score: 5, Funny

    Brillant!

    I always wondered where Paula Bean ended up...

  62. So what if you delete a few? by Alaria+Phrozen · · Score: 1

    Why not delete all the posts that have the words: insensitive clod, I for one welcome our [a-z]+ overlords, Soviet Russia, Libraries of Congress, ...profit!, frist psot, why is this on slashdot, dupe, or have any mention of porn.

    You'll free up 2^24 - 2^15 of the comment IDs at least...

  63. Re: Slashdot Posting Bug Infuriates Haggard Admin by JymmyZ · · Score: 1

    Mod parent down, funny my ass. It's obviously flamebait

    --
    The unexamined life is not worth living
  64. Mod parent up by foniksonik · · Score: 4, Funny

    Uhhhh who's your daddy?

    --
    A fool throws a stone into a well and a thousand sages can not remove it.
  65. Old articles? by TheThiefMaster · · Score: 1

    Does this mean that all replies to comments after the 2^24-1th one were attached to much much older comments instead? Can anyone find one and see?

    Perhaps some sql command that adds 2^24 to a comment's parent entry if the comment's own id is >2^24 and it's parent is less than 10,000?

  66. Why are all 16 million+ comments in a single table by poot_rootbeer · · Score: 4, Interesting

    Slashdot being a news (for nerds) site, I would expect that the usage patterns are such that a huge majority of the content accessed by users is very recent -- say, perhaps, 90% of the database hits are for stories and comments that were posted in the last week.

    So why, pray, is this usage pattern not accounted for in the database design?

  67. MOD parent up! by bazorg · · Score: 4, Funny

    Mod parent ... wait..

  68. I think you mean... by rjstegbauer · · Score: 2, Funny

    LOST Post!

  69. How is this possible? by Stonent1 · · Score: 1

    I thought you guys were like Gods or something. Maybe I should start praying to someone else instead now?

  70. This was fortold a few months ago... by Anonymous Coward · · Score: 4, Informative
    1. Re:This was fortold a few months ago... by zonker · · Score: 0

      duuuuuude. yer freakin' me out man. shit's like he told the future or something. woooooah. like fuckin' magic crystals n' shit.

  71. Should have used PostgreSQL instead.. by eamacnaghten · · Score: 2, Insightful
    Would not have happened if Slashdot used PostgreSQL.

    Let the flamewars begin...

    --

    Web Sig: Eddy Currents

    1. Re:Should have used PostgreSQL instead.. by WilliamSChips · · Score: 1

      PostgreSQL didn't even exist when Slashdot was invented. And I don't think Rob Malda is the Doctor.

      --
      Please, for the good of Humanity, vote Obama.
  72. No post but mod!! by Anonymous Coward · · Score: 0

    So I got mod points instead of being able to post....

  73. Digg by franksands · · Score: 0, Offtopic

    I'm sorry to inform you, but Digg has nested posting for a while now.

  74. Take all the time you need by deaton · · Score: 5, Funny

    Take all the time you need, I'm more than willing to refrain from posting durin.... Oh shit!

  75. Trolls by Jaseoldboss · · Score: 2, Funny

    At least nobody can feed the trolls now!

  76. Slashed Eyeballs by Doc+Ruby · · Score: 3, Insightful

    If Slashdot released the Slashcode more frequently, with more/better comments/docs, and encouraged some of the many of us who complain about bugs/features to help the project, then it's more likely that someone would have debugged this bug earlier.

    Open source - it's not just a buzzword, it's a way of life.

    --

    --
    make install -not war

    1. Re:Slashed Eyeballs by tf23 · · Score: 1

      While I agree with you on the lack-of-a-full-release, the doc's are _not_ that bad. Infact, if you compare them to many other open source systems (for the point of this post we'll call Slashcode a CMS) they docs are pretty good. Example: How many of them give pointers to using CPAN? And if you follow the INSTALL instructions, exactly, you have a working slash installation. That seems simple enough to me.

      encouraged some of the many of us who complain about bugs/features to help the project

      Clap clap clap. There ya go, your encouragement. Now quit your whining and actually _do_ something positive to help the project.

      more likely that someone would have debugged this bug earlier

      I do not agree with you here. How many websites would have that many comments posted? The only way you are going to find this problem is a) if you're going over the schema with a fine-tooth-code (and c'mon, very, very few people are going to put the energy into this) or b) your data you are migrating to Slashcode has that many comments. No one's going have createTestComments generate that many. That's just not something anyone would normally do.

    2. Re:Slashed Eyeballs by Doc+Ruby · · Score: 1

      "Not as bad as no docs at all", the typical state of other OSS projects, isn't good enough. And the "lack of a full releass" kills the entire point of Slashdot users working on the Slashcode - it's a different app. CPAN pointers are great - and probably the product of a single enthusiast's single night up. Saying that following the INSTALL exactly produces a working install is kinda weak praise. That's the best you can say?

      Slashdot's complaining programmer user community is a huge pool. If the Slashdot org encouraged us with better docs, not just silence or the arch, obnoxious attitude you just displayed, more of use would join the team to produce a better Slashcode. More would use it. Sixteen million user-produced items isn't so much. And if you think that none of the many programmer users would have noticed the index datatype change in one scope but not the necessary one in another, you don't even understand Slashdot.

      In fact, you've just shown you don't understand how OSS projects work, though you apparently understand how the OSS code works in this one. Exactly my point. No wonder the Slashcode project is so unpopular, and therefore irrelevant. Which you seem more than happy about - defensive of, even. Congratulations.

      --

      --
      make install -not war

    3. Re:Slashed Eyeballs by tf23 · · Score: 1

      I'm not saying that I don't agree the docs could be better. But that's nothing new for 99% of all projects, especially opensource, imho. Some of what's in /docs is seemingly ~4 years old. As far as slashcode goes, there've been many people who've complained the docs aren't great.

      However, that you _can_ follow the INSTALL instructions and have a working slashcode system, you can't knock that. I guess when you ask "that's the best you can say?" I don't see anything wrong with that.

      "lack of a full releass" kills the entire point of Slashdot users working on the Slashcode

      Yes, it surely does. And the upgrade process from 2.2.6 to current is well, abysmal. It's do able with some effort (following the documentation), more so obviously if you don't know the project well. The lack of a "slashupgrade.pl" that site admins can run is a turnoff for many people still running 2.2.6. The lack of a current release just plain puts people off from even attempting to run the latest. And even if you are the running the latest, or somewhat the latest, you have to apply updates - by hand. There's no stock-included upgrade tool to go from T_2_5_0_128 to T_2_5_0_133.

      Slashdot's complaining programmer user community is a huge pool.

      Slashdot's surely is huge. Slashcode's, I don't agree with you there. Just look at the activity (or lackthereof) on the listserves. Slashdot and Slashcode are two different things. Which is kind of sad, because you'd think with the pool of talent Slashdot itself attracts there'd be many more people trying to help with Slashcode.

      If the Slashdot org encouraged us with better docs, not just silence or the arch, obnoxious attitude you just displayed, more of use would join the team to produce a better Slashcode.

      Obnoxious? ha.

      The 'silence' is what's frustrating for me. Not knowing where the code is heading is aggravating at times.

      And if you think that none of the many programmer users would have noticed the index datatype change in one scope but not the necessary one in another, you don't even understand Slashdot.

      Well, no one noticed there could be a problem with that index in the stock code, obviously. The schema for comments wasn't changed for how long? The code's out there, been out in the open source land for years now. There's nothing stopping anyone from grabbing it an analyzing it. I still doubt that any "normal traffic" site would have noticed this limitation. Should someone have caught it? Sure. But most sites don't have the traffic slashdot has, so about the only site that'd ever run into this limitation with the slashcode code is Slashdot itself.

      In fact, you've just shown you don't understand how OSS projects work

      Oh? Please explain.

      though you apparently understand how the OSS code works in this one

      I think so, yes, at times, anyway.

      Exactly my point. No wonder the Slashcode project is so unpopular, and therefore irrelevant. Which you seem more than happy about - defensive of, even. Congratulations.

      Defensive? No. If my comment came off that way, that wasn't my reply's intent.

      However, frustrated, yes. Frustrated that people pop into a project, claim "this sucks" but don't give any concrete examples where it sucks. Or, better yet, how about some constructive criticism and pointed suggestions such that if someone were to spend their own time helping trying to help with what's pointed out, the project *could be improved*.

  77. What's impressive by FirmWarez · · Score: 0, Troll

    Is how quick you figured out what the problem was. If this were some huge corporate entity, the PHBs would still be running around trying to set up meetings upon meetings...I think the answer to all technical problems is smart people with little to no be bureaucracy.

  78. Reply to 2569161991 by Anonymous Coward · · Score: 0

    You creep up to the window and, in the soft, muted lights, you see a tall woman with long, blond hair. She sits before a mirror and brushes her hair, then stands and walks over to the sunken tub off to her left. She kneels and her blue, silken robe drops to the floor. She turns the water on and steam slowly fills the air.
    You watch in fascination as she reaches down into the tub, whirls, and points an Uzi in your direction. "Stop reading paragraphs you're not supposed to read, creeps." She sighs deeply. "Next time I'm going to demand they put me in a Bard's Tale game, this Wasteland duty is dangerous."

  79. A real Slashdotter! by QuickFox · · Score: 4, Funny

    And this is why you should not have arbitrary limits in your programs, ladies and gentlemen. Not even limits on the values your numbers can represent

    Now this is a real Slashdotter! This guy knows how to build an infinite computer!

    --
    Terrorists can't threaten a country's freedom and democracy. Only lawmakers and voters can do that.
  80. Let teh flogging commence... by Anonymous Coward · · Score: 0

    ... and by the way, you SUCK.

    LMAO, my vword: "cheeks"

  81. We're awesome! by Anonymous Coward · · Score: 0

    We're awesome!

    No, "Taco", you're just stupid. But we already knew that.

  82. Misleading Title! by bshroyer · · Score: 1

    I had a hard time imagining how the admins of Ted Haggard's site could be miffed at Slashdot.

    I also didn't recollect Slashdot discussing our favorite non-homosexual, non-meth-using ex-pastor recently...

    --
    The cure for cancer is coming: Reovirus
  83. 24 bit? by voidptr · · Score: 4, Insightful

    Why on earth does MySQL have a 24 bit integer datatype? On what platform does it even remotely make sense to use that in the first place? It's going to get cast to 32 bits for any arithmetic operations anyway, and on most platforms today alignment requirements are going to pad the extra byte in memory and disk, so you're not even saving any space. Why even give someone the option over choosing between 16 bit and 32 bit integers?

    --
    This .sig for unofficial government use only. Official use subject to $500 fine.
    1. Re:24 bit? by dkf · · Score: 1
      Why on earth does MySQL have a 24 bit integer datatype?
      Probably because the other 8 bits are used to indicate that it is a 24-bit integer, so that the whole thing (type and value) fits into a 32-bit word. Another possibility is that it allows for packing a table a bit tighter at the expense of slowing access a bit, a trade-off that wins by allowing you to hold more of the database tables in the OS's buffer cache. Databases do horrible things like these.
      --
      "Little does he know, but there is no 'I' in 'Idiot'!"
    2. Re:24 bit? by nconway · · Score: 1
      most platforms today alignment requirements are going to pad the extra byte in memory and disk


      MySQL uses a different representation for in-memory and on-disk data, so it's not too difficult to avoid the padding byte in the on-disk representation.
    3. Re:24 bit? by BRSloth · · Score: 1

      I don't think this is valid for disk storage. All bytes are stored one after another, without the need of any padding. You probably are thinking about sectors and inodes, but they would be filled up before jumping to the next one. So, it is a matter of disk usage.

      But you're right on the memory usage.

  84. Re: Why are all 16 million+ comments in a single t by jamie · · Score: 5, Informative

    poot_rootbeer asks why all the comments are in one table, when the data access pattern is such that 90% of our hits are on only the most recent entries in that table.

    The answer is that we used to do it this way but it's a huge pain. In 2000 we converted from having two tables for 'stories', recent and archived, and merged them together. The performance hit was not big, and it made the code so much simpler it was a no-brainer.

    It's the database's job to cache properly whether we split the table or not, and the database does that just fine. The only performance problem could be when there is a rush of inserts, or updates to the same sets of rows, spanning both newer and older portions of the table, and that just doesn't happen.

    If we did want to do this we wouldn't split the tables manually; the code complexity is too high a price to pay. In MySQL 5.0 we would use a MERGE engine, which has issues of its own but would involve smaller changes to our code. That's still not worth it for us. What we're probably going to do is wait for MySQL 5.1 to get out of beta and then do some performance testing on tables partitioned by date and see if that gains us anything. For example, a SELECT on our comments table could be limited with a WHERE clause to only retrieve rows with a date >= the discussion object's date, which for 90% of our queries MySQL 5.1 could optimize to only look at the most recent partition. If the gains turn out to be significant, then since partitioning involves very limited code changes, we'll probably do that. Generally speaking, though, database performance is not a problem for us. So far our main bottlenecks have been CPU and RAM on the webheads. As long as we don't do anything stupid our database performance has been fine, though, as today proves, we are quite capable of being stupid.

    [ Parent ]

  85. The wize by Psychotic_Wrath · · Score: 0

    16,777,216 comments in the database. The wise amongst you might note that this number is 2^24 Only would a slashdotter look at that number and think OH thats 2^24 :D

    --

    Doctors do Massage in Longview WA now, who knew?
    1. Re:The wize by starglider29a · · Score: 1

      Actually, anyone who has ever dealt with color on a computer will recognize that as the "16 Million colors" number, with 8-bits per Red, Green & Blue. Though, I didn't see "2^24", I saw #FFFFFF. CdrTaco prolly saw F#@^!

      The point about "arbitrary limitations", and WTF there are 24-bit integers are all well taken. Perhaps that's why they call it "Google". Maybe they have indices in the 2^A5570AD range in case they ever want to catalog every atom in the universe.

      -- "Software with limitations is of no value"

  86. Here's... by BJH · · Score: 2

    ....yet another non-existent comment numbered 16777215. And another one. And another one.
    Normally, accessing a non-existent comment gets you either the "nothing to see here" message or the "can't find that comment in this discussion" message. Where are the ghost comments coming from?

  87. Re: Access to the database by Control+Group · · Score: 2, Insightful

    Any thoughts on making the DB publicly accessable other than through teh Dot? Not sure what I'd do with all that data, but I'm sure these's a grad student somewhere who'd love the opportunity...

    Not just grad students; as a DBA by profession, I'd love a crack at the DB. If nothing else, it would give me a great place to play around with MySQL. Not to mention the ability to maybe extract some interesting user-level statistics.

    Of course, the odds of this happening are pretty damn low - there'd have to be an awful lot of work and review done to scrub the DB of information that is entrusted to /. that people didn't plan on having released to the internet at large. Passwords, for example (even if they're stored only as hashes, getting the whole DB would make it feasible to crack them); real email addresses, real names...I assume that the subscription process doesn't involve actually storing credit card information in the DB (I don't know; I've only used PayPal), but that might be another concern.

    Just the email addresses would be a huge deal - can you imagine the market value of such a targeted list of addresses?

    In short, it would be fantastically cool for them to release the DB, but it would be a lot of work on their part for no particular return. Not to mention that if they released it once, they'd no doubt be pestered to keep releasing periodic updates...then there's the bandwidth issues...and, even, the potential copyright issues (/. doesn't own the copyright on posted comments, the poster does)...then the copyright issues for stuff they do own; releasing the DB would make it trivial for a bad actor to post a mirrored slash. A little bit of domain typosquatting and some ad deals, and you could be talking about real money.

    If I were them, there's no way in hell I'd even think about doing it.

    But it would be cool.

    Parent

    --

    Reality has a conservative bias: it conserves mass, energy, momentum...
  88. Re: First time I had to ... something like that by Qzukk · · Score: 1

    >>16786443
    The question is, though, should we blame the person who wrote the last valid comment (therefore ruining the fun for the rest of us), or whoever wrote the first broken comment?

    The issue is that comments after 2^24 can't be replied to since their ID won't fit into the "parent" field. So the real culprit is the guy who wrote the first post that nobody could reply to.

    --
    If I have been able to see further than others, it is because I bought a pair of binoculars.
  89. I disagree with your post by Anonymous Coward · · Score: 1, Funny

    I disagree with your post and I think you are a jackass.
    It is up to the various parents to determine which comment I am replying too.

  90. trolltalk by Anonymous Coward · · Score: 0

    this is what you get for letting the trolltalk crapflooder run free

    1. re: trolltalk by Anonymous Coward · · Score: 0

      damn right

  91. Let the flamewars begin... by bigpat · · Score: 5, Funny

    Would not have happened if Slashdot used PostgreSQL.

    Let the flamewars begin...


    Unthreaded flame wars are much less enjoyable.

  92. That Explains It by fdiskne1 · · Score: 1

    I thought something with the Slashdot web code didn't agree with some part of my newly installed Firefox 2.0. I was looking at a comment and wanted to see the parent. When I clicked it, I got a blank comment. Now I see this story and that explains it.

    Comment #16,777,216 should definitely get a free "Last Post" t-shirt courtesy of Slashdot and Comment #16,777,217 should definitely get a free "I /.ed /." t-shirt courtesy of Slashdot. Or would that be 16,777,215 and 16,777,216? Whichever. Do it!

    --
    But why is the rum gone?
  93. I personally... by Billosaur · · Score: 1

    ...am aiming for post # 33554432 (2^25)

    --
    GetOuttaMySpace - The Anti-Social Network
  94. graphic artists by Speare · · Score: 5, Funny

    The number 2^24 is of interest to digital computer artists, as that is the number of unique colors combined in the commonly implemented "True Color" RGB8 space. That color space is looking pretty limiting in some respects, but that is truly a lot of unique colors when you think about it. A 16 megapixel image does not need to repeat any color used.

    If all slashdot posts from the history of Slashdot were sorted into color bins,
    • every post including the -2 trolls would get their own unique color,
    • all the colors which are predominantly blue would be claimed as "first posts,"
    • all the colors which are predominantly green would be unfunny memes like "hot grits,"
    • all the colors which are predominantly red would be complaints about editing or journalism,
    • the pure cyan, magenta, yellow shades are moderated as insightful or interesting,
    • the 256 posts corresponding to completely neutral gray shades are actually insightful or interesting

    Once that were done, people could simply post their replies as a reference to existing posts. "Hey, #938D3A to you, buddy!" "Know what I think of that? #F2C2A9!"

    --
    [ .sig file not found ]
    1. Re: graphic artists by quokkapox · · Score: 2, Funny

      If all slashdot posts from the history of Slashdot were sorted into color bins, ...

      So, from a distance the site would blur into an ugly pastiche resembling lime green?

      --
      it's a blue bright blue Saturday hey hey
    2. Re:graphic artists by chrysrobyn · · Score: 1
      If all slashdot posts from the history of Slashdot were sorted into color bins,
      * every post including the -2 trolls would get their own unique color,
      * all the colors which are predominantly blue would be claimed as "first posts,"
      * all the colors which are predominantly green would be unfunny memes like "hot grits,"
      * all the colors which are predominantly red would be complaints about editing or journalism,
      * the pure cyan, magenta, yellow shades are moderated as insightful or interesting,
      * the 256 posts corresponding to completely neutral gray shades are actually insightful or interesting

      Can I mod you as a pale reddish cyan? Do users' names end up getting averaged their mod points? Can teenagers make a strategy game of making posts to align with their favorite vanity color? Or is that a "Color Whore", leading /. to change the entire system to a series of 5 colors?

  95. Who needs data integrity? by _xeno_ · · Score: 2, Informative

    Ah, MySQL. Where trying to insert a row with a column value larger than the column can actually store results in MySQL clipping it to the max value.

    mysql> create table test (field mediumint unsigned);
    Query OK, 0 rows affected (0.05 sec)

    mysql> insert into test values (20000000000);
    Query OK, 1 row affected, 1 warning (0.02 sec)

    mysql> select * from test;
    +----------+
    | field |
    +----------+
    | 16777215 |
    +----------+
    1 row in set (0.00 sec)

    Fortunately, as of MySQL 5, you can fix this problem.

    mysql> set session sql_mode='TRADITIONAL';
    Query OK, 0 rows affected (0.00 sec)

    mysql> insert into test values (20000000000);
    ERROR 1264 (22003): Out of range value adjusted for column 'field' at row 1

    So, yes, early versions of MySQL had a brain-dead default SQL mode that simply "corrected" invalid column values, but MySQL 5 fixes this.

    Now if only they would add column constraints...

    --
    You are in a maze of twisty little relative jumps, all alike.
  96. This, my friends, is called... by sheepoo · · Score: 1

    oversight!

  97. OMG, Even Better Than Ponies! by vain+gloria · · Score: 1

    The lengths that Slashdot goes to to keep us entertained are much appreciated!

  98. reply to 16786487 by sam31415 · · Score: 1
    Little Brother (122447) wrote in #1678647:

    /Hey, this whole no threading thing reminds me of something.
    //Obscure?

    Nothing is obscure on SlashFark.
    /Even if we wish it were

  99. to the person who asked why it uses a 24 bit integ by happytechie · · Score: 1

    probably to reduce the size of the index, if 2^24 index values is deemed to be enough then why make those index pages any bigger than they need to be, the shorter the indexed value then the more indexes you pull back with a single IO operation and the faster you can search the index I believe.

    --
    --
  100. Finally, a tale for my grandkids in the new era by voidptr · · Score: 5, Funny

    One day, Cmdr Taco is designing his database, and he sits down at a table with three integers on it. First, he tries the baby bear's integer, but exclaims "2 meager bytes is way too small for my appetite."

    Next, he tries Papa bear's integer, but proclaims "4 bytes is way too big for my little site, I'd just end up wasting so much."

    Finally, he tries Mama bear's integer, and extols "3 bytes is just right," not noticing it was really the same as Papa Bear's bowl in disquise.

    --
    This .sig for unofficial government use only. Official use subject to $500 fine.
  101. Moo by Chacham · · Score: 1

    Now had they just used a real database, this wouldn't be an issue.

    MySQL for them, three hours for us.

    Hmm... one thing though, this flat mode reminds me of the good old days. :)

  102. Comments? by erroneous · · Score: 1

    Population approximately 16,777,216 comments ... all Borg.

    --
    erroneous: look me up in a dictionary
  103. /. copyright question by Control+Group · · Score: 5, Interesting

    Get your mod points ready, this is off topic, but considering the current state of discussion anyway, I don't feel so bad about it.

    Regardless, while writing this post regarding why the /. admins won't (and shouldn't) consider releasing a copy of the /. DB to the public, something occurred to me.

    Comments on /. are owned by the poster, according to that one line that shows up on all the comment pages (specifically, "The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.") At the same time, though, /. doesn't provide a method for having comments you've made removed from the DB.

    If I own the copyright on the comments I've made, shouldn't I be able to rescind publication rights on them, and prevent /. from displaying them in future? Or is there some kind of implicit license in posting on /.? Did I clicksign an agreement covering this when I joined (this was getting on towards a decade ago, so I really don't remember the joining process at all)?

    Or are publication rights, once granted, irrevocable?

    Of course, I suppose asking questions when there's no way for people to hit reply is a specific form of vague insanity...still, I'm curious.

    --

    Reality has a conservative bias: it conserves mass, energy, momentum...
    1. Re: /. copyright question by Sloppy · · Score: 2, Interesting
      In reply to this:
      Or are publication rights, once granted, irrevocable?

      IMHO, probably. When you published a comment, there was no mechanism available to you, for removing comments, or even the slightest hint that one might appear in the future. You knew what you were getting into, so it could be argued that you accepted what happened.

      In a more general sense, it is well-known that sending a packet to the 'Net is like opening a bottle and letting a genie out. Once you do it, it's out, and if you ever manage to shove it back inside, it'll be more a matter of luck, rather than something possible because of policy.

      --
      As copyright owner of this comment, I authorize everyone to defeat any technological measure which limits access to it.
    2. Re: /. copyright question by Anonymous Coward · · Score: 0

      Regarding "Control Group's" point about not having any way to rescind publication rights (i.e. delete stuff you've already posted), let me be the first to say when this gets implemented, I wish to be the first to remove everything I've ever posted here.

      Sincerely,
      Anonymous Coward

  104. All that mumbo-jumbo in the article... by Anonymous Coward · · Score: 0

    and you STILL cannot stop the trolltalk crapflood...

    LOAL!

  105. So how do I get to post #1? by filesiteguy · · Score: 3, Informative

    I'd really like to see it. I bet it goes something like, "what's this stupid web thingy anyway? I bet it'll never make it to version 2.0..."

    1. Re: So how do I get to post #1? by Control+Group · · Score: 1

      I'd really like to see it. I bet it goes something like, "what's this stupid web thingy anyway? I bet it'll never make it to version 2.0..."

      Well, here's the oldest story I could find: posted 12/31/1997, ignoring all the stories listed as posted on 12/31/1969. But there are no comments attached, so that doesn't really help.

      This is the oldest comment on the oldest story I could find that had comments, posted on 1/1/1999.

      Unfortunately, it's not even close to comment #1...but it's the best I could arrange. ;)

      Parent

      --

      Reality has a conservative bias: it conserves mass, energy, momentum...
  106. hey by ripcrd · · Score: 1

    You can flog the dolphin while you are waiting on the reindexing. So get yer hands back to the keyboard til that job is running.

    Carry on.

    --
    --Somewhere there is a village missing an idiot.
  107. Hit counter by crunch_ca · · Score: 1

    On a side note, I noticed the /. hit counter (in the stats) recently rolled over 2^32 hits with no problem (i.e. more than 4294967296).

  108. It's just like Digg by hansonc · · Score: 0, Redundant

    Look Mom Slashdot's comments system sucks just like Digg's :-)

  109. Bad Developers! by DaveV1.0 · · Score: 1

    No Ramen and no Jolt!

    --
    There is no "-1 offended" or "-1 you don't agree with me" mod options for a reason.
  110. oh, now I understand by neuro_guy · · Score: 1

    ...why all my witty and charming replies got eaten and never showed up in public. Man, each of those might have been glorious "+5, godlike" slashdot, you destroyed my life!

  111. MOD PARENT UP by Rich0 · · Score: 0, Redundant

    Er...nevermind...

  112. Woo, we have more data than Slashdot :) by oldosadmin · · Score: 1

    Hey, at least I get to claim now that we have more data than slashdot! Woo! Nothing like large, delicious MySQL databases. Mmm, Mmm good.

    --
    Jay | http://oldos.org
  113. Is threading retro-active? by Equis · · Score: 1

    A quick look at older articles shows that they're still threaded. Will this story be threaded again once threading is enabled or is it doomed to be flat forever?

    /me is not a programmer of any sort

    1. re: Is threading retro-active? by Kelson · · Score: 1

      Replying to comment #16787077 by Equis:

      A quick look at older articles shows that they're still threaded. Will this story be threaded again once threading is enabled or is it doomed to be flat forever?

      If I understand the situation correctly, each comment has a field that identifies the parent comment. That field is the one that broke and is being fixed today. What Slashdot is doing during the update is just disabling the ability to post replies to comments.

      All the older comments have threading information on them, so they can be displayed properly threaded. But if you look at an article from yesterday, you'll see the "Reply to this comment" links are missing. Everything being posted today, however, is being posted as if it were the start of a new thread.

      When Slashdot turns threading back on, new comments to this article will probably be threaded... but the first few hundred posts will stay flat unless someone with access feels like manually tracking down parent comments and updating the DB themselves.

  114. ... that number looks familiar ... by ninjagin · · Score: 1

    Some time back, our ClearCase record database hit the exact same limit of 2^24. Set us up for a schema 54 upgrade. It was very challenging. I feel your pain, CmdrTaco.

    --
    .. pa-ra-bo-la, pa-ra-bo-la, 2 pi R, 2 pi R, where's your latus rectum, where's your latus rectum, 2 pi R
  115. No threading? by ellem · · Score: 1

    My eyebrows are going to be bushy!

    --
    This .sig is fake but accurate.
  116. 4,100,000,001st Post! by bareman · · Score: 1

    I've never been quick enough to get a 1st Post. ;-)

  117. +10 by BandwidthHog · · Score: 4, Insightful

    Ten points for honesty!

    At least they didn’t try to make bullshit excuses. I respect them for being up front about the real nature of the issue.

    --

    Quantum materiae materietur marmota monax si marmota monax materiam possit materiari?
  118. TDWTF Import Service / Opera by schnipschnap · · Score: 1
    Brillant!

    And as you can't reply, I'll do it for you: "Soon to be closed down by Sony"

    On a related note, (which I haven't tested yet,) could it be that old versions of Opera with the 15-16 hole will be able to render Discussion2 again? (Opera 9.02 handles it already, BTW.)

  119. Non-standard data types by leandrod · · Score: 1

    You need a Data Administrator, who would have told you not to use unsigned because it is non-standard -- and to use PostgreSQL because it has DOMAINs.

    --
    Leandro Guimarães Faria Corcete DUTRA
    DA, DBA, SysAdmin, Data Modeller
    GNU Project, Debian GNU/Lin
  120. Oh by Movi · · Score: 1

    Welcome to the world of tommorow!

  121. In reply to an earlier thread by antifoidulus · · Score: 1

    As if a thousand geeks all made the same damn "last post!" joke at once. . . . . .

    I would suggest we make a thread for just such jokes but....

  122. Mysql long running alter command by Anonymous Coward · · Score: 1, Insightful

    I recently ran into this problem with Mysql 5.0.x -- I had to alter a few columns to increase a char(2) to char(20) on a table with 10+ M records.

    I too run multi-master replication -- but only one server is primary at any one point in time.

    To get around this problem, I made the change on one of the standby servers, failed over the web application to that server and then implemented the change on the previously live server.

  123. weee by FuturePastNow · · Score: 1

    Little Brother: /Hey, this whole no threading thing reminds me of something.

    //Obscure?


    I don't see anyone else using the FARK posting format, so, apparently yes.

    /slashie

    --
    Give a man fire, and you warm him for the night. Set a man on fire, and you warm him for the rest of his life.
  124. Obligatory... by wahman143 · · Score: 1

    All Your Posts Are Belong To Us

  125. "flogging definition" by UnanimousCoward · · Score: 4, Interesting

    As your punishment, you should write some kind of data-mining algorithm that starts from the point you disabled threading and try to construct intelligent threads based on the subject and the body of comments...

    --
    Twelve-and-three-quarter inches. Unyielding. This wand belonged to Bellatrix Lestrange.
    1. Re: "flogging definition" by drew · · Score: 1
      As your punishment, you should write some kind of data-mining algorithm that starts from the point you disabled threading and try to construct intelligent threads based on the subject and the body of comments...


      That's a pretty tall order, considering most of the time we can't even do that when threading is enabled. Reminds me of a quote I saw once:

      That job is like trying to make a cow out of 800 pounds of hamburger meat and white glue.
      --
      If I don't put anything here, will anyone recognize me anymore?
  126. Slashdot admins and politicians by HikingStick · · Score: 1

    Now if we could only get politicians to be this forthright and transparent!

    Anonymous Coward for president!

    --
    I use irony whenever I can, but my shirts are still wrinkled...
  127. Use MySQL and eventually it'll bite your arse by LizardKing · · Score: 3, Informative

    I guess this is another thing to add to the MySQL gotchas page. Of course, in a decent database engine, like PostgreSQL, if you alter a column data type then the indexes are updated to reflect this.

    1. re: Use MySQL and eventually it'll bite your arse by kpharmer · · Score: 1

      LizardKing wrote:

      > I guess this is another thing to add to the MySQL gotchas page [sql-info.de]. Of course, in a decent database engine,
      > like PostgreSQL, if you alter a column data type then the indexes are updated to reflect this.

      Nah, this is a feature - each storage engine for mysql can do it differently. Sometimes they might behave like any other database, at other times you might have extra steps. And you can even get this benefit within a single database across multiple tables.

      FYI, regarding partitioning as a design consideration:

      - Yes, it is well-worth looking at, but note that partitioning isn't as fast as btree indexes for retrieval - *if* you were only planning to grab a few rows. It's more of a reporting thing that helps save you from table scans when you need to grab thousands of rows.

      - Also, I wouldn't necessarily trust the merge table or partitioning features out of mysql until others have worked out the kinks first: there's a lot of potential complexity there with how indexes work (global or local), how the optimizer works, etc.

      - And you probably will have sql changes and maybe column changes - in order to incorporate something like a story-id, thread-id or time-id to partition upon and to use as a query predicate.

      Regarding your product selection - if you're going to look at changes for partitioning anyway:

      - it wouldn't hurt looking at a database with fewer sharp edges to injure yourself on either. I mean, really - you've got degraded functionality right now because of design defects in the tool

      - which allowed the error to occur and take so long to reindex and process defects in that your process doesn't require the additional testing that is essential when using dangerous tools like mysql.

      - side note: if you were using a database engine capable of reindexing quickly in parallel you would have had that index built in probably a fraction of the time. Sometimes it's worth spending a few dollars to get infrastructure that you can really depend on. Doesn't have to be much cash, I think the free version of db2 (limited to 2 cpus & 4 gbytes of memory) would probably be a substantial improvement.

    2. Re:Use MySQL and eventually it'll bite your arse by ajs · · Score: 1
      I'm duplicating this post from an unthreaded comment that I made earlier on this same article, now that threading is back on:

      Some folks have been criticizing MySQL here, saying that it's MySQL's fault. I think this is a result of mis-reading the story. The "parent index" is not an SQL "index", but a column that acts as a self-referential key. Ala:
      create table a (
        xxx mediumint unsigned primary key,
        yyy mediumint unsigned null references a.xxx );
      alter table a modify column xxx bigint unsigned;
      A database like Oracle, and perhaps even PostgreSQL or later versions of MySQL, might have choked on a foreign key constraint if the column types differed, but I'm not aware of any magic that would automatically extend an ALTER TABLE to alter all foreign key columns' types also, self-referential or not. Am I incorrect? Is this a magical feature in some/all databases?

      Suffice to say, however, that this is a clear case of the database doing exactly what you asked for, and Slashdot has paid the price for asking for something nonsensical (hey, we've all done something similar).

      PS: Note that the ALTER TABLE docs on the PostgreSQL site do seem to imply that something as extensive as the type of a foreign key column would not be updated, only indexes and "simple table constraints involving the column."

      PPS: Tried this in MySQL 5.0, and it does not complain about the alter table creating a mismatched foreign key type, which is either a bug or a problematic feature that should probably be addressed if it hasn't already in 5.1.

      PPPS: Of course, no one will ever see this comment, given the lack of threading ;-)

      PPPPS: Ok, now they might ;-)
  128. auto... by Anonymous Coward · · Score: 0

    ...LART

  129. Daily quote problem by l0b0 · · Score: 1
    Function reject.

    Who said that? RMS? Linus? Data? HAL?

  130. Work around by DrYak · · Score: 1

    There's a work around to the flat structure :

    1. Select the post you want to reply to.
    2. Click on it's CID (on the right side of the post header. Don't confuse it with the UID).
    3. The post appears alone on it's own webpage.
    4. Click on the reply button.
    5. Now you're replying again in a tree-like fashon.
    6. ???
    7. Profit ! (Or infuriate the administrator who actually had a good reason to temporary force a flat style),

    And here's a link on my opinion about flat-structured forum !

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
    1. Re:Work around by cuantar · · Score: 1

      Hmm, like this? ;)

      --
      Legalize it.
  131. Prepare to be FLOGged... by avronius · · Score: 1

    I have a Flog file here that I would be happy to send to you. However, due to regulations, etc. that abound with regards to the material tghat can be transmitted via the internet, I'll have to use an antiquated modem transmission.

    Let me know when you are ready, then I'll Kermit the Flog.

    [insert groan here]

  132. Awww by Anonymous Coward · · Score: 0

    Don't worry about it, CT. We'll forgive you this time. *hugs*

  133. Archiving by smallguy78 · · Score: 1

    Why isn't the table archived?

    --
    Nothing costs nothing
  134. NO NO NO by Anonymous Coward · · Score: 0

    Little Brother: /Hey, this whole no threading thing reminds me of something.

    //Obscure?

    I don't see anyone else using the FARK posting format, so, apparently yes.

    /slashie

    STOP THAT FARK SHIT RIGHT NOW. That's the gayest thing EVER. Fark is a cesspool of computer-illiterate userbase of fat goths, fat sports fans, and fat suburbanite soccer moms (and other types of fat Americans) who think "omg lolololol Drew drinks beer lolololol your dog wants steak lol no cure for cancer hur hur hur hur hur" is funny or witty. "Oh ha ha we namedrop Wil Wheaton and Christopher Walken because it's ironic, just like the bumper-sticker slogan on my Hot Topic t-shirt." I swear to god and don't get me started on their mediocre photoshop contests. No, no your non-photoshop doesn't make it funny just because you put the word "subtle?" below it, gtfo faggots. Fark SUCKS.

  135. another pro postgresql post by larry+bagina · · Score: 1
    Obviously, when slashdot was started (97/98 or so) postgresql wasn't as widely known as mysql, and slashdot has a lot of mysql-isms (both in slashcode and that they're using a custom version of mysql).

    --
    Do you even lift?

    These aren't the 'roids you're looking for.

  136. So why was this 24-bit to begin with? by Iron+Condor · · Score: 3, Insightful

    With all teh funnae posts about it, let me be the first one to ask: why were you using 3-byte integers to begin with? Why would anybody anywhere ever use these for any reason at all? What advantage to these have? Why was this table laid out like this? This doesn't make sense to me at all. Were you really imagining that shaving a byte off each post was going to save you DB space? I can't quite believe that. But than what exactly would be the motivation for using such an odd integer size?

    --
    We're all born with nothing.
    If you die in debt, you're ahead.
  137. Haha by thejrwr · · Score: 1

    I know how you feel slashdot, why in the hell does mysql do that, why catn it use 32bit numbers.........

  138. I blame commenter #1... by codemoose · · Score: 1

    ...he started it.

  139. Slashdot just got /.'ed by KJSwartz · · Score: 1

    (since /. had to go offline for THREE HOURS)

    To paraphrase a scene from Disney's Hercules:

    "'Hey Cowboy Neal, nice job on those tables. Ya missed a spot'"

  140. What Happen ? by iceborer · · Score: 1

    Somebody set up Slashdot the 16,777,216th comment.

  141. No one has quoted ObviousGuy yet? by RPI+Geek · · Score: 1

    I don't get it.

    --

    - "Nobody came out that night, not one was ever seen. But Old Man Stauf is waiting there, crazy sick and mean!"
  142. mediuminty reFreshness by digitaldc · · Score: 1

    2^24, or in MySQLese an unsigned mediumint

    After that final Taco, you really do need a bigmint.

    --
    He who knows best knows how little he knows. - Thomas Jefferson
  143. MOD PARENT UP!! by bugnuts · · Score: 1

    Oh wait, there ARE no parents.

  144. MOD TROLL DOWN! by Mozzie · · Score: 1

    MOD TROLL DOWN!

    Oh, wait...nevermind.

  145. System by certel · · Score: 1

    Way to go! This will put the system to the test!

  146. Hexplanations by tehshen · · Score: 1

    I'm not sure if anyone will see my poor little comment stranded at the bottom of this well of posts, but I have nothing else to do so I'll post it anyway.

    It's nice to see a site posting reasons for breakages from time to time. I'm sick of seeing errors like "Database error, sorry for the inconvenience". Database error? Should I try again? Should I try again later? How long will it take to fix? Did someone screw up somewhere, or did some of your hardware explode?

    Here, we get "Heh, we forgot to twiddle with the database a while ago. Silly us. It should take a few hours to fix, so come back here then ok?". Very refreshing, or something like that.

    --
    Guy asked me for a quarter for a cup of coffee. So I bit him.
  147. so... by Anonymous Coward · · Score: 0

    in a way, jamie, it's rumsfeld's fault?

  148. Time for the AOL reply... by Cervantes · · Score: 1

    Me too!

    --
    If I knew the wedgies I gave you back in 6th grade would have resulted in this . . . I might have taken a moments pause.
  149. Comment #1 by in2mind · · Score: 1

    Does comment #1 exist? /. seems to have had a different URL pattern then..(Date/Time!!)
    The farthest I could get to was,
    http://slashdot.org/article.pl?sid=98/01/08/113300

    1. Re: Comment #1 by Control+Group · · Score: 1

      Does comment #1 exist? /. seems to have had a different URL pattern then..(Date/Time!!)
      The farthest I could get to was,
      http://slashdot.org/article.pl?sid=98/01/08/113300 [slashdot.org]


      See my comment on this elsewhere in this thread. The first story I can get to is from '97, the first story with comments is from '99.

      Both were reached by starting from "older stuff," then twiddling the "start" parameter in the URL. Using a sort of ham-fisted binary search, I narrowed "start" parameters that /. thought were valid into the 70000+ range (I didn't write down exactly where I found the start). The first post that has comments discernibly attached lay somewhere between starts of 66829 and 66893 (once I was down to 32 numbers between test parameters, it was easier to hit "next 30" than to go back to the URL).

      Parent

      --

      Reality has a conservative bias: it conserves mass, energy, momentum...
  150. Hey, wait a minute... by Cervantes · · Score: 1

    The post that broke it is on our good friend Rumsfeld. About 1/2 way into things, in fact. Did Slashdot die because of more poor Rumsfeld planning, failing to plan for the entire thread, but only the first few years^H^H^H posts?
    Does this mean we can now have a threadless jihad? Who's going to be the first to IED Taco?

    --
    If I knew the wedgies I gave you back in 6th grade would have resulted in this . . . I might have taken a moments pause.
  151. I think... by Anonymous Coward · · Score: 0

    you stink.

    What have you got to say about that?? ...yeah that's what I thought.

  152. Amazing. by kbox · · Score: 1

    So the cops knew that internal affairs were setting them up?
    So many comments modded as funny in a post that makes absolutely no fucking sense to me what so ever

  153. Never enough Taco to go around... by Alpha232 · · Score: 1

    Welcome to the /. karma-fest!
    Whether it's Pity or Witty, there is only ModUp from here!

  154. Weird, /. actually renders better by Anonymous Coward · · Score: 0

    Did a test with the new format of no replys and what do you know the pages actually render more consistantly (based on format and speed) in more browsers now.

    God I love being QA tester.

  155. MySQL sucks by Cthefuture · · Score: 1

    Man I hate that stupid database. A couple of hours just to change a 16 million item table. Pffft, what a bunch of crap. 16 million rows is nothing in database terms.

    I hate that MythTV uses it, the damn thing chugs along grinding away with only a couple thousand rows. It makes MythTV suck because the performance is so crappy when you have only a couple hundred programs recorded.

    --
    The ratio of people to cake is too big
  156. We shall flog ourselves appropriately. by on9star · · Score: 1

    Quote - "We shall flog ourselves appropriately." Could you please film this? I'd like to see that :P

    --
    Who let the job's out?
  157. There are TWO posts #'ed 16,777,215 by TubeSteak · · Score: 0

    http://slashdot.org/comments.pl?sid=205549&cid=167 77215
    http://yro.slashdot.org/comments.pl?sid=205709&cid =16777215

    Both are modded up +4 Interesting, but the second link goes to a blank post...

    --
    [Fuck Beta]
    o0t!
  158. Bug? Nah, it's a feature by Rixel · · Score: 1

    Anti-Dupe System.

    --
    Never play chicken with a passive aggressive.
  159. Let's find the next limit by ticklemeozmo · · Score: 1

    Quick everybody! Let's find the next limit! (Do your part to help debug ;))

    --
    When modding "Informative", please make sure it both has a source and IS actually informative.
  160. Oops? by kinglink · · Score: 1

    At least this isn't a mission critical system or anything otherwise there will be talks of how stupid slash dot is to hire the lowest bidder.

    At least it's proof that not everyone is perfect. Except George Lucas, even though he made Howard the duck... or maybe no one is perfect.

  161. zerg by Lord+Omlette · · Score: 1

    I slept through this, so I don't know: Did they post amusing music to celebrate their downtime?

    --
    [o]_O
  162. Re: Can't count. by monkeydo · · Score: 1
    In reply to http://slashdot.org/comments.pl?sid=205731&cid=167 86435
    comment id 16786329: > Last night we crossed over 16,777,216 comments [snip] > .. but on a table that is 16 million rows long

    That's nearer 17 million YTC
    > Last night we crossed over 16,777,216 comments [snip] > .. but on a table that is 16 million rows long

    That's nearer 17 million YTC
    i'd be willing to bet it's much below 16 million actual comments, since the first few were probably tests, and then deleted. he means the comment with a primary key of 16777216; that doesnt necessarily mean there are that many comments in the table.

    Since only the odd numbers are used to table is really closer to 8 million lines long.
    --
    Si vis pacem, para bellum
    The only thing more annoying than a Libertarian is an (un|mis)informed Libertarian
  163. What is SID? by KlomDark · · Score: 1

    I thought it was Story ID, but Story ID #1 is from 06-25-01.

    http://slashdot.org/comments.pl?sid=1

    Parent

  164. Index vs. index and MySQL flamage by ajs · · Score: 1
    Some folks have been criticizing MySQL here, saying that it's MySQL's fault. I think this is a result of mis-reading the story. The "parent index" is not an SQL "index", but a column that acts as a self-referential key. Ala:
    create table a (
      xxx mediumint unsigned primary key,
      yyy mediumint unsigned null references a.xxx );
    alter table a modify column xxx bigint unsigned;
    A database like Oracle, and perhaps even PostgreSQL or later versions of MySQL, might have choked on a foreign key constraint if the column types differed, but I'm not aware of any magic that would automatically extend an ALTER TABLE to alter all foreign key columns' types also, self-referential or not. Am I incorrect? Is this a magical feature in some/all databases?

    Suffice to say, however, that this is a clear case of the database doing exactly what you asked for, and Slashdot has paid the price for asking for something nonsensical (hey, we've all done something similar).

    PS: Note that the ALTER TABLE docs on the PostgreSQL site do seem to imply that something as extensive as the type of a foreign key column would not be updated, only indexes and "simple table constraints involving the column."

    PPS: Tried this in MySQL 5.0, and it does not complain about the alter table creating a mismatched foreign key type, which is either a bug or a problematic feature that should probably be addressed if it hasn't already in 5.1.

    PPPS: Of course, no one will ever see this comment, given the lack of threading ;-)
  165. Daily WTF by Helmholtz · · Score: 1

    Coming to a www.dailywtf.com near you *grin*

    --
    RFC2119
  166. Pshaw by Matey-O · · Score: 1
    The comment that got 2**24-1 was this one [slashdot.org], if anyone cares :)
    Is THAT what you've gotta do to get a +5 insightful around here?
    --
    "Draco dormiens nunquam titillandus."
  167. 3+ hours? by XO · · Score: 1

    3 hours to change a table with 16 million rows? Hmm.

    I think my 486 could handle that in that time frame. If not, I'm positive my K6-2/450 could.

    --
    "Champagne for my real friends - and real pain for my sham friends!" http://ericblade.postalboard.com/
  168. WTF! by FungosBauux · · Score: 0

    Ok. First WHO IS THE DAMN MORON THAT USES mediumint as Identity!?

    Wtf! One good thing is aways in all your tables aways having id as int/bigint !

    What the loser tried doing with mediumid? save hd space?! fuck

    Ok. Ok. I got too ungry.

  169. I thought it was just me. by Ant+P. · · Score: 1

    I was messing with my comment settings and came back to see it all messed up. Being too lazy to change it back I left it for a few hours, then I saw someone in an article complaining that the threading was broken.

    First reaction: "Oh shiiii..."

  170. At last... by Anonymous Coward · · Score: 0

    Slashdot is getting slashdotted!

  171. Oh god by I+Like+Pudding · · Score: 1

    Wow, looks like a phpBB in here. Does that mean I have to post even more retardedly than normal?

  172. Oh my god! by The+One+and+Only · · Score: 1

    We slashdotted Slashdot!

    --
    In Repressive Burma, it's not just your connection that dies. slashdot.org/comments.pl?sid=314547&cid=20819199
  173. database record by Anonymous Coward · · Score: 0

    This is an entry in a database, located somewhere under a white house.

  174. Here's an Idea by schestowitz · · Score: 1

    Disable comment altogether, start duping 24/7, and never get flamed for it. :-) :-) Thanks for the honesty. Tagged appropriately, I see...

    --
    My Linux - (L)ove (I)s (N)ever (U)tterly eXPensive
  175. What I find most interesting by lskovlund · · Score: 1

    I may be behind the curve here, but I find it interesting that Slashdot even has a no-threading mode... or was this a quick hack job?

  176. Wrong strategy? by Qbertino · · Score: 1

    Wouldn't this have been the better way:
    1) Inmediate hack-patch at runtime: Add column or extra 1:1 table, whichevers faster,
    2) add super-quick hack that adds a new index beyond 2^24. (some /. Perl crack probably can do this in 5 minutes)
    3) Add third column, migrate/merge/rebuild new index at runtime
    4) Switch to new index
    5) remove old code and columns 1&2 after correct functionality is confirmed

    Most People probably wouldn't even have noticed. ... Then again, if someone didn't do his homework and slashcode is a messy hack, this could be troublesome.

    --
    We suffer more in our imagination than in reality. - Seneca
  177. Where's the lotion? by TranscendentalAnarch · · Score: 1
    We shall flog ourselves appropriately.
    Please record this and put the video on youtube.
  178. Liar Liar by Anonymous Coward · · Score: 0

    It was ME!

  179. ATTN:kpharmer ID #16789193 by LiquidCoooled · · Score: 1

    Agreed on the points for the reindexing, but the database has been created to specification.
    As they said, its an oversight after converting years ago.

    A few years ago I had to do a similar fix on the behemoth I inherited which used 16 bit index keys.

    I personally think mysql handles slash really nicely and coupled with the open source foundations it stands on allows a lot more people to get systems up and running, moving to a proprietary database (even a free one) would exclude a lot of people from running their own site with slashcode.

    Maybe there are enough database developers out there today who have been effected by this who could step up to the plate and fix mysql itself so it does have the required features. There are certainly enough geeks in here.

    [ Parent ]

    --
    liqbase :: faster than paper
    1. re: ATTN:kpharmer ID #16789193 by kpharmer · · Score: 0

      LiquidCooled wrote:
      > I personally think mysql handles slash really nicely and coupled with the open source foundations it stands on allows
      > a lot more people to get systems up and running, moving to a proprietary database (even a free one) would exclude a lot of
      > people from running their own site with slashcode.

      Yep - open source products are definitely more agile than closed source - especially if you have to work through a horrible centralized procurement process like I have to. However, I wouldn't assume that mysql helps slashdot out today. Aside from today's snafu:
          - why has the addition of new functionality taken so long?
          - why is it so painful to see all threads by subject over the last x days, filtering by y?
          - why can't we easily see better metrics on threads?
          - why can't we easily see better metrics on posters?
          - etc
      Well, one reason is that the database would have to return aggregate results for many queries - and mysql is a bad match for mild analytical queries - in which you need to scan 10k rows and return fifty.

      So yeah, mysql was about the best option five years ago, but has had commercial options almost as inexpensive for the past two years and open source options with better data quality and just as good performance for the past three years or so.

      > Maybe there are enough database developers out there today who have been effected by this who could step up to the plate
      > and fix mysql itself so it does have the required features. There are certainly enough geeks in here.

      Well, mysql has been getting much better over the years: just a few years ago:
          - it had no transactions (and their vps said this was a good thing)
          - no views
          - no triggers
          - no stored procedures
          - no subselects
          - a trivial optimizer (5-way joins were almost unrunnable)
          - silent errors on data truncations (truncates numbers)
          - silent errors on data types (allows feb 58th, 2004)
          - silent errors on transaction-safe storage creation
      it's far better today, but still has inexcusable problems - in which a simple column addition requires an entire table to be rebuilt, adding an index to a 16m row table takes 3+ hours (!?), you can turn on error reporting for type failures, etc - but any client can override the server setting, etc.

      So, they've come a long way, but are still only halfway there. The question for developers that want to jump in and help fix things - is where is their time better spent? Helping a for-profit company fix its product, or just using a completely unencumbered and free product like postgresql in which these kind of errors have never existed.

  180. No downtime by QuickFox · · Score: 1

    Several people have made comments about posting being disabled for a while, clearly based on this statement in CmdrTaco's writeup: ... our system will take 3+ hours to do it, during which time there can be no posting.

    But posting was never disabled! Only replying was disabled. (And still remains disabled, 7+ hours later.) Thus he shouldn't be flogged for downtime!

    Let's try to be fair here. Stay your whips. Calm your tempers. Take a deep breath. Gather some strength.

    And now flog him for disinformation instead!

    --
    Terrorists can't threaten a country's freedom and democracy. Only lawmakers and voters can do that.
  181. Other historic posts by SamSim · · Score: 1

    At bewildering times like this I, personally, reflect back to comment #10,000,000.

    (And the rest)

  182. Re: by DesireCampbell · · Score: 1

    Mod parent up!

    --
    Whoo, signature!
    DesireCampbell.com
  183. C'mon Taco by bernywork · · Score: 1

    Turn on threaded replies and take a bow!

    --
    Curiosity was framed; ignorance killed the cat. -- Author unknown
  184. Well, since there is no threading... by JourneyExpertApe · · Score: 1

    I'd like to reply to that guy who said that thing about welcoming the Overloads and Soviet Russia and all that. I think that comment was spot on. Spot on. If anyone agrees with me, please... start a new thread.

    --
    If you can read this sig, you're too close.
  185. OMGOMGOMGOMG by Ticklemonster · · Score: 1

    OMG, it's the dreaded Y2K*8388.608 bug!

    --
    Karma: Bad is the liberal way of saying this guy won't drink the kool aid here on slash dot. I wear my Karma with pride
  186. If you had used Postgresql by tacocat · · Score: 1

    you would be home by now...

  187. O I C by cmacb · · Score: 1

    Oh, I see, we can still post just no convoluted threads that degenerate into personal attacks.

    Hey! Why don't you leave it broken and call it a feature!

  188. I call for a THREAD PARTY!!! by Anonymous Coward · · Score: 0

    Once Slashdot threading is fixed, we need to celebrate somehow.

    So, on the first story posted after 16:00 GMT tomorrow, we should establish the longest comment thread in Slashdot history!

    This will show our great appreciation for all that the Slashdot crew has done for us. (Or for the more trollish among you who have an unreasonable grudge against the editors, you may consider it an attempt to test the limits of Slashcode.)

  189. Re: 10+ by Dean+Hougen · · Score: 1
    Ten points for honesty!

    At least they didn't try to make bullshit excuses. I respect them for being up front about the real nature of the issue.


    What makes you think they were being honest?

    "Something is zorked up with the database!"

    "What seems to be the problem?"

    "How the fsck should I know? But we've got to post something so they won't know we're clueless."

    "Okay, but what?"

    "Some posters are guessing we ran out of indexes at message 10^24. We can claim we used 24 bit indexes."

    "24 bit indexes, that's the dumbest thing I've heard all day."

    "Fine you come up with a better excuse."

    "Okay, just post it and get back to figuring out what really went wrong."

    Honesty is indistinguishable from a believable lie.

    Dean

    Parent
  190. So... by Aramgutang · · Score: 1

    Are we to understand that Slashdot has been Slashdotted?

  191. Alas, poor Slashdot! by SirBruce · · Score: 1

    Alas, poor Slashdot!

    I knew it, CmdrTaco. A website of infinite jest, of most excellent facny. It hath borne my posts on its page a thousand times. And now, how abhorred in my imagination it is!

    Bruce

    1. Re:Alas, poor Slashdot! by wllf · · Score: 1

      First parent?

  192. Feels nice... by l0cust · · Score: 1

    Slashdot broken: feels like the times when a thunderstorm used to hit my home and everything will stop working(including all electrical appliances). Then everyone will drop whatever they were doing, light a fire in the covered verandah and sit around it sipping tea/coffee and swapping stories !

    Damn I miss those days now :)

    --
    Politicians and Pedophiles: Two groups of exploitive bastards who are most dangerous when they're thinking of children.
  193. Does a reply to a last post... by LordEd · · Score: 1

    become a first post?

  194. 16,777,216 comments ought to be enough by Baikala · · Score: 1

    I've being looking for a new signature for months. Thanks a lot!

    --
    16,777,216 comments ought to be enough for any forum!
  195. Re:Today is the first day I've had to type subject by Trumpet+of+Doom · · Score: 1

    Clearly not. Look right below this thread.

  196. Damm, I'm impressed. by anubi · · Score: 1
    Yes, you had a bug.

    You knew what it was damned near immediately.

    And fixed 16 million comments - in 3 hours?

    This just goes to show you the power of knowing what you are doing.

    Stuff like this impresses the hell out of me.

    --
    "Prove all things; hold fast that which is good." [KJV: I Thessalonians 5:21]

  197. Re:Would PostgreSQL be faster? by larry+bagina · · Score: 1

    Yes it would.

    --
    Do you even lift?

    These aren't the 'roids you're looking for.