Slashdot Mirror


Twitter Leads Social Networks In Downtime

illectro writes "A study on site availability by monitoring service Pingdom shows that in 2008 Twitter greeted users with the 'Fail Whale' for more than 84 hours, almost twice as much as any other site. At the other end of the scale imeem and Xanga managed less than 4 hours of downtime for 99.95% uptime. Myspace, Facebook and Classmates.com were the only other sites studied which managed to stay up more than 99.9% of the time."

40 of 175 comments (clear)

  1. 84 hours???? by sunking2 · · Score: 4, Insightful

    And yet it had 0% impact on my life. So who really cares.

    1. Re:84 hours???? by maxume · · Score: 2, Funny

      I tweet each plop.

      --
      Nerd rage is the funniest rage.
  2. 84 hours?!?! by RoFLKOPTr · · Score: 5, Interesting

    I find it kind of strange that a site as incredibly simple as Twitter had so much downtime. Granted, they probably don't have the multiple dedicated redundant datacenters to their name like MySpace and Facebook do... but still, they're only serving little tidbits of text.

    1. Re:84 hours?!?! by The+End+Of+Days · · Score: 2, Insightful

      Awww, the poor little rails fan is gonna get violent on the internet. Good way to make a point, hotshot.

    2. Re:84 hours?!?! by SatanicPuppy · · Score: 3, Insightful

      Oh BS. A huge volume of extremely easy data. No images, no War & Peace length text posts. Just a lot of short, sweet, and simple text.

      I want you to say with a straight face that it's really just the amazing volume of data that separates a highly reliable and available site like Facebook from a constantly failing jumped up IRC client like Twitter.

      Twitter is a dog. And because it's written in Rails, it's a special needs dog that has to go to the vet a lot.

      --
      ad logicam Claiming a proposition is false because it was presented as the conclusion of a fallacious argument.
    3. Re:84 hours?!?! by CMonk · · Score: 2, Insightful

      What does rails have to do with building in an unscalable way? You could say the same but sub in php, c, java, perl, .net, etc. As I understand it most of their problems stem from them thinking a SQL database would make a good message bus.

    4. Re:84 hours?!?! by metalhed77 · · Score: 2

      Your ad nauseum argument says nothing, but since some moronic people with mod points are out there I may as well respond.

      You haven't said anything specific about rails. There's tons of successful rails deployments out there, just because twitter's engineers suck at what they do doesn't mean the tech they use is bad. Tell me WHY does rails suck? What part of it is causing all these problems?

      Also, Twitter isn't just rails, from all accounts the problems they have are from other parts of their stack. Again, not the tech used there, but their inability to deploy and set it up properly.

      Also, If you've ever read about the architecture of Facebook you'd realize it's an extremely complex application. It's not just a simple LAMP stack, there's all kinds of caching and queing, with large hadoop clusters etc. Facebook is a HARD PROBLEM with a complicated solution. Luckily for facebook, they engineered it correctly. Those same tools if used improperly would not work.

      Furthermore, your assertion that the data is easy is wrong. EVERYTHING IS EASY FOR SMALL N. The problem isn't the content, it's the quantity of messages. You may as well have said a man who eats 1000000000 jelly beans did something far easier than a man who ate a large burrito.

      In short, don't hate the tool, hate the guy who's not using it right. Also, if you're going to critique something, be knowledgable and specific about it, don't just say X sucks because it sucks. Your ad nauseum argument says nothing.

      --
      Photos.
    5. Re:84 hours?!?! by metalhed77 · · Score: 2, Insightful

      Well you misunderstand scalability. Scalable DOES mean you can just throw more hardware at something, as you said. But you omit the part the scalability has limits. There's always a bottleneck, so no app is infinitely scalable. You take your best guess at what its intended audience will be and you proceed form there.

      You can say my app's been designed so that it will scale when n is between 1 and 100,000 for instance. Or that it'll scale between 1 and 100,000,000,000,000. But the app you design for the later will be very different internally and take a lot more time to design. Most apps start out working only for small n because most apps will never get to big n or if they do, they do so gradually and give developers time to deal with it. Twitter was cursed by its own success, they didn't know it'd be as popular as it turned out.

      Let's look at some specific technical details.

      For most sites a single master DB server with slaves for reads is fine. Most apps out there don't need multi-master capabilities and thus implementing that would be a waste of time. In fact, most web apps you see out there are designed to run on a single DB server for reads and writes.

      When Twitter started that's what they had and it worked. Then twitter got unexpectedly popular, and at that point in time Rails did not support multiple DB connections per instance, so sharding wasn't really possible. Days after they announced this problem it was fixed so it's no longer an issue.

      We could speculate on problems they've had since then, but that would just be speculation. They've said repeatedly however that their stack's scalability issues have been in the non-rails parts (like the DB). Since they're the only ones who actually know what's going on, I'm inclined to believe them.

      Let's look at some other social app failures,

      An example would be myspace, which had horrible problems scaling, even though that was written in PHP which you consider to be super scalable. Or we could look at friendster, which was written in enterprisey java, which also had huge scaling problems. It's not the tool, it's how you use it.

      Additionally, when you scale real world systems you just may find out the bottlenecks aren't where you thought they'd be during the design and testing. Runaway successes like twitter are vulnerable to this fact.

      If you want to fault the Twitter engineers you really can only fault them for bad judgement in estimating the size of their user base. I don't think you know what Rails actually is. It's just helpers for YOUR code. Ultimately, a rails site is mostly your code, and your architecture.

      --
      Photos.
  3. Re:They are cut off by ProfMobius · · Score: 4, Funny

    Go outside, take a sunbath, twitter your friend about it... err, ha, well...

    --
    EULA : By reading the above message, you agree that I now own your soul.
  4. Does it make that much difference? by Thornburg · · Score: 5, Insightful

    If Twitter was the worst, with 84 hours downtime, one year is 8765.81277 hours, which means that Twitter was down .958268243% of the time. Not .9 (90%), but .009 (nine tenths of one percent). IOW, it has an uptime of 99.05%. Sure, that's not great compared to 99.95%, but it was down less than 1 in every 100 times you tried to reach it. I'm pretty sure Yahoo! doesn't manage that, and I know Microsoft's download servers don't manage that...

    1. Re:Does it make that much difference? by ProfMobius · · Score: 2, Funny

      Yep, but can you imagine the mental distress of those who can't post this tweet (is this a word ?) about the fact they are waiting at a red light ?

      --
      EULA : By reading the above message, you agree that I now own your soul.
    2. Re:Does it make that much difference? by camperdave · · Score: 2, Funny

      Yep, but can you imagine the mental distress of those who can't post this tweet (is this a word ?) about the fact they are waiting at a red light ?

      What about the mental distress suffered by those of us who are anxiously waiting for tweets regarding the twitter repair status? How are we supposed to cope?

      --
      When our name is on the back of your car, we're behind you all the way!
    3. Re:Does it make that much difference? by Colonel+Korn · · Score: 4, Insightful

      If Twitter was the worst, with 84 hours downtime, one year is 8765.81277 hours, which means that Twitter was down .958268243% of the time. Not .9 (90%), but .009 (nine tenths of one percent). IOW, it has an uptime of 99.05%. Sure, that's not great compared to 99.95%, but it was down less than 1 in every 100 times you tried to reach it. I'm pretty sure Yahoo! doesn't manage that, and I know Microsoft's download servers don't manage that...

      Good numerical point, but Yahoo hasn't failed to load for me any time in the last 10 years, with something like 10-50 page views per day. Their uptime is thus no worse than based 0.99997 on my experience, which is means 300x less downtime than twitter.

      --
      "I zero-index my hamsters" - Willtor (147206)
    4. Re:Does it make that much difference? by ari_j · · Score: 2, Insightful

      Frankly, I don't know how they did their measurements but Myspace gives me "an unexpected error occurred" often enough (and I only sign in when I get an e-mail notification of a new message or the like, to begin with) that it very much is expected.

  5. and here I am... by gEvil+(beta) · · Score: 4, Funny

    And here I am worrying about whether I should see my doctor after 4 hours of uptime.

    --
    This guy's the limit!
  6. Re:They are cut off by The+Dancing+Panda · · Score: 4, Funny
  7. Twitter doesn't work by design by itsme1234 · · Score: 4, Informative

    I think many of us recognize the potential power of twitter-like thingies. With this in mind I recently joined. It is beyond disappointing.

    - the site itself is barren, with basically no features - it is just like a '98 site in a bad way (not in a "Google-like" minimalist way)
    - can't get updates by SMS in Europe. OK, fair game, it isn't free. But you should be able to at least post by SMS, right? Somehow although they do offer local numbers (very nice) I wasn't able to actually verify any phone so can't update by SMS
    - they had updates by Instant Messenger as official feature for a while but couldn't make it work (why?! at least it should be practically free for them unlike SMS)
    - there are some 3rd party solutions to update by IM but none work (plus you have to trust the 3rd party)
    - same as above for updates by email

    So, yes, nice idea but poor execution.

    1. Re:Twitter doesn't work by design by dandv · · Score: 2, Informative

      - there are some 3rd party solutions to update by IM but none work (plus you have to trust the 3rd party)

      The Pidgin Twitter plugin works.

  8. Re:Twitter, Facebook, MySpace by Anonymous Coward · · Score: 4, Funny

    Your post, however, was a great contribution to society and will be studied for years by future generations.

    .....just not for the reasons you'd like.

  9. Re:They are cut off by exley · · Score: 3, Funny

    Go outside, take a sunbath, twitter your friend about it... err, ha, well...

    No, what you need to do in that situation is go and create a Facebook group about it.

  10. Twitter Developer Alex Payne on Rails performance by dandv · · Score: 5, Interesting
    In an interview with RadicalBehavior.com, Twitter lead developer Alex Payne commented:

    By various metrics Twitter is the biggest Rails site on the net right now. Running on Rails has forced us to deal with scaling issues - issues that any growing site eventually contends with - far sooner than I think we would on another framework. [...] At this point in time there's no facility in Rails to talk to more than one database at a time. [...] All the convenience methods and syntactical sugar that makes Rails such a pleasure for coders ends up being absolutely punishing, performance-wise. Once you hit a certain threshold of traffic, either you need to strip out all the costly neat stuff that Rails does for you (RJS, ActiveRecord, ActiveSupport, etc.) or move the slow parts of your application out of Rails, or both. It's also worth mentioning that there shouldn't be doubt in anybody's mind at this point that Ruby itself is slow. [...] I think it's worth being frank that this isn't one of those relativistic language issues. Ruby is slow.

  11. Re:Twitter, Facebook, MySpace by D+Ninja · · Score: 3, Interesting

    Well, I don't care so much about the downtime.

    However, your post shows extreme shortsightedness to what the people of this world are interested in. Yeah, Facebook, Twitter and the like *can* be extreme wastes of time. But, there is a reason that so many people are drawn to those sites. As engineers and "nerds," it would be interesting to not only know why (psychology playing a huge role in this), but what can be done to leverage technologies like these to actually provide something "worthwhile." (I put worthwhile in quotes as the worth of something is very relative.)

    What may or may not be important to you is not what the populace as a whole agrees with. You're definitely entitled to your own opinion (and I will agree with you to some extent), but given the number of users of these sites, it's important to consider the bigger picture and implications.

  12. Re:'Get a life' as a positive suggestion by The+End+Of+Days · · Score: 2, Insightful

    the rapid update demands of Facebook are more than is worth spending my limited lifespan on

    Demands? Facebook requires you to update? You must be using a different site than the one I know.

  13. My latest Tweet by Sponge+Bath · · Score: 4, Funny

    I'm now posting on /. about Twitter.
    I live such a full life.

  14. Re:'Get a life' as a positive suggestion by clone53421 · · Score: 3, Insightful

    No kidding. I've always been frustrated with people who claim they're "deleting my account because of the amount of time I waste on here". Hello? Just stop spending so much time on it...

    The only reason I can think of to delete your account would be if you actually wanted to mass-delete every note and posted item you'd posted, every post on your wall, and every tag that you'd ever been given. Otherwise, just disappear for a week or three. Your "friends" will forgive you, and the real ones might even call or e-mail if they're really that concerned about you falling off the face of the earth.

    --
    Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  15. mod parent down (wrong) by BitterAndDrunk · · Score: 2, Informative

    schadenfreude - taking delight in others' misfortune. Guilt doesn't enter into it, AC.

    --
    You better watch out, there may be dogs about . . .
  16. Re:Twitter, Facebook, MySpace by owlnation · · Score: 2, Interesting

    Yeah, Facebook, Twitter and the like *can* be extreme wastes of time. But, there is a reason that so many people are drawn to those sites.

    I think there is some truth in that, but the reason why most people use these sites is peer pressure, purely and simply. It's just a fad for most people. It's just like a local bar or club becomes the in place to go to -- without any substance. Being the reason why there's a drift from MySpace to Facebook to Twitter to the next thing.

    Personally I can see absolutely no use for Facebook nor Twitter whatsoever. But now that the sparkly teenage girls have left MySpace for the next thing, MySpace is actually a useful site. If you are an artist of some sort, MySpace is a great tool for networking and showcasing your work. Facebook is worthless for that, since you have to become friends with someone to see their profile.

    It could be that there are genuine core uses for Facebook and Twitter too -- though I cannot personally think of what they could be.

  17. Re:Twitter Developer Alex Payne on Rails performan by Anonymous Coward · · Score: 2, Interesting

    I mean wtf? This has been dubunked so many times.
    After this announcement someone wrote a plugin for rails that handled multiple databases.
    And you know, we had this huge ruby on rails application that never really took off. I would had really loved to have those performance issues they were describing.

  18. What is the uptime metric? by 222 · · Score: 3, Insightful

    I no longer use Myspace (Thank god!) but it seemed like every time I tried to do something, I was redirected to an error page assuring me that their support staff would be notified...

    Sure, Myspace was able to display html in my browser, but it seems a bit far fetched to consider that "uptime".

  19. Re:Twitter Developer Alex Payne on Rails performan by SanityInAnarchy · · Score: 3, Informative

    Running on Rails has forced us to deal with scaling issues - issues that any growing site eventually contends with - far sooner than I think we would on another framework.

    That is probably true. However, I would count that as an advantage -- better to deal with them sooner than later.

    At this point in time there's no facility in Rails to talk to more than one database at a time.

    There are many, many ways to talk to more than one database in Rails. In fact, it is possible to swap out the entire database layer of Rails and use another ORM, or no ORM at all. On the bleeding edge -- and Twitter might actually be a good candidate for this -- people have wired up Rails to CouchDB, which provides trivially scalable multimaster replication, and which, being HTTP, can be thrown behind any old load balancer -- which brings this back to a "just throw hardware at it" problem.

    All the convenience methods and syntactical sugar that makes Rails such a pleasure for coders ends up being absolutely punishing, performance-wise.

    Some of them do -- a good example would be Symbol.to_proc.

    However, Merb proves that this is not actually a Ruby problem, it is a Rails problem. And Rails and Merb are merging some point in the near future.

    It's also worth mentioning that there shouldn't be doubt in anybody's mind at this point that Ruby itself is slow. [...] I think it's worth being frank that this isn't one of those relativistic language issues. Ruby is slow.

    Somewhat true -- after all, Ruby 1.9.1 did double the performance of the language.

    But, relative to what?

    Turns out that, at least compared to other languages and frameworks (like PHP), Ruby is not slow.

    It's also worth mentioning that while all of the Twitter alternatives may have enjoyed better uptime, they haven't had nearly the amount of traffic that Twitter does. We don't really know if they can scale -- but even supposing they can, Twitter was there first. And while they complain about those nice features being slow, they probably owe their success to those features for getting their product out the door faster than their competitors.

    It's also worth mentioning that this interview is almost two years old. Rails changes a lot in two years. In fact, Twitter were early adopters -- two years before that interview, Rails had only just shared commit rights. Two years before that, it didn't exist at all.

    It might be worth asking what version of Rails Twitter is using, and if they've noticed a change since then.

    --
    Don't thank God, thank a doctor!
  20. Re:Twitter Developer Alex Payne on Rails performan by stoolpigeon · · Score: 3, Funny

    does this mean metalhed77 wants to punch Alex Payne in the face?

    --
    It's hard to believe that's how Micronians are made. Why don't we see it right now by having you both kiss one another?
  21. This is nonsense. by Jane+Q.+Public · · Score: 2, Insightful

    The Twitter people have stated publicly that their technical problems are NOT due to Rails. You folks can claim that it is all you want, but that doesn't change the facts.

    The problem isn't people obsessed with Rails... the problem here is people who just don't like it, for whatever reasons of their own. Well, your reasons *ARE* your own. Please keep them to yourselves unless you can start coming up with facts rather than unfounded insults.

    Quote from Twitter representative: "I strongly believe that the best tool for the job is the best tool for the job. Rails is the best web application framework around for rapid prototyping and, as aforementioned, building CRUD-style applications. I would choose Rails again for such a project."

    Twitter stated that they simply did not plan ahead for the popularity of their service. Period. That is not the fault of the platform they use.

    1. Re:This is nonsense. by blueZ3 · · Score: 4, Funny

      CRUD-style applications

      I think that says it all, right there.

      --
      Interested in a Flash-based MAME front end? Visit mame.danzbb.com
  22. My favorite social networking site never down by noidentity · · Score: 3, Funny

    The social non-networking site I use, isolatr.com, is never down, and has never failed to bring me zero annoying "friends". I highly recommend it.

  23. Twitter's downtime by teknognome · · Score: 5, Funny

    While I don't use twitter, it's downtime is bad enough (or people are obsessed enough) that not only is there IsTwitterDown.com but also IsIsTwitterDownDown.com

  24. Yay fail whale by bluefoxlucid · · Score: 2, Interesting

    One of the most amusing error messages ever 3 Where the hell did it come from? Why is it flying with birds? What the fuck is this shit? Who knows! It's fail whale!

    1. Re:Yay fail whale by revscat · · Score: 2, Interesting

      Birds tweet. They all tweet to each other. And they do so using tin cans and string.

      So they're flying along, happy tweeting on their retro iPhones when all of a sudden this doped up whale jumps in the middle of them, dragging them all to their doom.

      Birds = Twitter
      Whale = system/network load/myth of Rails scalability

      It's a gorgeous bit of iconography.

  25. Re:Twitter Developer Alex Payne on Rails performan by Mad+Merlin · · Score: 2, Interesting

    Once again: Look at the actual statistic I'm quoting. Are you suggesting this was CakePHP, run as a web app, benchmarked with a web benchmark, yet somehow run as a commandline app?

    I've never used CakePHP before, but every benchmark I find on it suggests that it's horribly slower (10-100x slower, if not more) than stock PHP. For example, over here they get 37.46 requests/s for a hello world CakePHP page on a 3 GHz Intel machine with 512M RAM. I gave a plain PHP hello world page a try on a 1.3 GHz Pentium-M laptop with 512M RAM (a substantially slower machine) with the same ab parameters and I get 1254.75 requests/s. In other words, the substantially slower machine gave 33x better performance with stock PHP than the substantially faster machine gave with CakePHP.

    So yes, maybe RoR has comparable performance to CakePHP, but who cares? CakePHP is painfully slow and I don't know anyone or anything that actually uses it. Wake me up with RoR (or Ruby) is faster than stock PHP.

  26. Re:They are cut off by NeoSkandranon · · Score: 2, Insightful

    What the readers of the feed think: Having a bunch of feeds to follow is a mildly amusing way to kill time

    What the owner of the feed thinks: That he's so awesome/important that people want to know what he's doing at all hours

    --
    If you can't see the value in jet powered ants you should turn in your nerd card. - Dunbal (464142)
  27. Re:99% isn't good enough by TheVelvetFlamebait · · Score: 2, Insightful

    The GP was saying that, all conversions be done, 84 hours is not as devastating as it can sound. That's not saying it couldn't, nor that it shouldn't, be improved.

    Mind you, it's a freaking social networking site. How many lives will be seriously inconvenienced (much less endangered) by its downtime?

    --
    You know, there is a difference between trolling and pointing out the flaws in your reasoning. Just saying.