Slashdot Mirror


Amazon's Cloud Service Has Outage, Disrupting Sites (usatoday.com)

An anonymous reader shares a report on USA Today: Portions of Amazon Web Services, the nation's largest cloud computing company, went offline Tuesday afternoon, affected multiple companies across the United States but especially on the east coast. The outage appeared to have begun around 12:45 pm ET. It was centered in AWS' S3 storage system on the east coast. Many of the services that firms use AWS are for back-end processes, and therefore not immediately visible to consumers, though the outage could disrupt customer-facing activities like logins and payments. At least some websites that appear to be affected are: Airbnb, Down Detector, Freshdesk, Pinterest, SendGrid, Snapchat's Bitmoji, Time, Buffer, Business Insider, Chef, Citrix, CNBC, Codecademy, Coursera, Cracked, Docker, Expedia, Expensify, Giphy, Heroku, Home Chef, iFixit, IFTTT, isitdownrightnow.com, Lonely Planet, Mailchimp, Medium, Microsoft's HockeyApp, News Corp, Quora, Razer, Slack, Sprout Social, Travis CI, Trello, Twilio, Unbounce, the U.S. Securities and Exchange Commission (SEC), and Zendesk.

The dashboard of Amazon Web Services, which tracks the status of the service, is unable to change color, Amazon said. It is because the status dashboard also runs on the service that is down.

24 of 161 comments (clear)

  1. I guess that explains Strava by dugancent · · Score: 2

    I couldn't upload or view my run this morning. I was a bit upset, but I guess it can wait.

    --
    SJWs are the new boogeyman. -Me
    1. Re:I guess that explains Strava by xevioso · · Score: 2

      You could go for a run while you wait...

  2. even downdetector.com is down by gd2020 · · Score: 4, Funny

    irony

    1. Re:even downdetector.com is down by Daetrin · · Score: 2, Funny

      Are you sure it's down? I tried to check with IsItDownRightNow.com, but am having difficulties with the site for some reason...

      --
      This Space Intentionally Left Blank
  3. The solution by Ol+Olsoc · · Score: 4, Funny

    This wouldn't happen if we put the cloud in the cloud.

    --
    The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
  4. Ahh, the cloud. by Lisandro · · Score: 4, Insightful

    AKA "just someone's else computer".

    This outage is being going for over an hour now but, according to Amazon, their services are green all across the board with "increased error rates". Almost feels like they're trying to cheat out their own SLAs.

    1. Re:Ahh, the cloud. by Lisandro · · Score: 2

      Grrr, it's "someone else's". Thanks phone.

  5. Re:So why use these large cloud services? by ScentCone · · Score: 5, Informative

    Seriously...I would suspect this is due to an attack of some sort. Just a hunch.

    The last time Microsoft's Azure platform had a huge, sustained failure, it was just an internal screw-up, not an attack. I've got no reason to think Amazon's east coast problems are any different. Not to say it couldn't be an attack, but no reason to think one way or the other, and lots of reasons to think "screwed up" - because that has happened at Amazon and elsewhere in Big Cloud many times.

    And if so, isn't it the case that the larger the company, the bigger the target?

    Yeah, but they've also got the enormous resources to help fend off problems that would crush a smaller provider. Works both ways.

    --
    Don't disappoint your bird dog. Go to the range.
  6. Re:Too bad ... by Oswald+McWeany · · Score: 4, Insightful

    Meh. Finally gave in and installed Ad Blocker. Slashdot easily has the most invasive ad structure of any web site I go to.

    --
    "That's the way to do it" - Punch
  7. Re:Great time to handle failure cases... by Dunbal · · Score: 3, Insightful

    Why bother. People are used to mediocrity. Doing what you suggest would cost money and eat into profits. Fuck 'em. The TOS are quite clear, this will happen once in a while and you'll just have to put up with it. By the way, don't forget your next payment is due.

    --
    Seven puppies were harmed during the making of this post.
  8. Re:Why are they lying? by Anonymous Coward · · Score: 2, Informative

    Ha!

    Update at 11:35 AM PST: We have now repaired the ability to update the service health dashboard. The service updates are below. We continue to experience high error rates with S3 in US-EAST-1, which is impacting various AWS services. We are working hard at repairing S3, believe we understand root cause, and are working on implementing what we believe will remediate the issue.

  9. All good by Anonymous Coward · · Score: 4, Insightful

    My website is on my own server network and is working fine.

    Because I have not built up an infrastructure depending on computers I don't own, don't control, have no ability to see to the physical and network security of, where I don't have any control of reliability, redundancy, backup, availability of resources, longevity, OS level, OS and other software updates...

    Oh yeah, and my costs are far less than the monthly dollop of blood extracted by cloud services.

    "Live by the cloud... die by the cloud."

    Carry on, suckers.

  10. Re:Yeah, this got me as well by Paradise+Pete · · Score: 2

    Does your spell checker really understand when to use its or it's? Mine doesn't. Not an easy problem for computers (nor for humans, apparently). Or were you talking about something else?

  11. Re:Yeah, this got me as well by Osgeld · · Score: 2

    shut up, dickhead

  12. Re:The irony of this... by MachineShedFred · · Score: 3, Informative

    Yeah, that guy is a douche, and you don't want to work for him.

    I work for a company that hosts stuff in AWS, and we are doing cross-region backups, as well as a weekly dump to our on-prem servers. Yes, AWS has a good amount of redundancy between the multiple availability zones per region, etc. But why take the chance, when it's trivial to dump your stuff on a scheduled basis to another region, or even to something as cheap as a Synology box or one of those workstations being recycled into a FreeNAS box in the office?

    --
    Slashdot still doesnâ(TM)t support Unicode after it was added to the HTML standard in 1997.
  13. Re:Yeah, this got me as well by Known+Nutter · · Score: 3, Informative

    Your and idiot.

    --
    Beware of the Leopard.
  14. Re:Wow AWS Goes down also? by BenFranske · · Score: 2

    I caught that too and thought it was interesting. One other interesting thing about an application that really uses cloud services to their full potential (rather than just as an expensive VM/VPS) is that since the services are not commoditized/standardized there is a lot of cloud vendor lock-in. E.g. if you build a huge web app around AWS you're going to have a lot of rework to do (to some extent depending on how well you modularized your code) to migrate to another cloud provider.

  15. Re: Not a complete outage by BenFranske · · Score: 2

    This. Clearly a lot of people jumped into cloud "to save boatloads of money" (same reason so many jumped into outsourcing. Saving tons of money is not often a good reason to do something. Usually you can make incremental savings but it's never what the salespeople or service promises because those prices ignore things like redundancy, etc. In the end doing it right ends up costing about the same as you were paying before, maybe a little less or a little more and maybe you gain some more features, but it's also probably more complex.

  16. Shattered SHA1? by pHZero · · Score: 2

    Surprised no one has mentioned that a possible root cause is that someone uploaded the two PDFs from the Shattered attack, causing a SHA1 collision on S3

  17. It's not "no dependencies" as much as "fewer" by tepples · · Score: 3, Insightful

    I have not built up an infrastructure depending on computers I don't own, don't control, have no ability to see to the physical and network security of, where I don't have any control of reliability, redundancy, backup, availability of resources, longevity, OS level, OS and other software updates

    I'm interested in how you eliminated dependencies on your home ISP's DHCP server, backbone routers, the DNS, the OCSP server of the CA that provided your site's TLS certificate, etc. And without advertisement exchanges or subscription payment servers, how do you afford to keep your server powered on and connected to the Internet?

    1. Re:It's not "no dependencies" as much as "fewer" by tepples · · Score: 2

      I have not built up an infrastructure depending on computers I don't own, don't control

      I'm interested in how you eliminated dependencies on your home ISP's DHCP server

      I have static IPs.

      First, most home ISPs charge extra per month for that. Second, Comcast requires subscribers with a static IP to either forfeit the static IP or rent and use Comcast's modem, which reintroduces "depending on computers I don't own, don't control", and moving to an area whose cable company is not Comcast can prove cost prohibitive, particularly if your work is unrelated to your website.

      I don't serve HTTPS. I'm not collecting information about you, or serving illegal or secret information.

      Making even a completely public, completely static website available over cleartext HTTP and not HTTPS has three consequences. First, the most popular western web search engine will demote your site. Second, you run the risk of a rogue ISP injecting pop-up advertisements and other malware into your pages, as Comcast has done (source 1; source 2). Third, you cannot make resources on your site available for transclusion into sites that do use HTTPS due to the mixed content policy.

      And without advertisement exchanges or subscription payment servers, how do you afford to keep your server powered on and connected to the Internet?

      I work.

      Is your work related to your website? If not, what benefit do you gain from having a website, and do you ever have to take time off your day job to keep it updated?

      When many people concentrate their dependencies on something such as Amazon's cloud, when the cloud dies or is successfully attacked, everyone goes down.

      The same is true of DNS or a major home ISP. Or is your argument "only those dependencies that are provably absolutely necessary, and not a single one more"?

  18. Problems with the Cloud by Cro+Magnon · · Score: 4, Insightful

    If it rains, you're in trouble.

    --
    Slow down, cowboy! It has been 4 hours since you last posted. You must wait another few hours.
  19. Re:Coffee Doesn't Meet Bagel by ColdWetDog · · Score: 5, Funny

    CMB messaging has silently stopped.

    The Cosmic Microwave Background has stopped?

    Jeez. I didn't realize that Amazon was that important.

    --
    Faster! Faster! Faster would be better!
  20. Re:ONLY EAST COAST by sexconker · · Score: 4, Funny

    West coast best coast, east coast least coast.