GMail Experiences Serious Outage
JacobSteelsmith was one of many readers to note an ongoing problem with Gmail: "As I type this, GMail is experiencing a major outage. The application status page says there is a problem with GMail affecting a majority of its users. It states a resolution is expected within the next 1.2 hours (no, not a typo on my part). However, email can still be accessed via POP or IMAP, but not, it appears, through an Android device such as the G1." It's also affecting corporate users: Reader David Lechnyr writes "We run a hosted Google Apps system and have been receiving 502 Server Error responses for the past hour. The unusual thing about this is that our Google phone support rep (which paid accounts get) indicated that this outage is also affecting Google employees as well, making it difficult to coordinate."
Seems to be fine at the moment. Is this the first anti-slashdot-effect?
The wheel is turning, but the hamster is dead.
So much for handing your email over to Google because it's more reliable than hosting locally...
To do list for Windows
Someone's gonna get fired over this.
I don't know that this is actually news-worthy. I have never worked for a company which has not suffered email outages, no matter how their email is supported. Granted, GMail has a large list of client companies, but you are a fool of the highest order if you think the name will protect you from outages.
It always worked on my iphone too, through Beejive.
12:50 - press return.
It seems like it might be a DDOS attack. I was asked to pass through a CAPTCHA and I made it in. Try this link: https://mail.google.com/mail/?shva=1#inbox
Take off every 'sig' for great justice.
It came back up for me about 10 minutes ago.
The greatest revenge in life is massive success.
Great job slashdotting my email, dammit.
To do list for Windows
If anyone cares, I had no problem logging in just now from Toronto (Canada).
The cloud is falling! The cloud is falling!!
Although my Thunderbird access to Google Apps works fine. :)
Not to belittle the editorial staff, but gmail was back up and running before the story was posted publically
As of the time of this posting, Gmail Mobile is working.
"As God is my witness, I thought turkeys could fly." A. Carlson
My G1 Android phone is working fine, I'm still able to access and receive gmail.
Hosting and Domain name coupons
The unusual thing about this is that our Google phone support rep (which paid accounts get) indicated that this outage is also affecting Google employees as well
Doesn't everybody use gmail or related items in some way shape or form during the day?
When its a cloud ... expect it to rain.
At the same time Dell.com has been down. Made me wonder if it was just a bad day for computers, or someone attacking companies.
As I type this, I can get in to GMail just fine, but a friend in Texas can't (I'm in Nevada). Guess Google likes us better.
And kudos to the Google team for updating the status when they say they will. Looks like the script they use automatically puts current time + 1 hour in as the default next update time, and they're posting updates before that expire. Too many times, something simple like that gets overlooked.
DELL.Com is down also.. how funny is that
..'cause Gmail works perfectly for me, and has been working just fine the whole day. Does the fact that I am in Finland have anything to do with Gmail not going down?
"The agriculture ministry is not in charge of Gundam" - Japanese ministry official.
*snore* ... now we are going to see an article by every "tech" writer on the big outage. CNET is probably working overtime as we speak to get this important news out to the readers!
After all, Google is always experiencing these outages and the other options for hosted email and web apps have a 100% uptime.
ok ok... end sarcasm.
Works fine for me.
but now back, in California
At least, it seems to be fixed on the west coast of Canada.
I think Gmail is a great service for personal accounts...
but for business sorry you need to pay a real live person or support company who will actually be able to deal with your data
how do you get the data out of gmail to switch providers ?
ever serviced a discovery litigation from google ?
(you know where they judge you guilty of you dont come up with the data)
sorry but there is a good reason to keep this stuff on site and working...
regards
John Jones
It it's true that this outage is affecting Google too I have to say that is a good thing. Eating your own dog food, product-wise, is always a good idea.
.: Max Romantschuk
I guess it's hard to complain as I use google apps for free.. Though years back I made the switch over from my own personal mail system to escape the infrequent, but intolerable outages from my ISP..
OHh well, I guess carrier pidgeon is still an option.
Bah, gmail is great, if this is it for awhile, I won't complain.
It started working again for me at about 5:15pm EDT.
Upside: shows confidence in your products; makes it more likely that your engineers will spot problems if they use the software and services themselves; can increase how motivated people are to improve the products
Downside: tainted dogfood kills the engineers who would have investigated the issue
10 PRINT CHR$(205.5+RND(1)); : GOTO 10
I've had more outages through power loss and the connection being physically severed to locations than I have through gmail, but I do live in the south and everything is above ground around here.
This is what happens when you force a product out of beta too early. Google should have kept Gmail in beta for a few more years.
The RSS feed shows they've been having problems since yesterday.
I got a 502 error today, not a huge deal for me, I just use it for personal but if I was paying for it I'd be mad, just like people at work get mad at IT when the Exchange server goes down.
Anybody know what kind of hardware setup they have there?
Maybe they contracted a third party company to store the data in the cloud and their service was interrupted?!
Google apps for domains, free version. 20 employees have been using it all evening with no issues (Belgium).
I drank the Google kool-aid about six months ago and moved my personal domain's mail over to the free gmail service. I've been extremely happy with it ever since.
I think it's interesting that I couldn't access my personal domain gmail during this outage, but my @gmail.com account worked without issue.
I use my gmail account whenever I sign up for free services. This is serious people! Where will all my spam go? Oh, wait, nevermind...
My Android device was not affected by this outage at all.
Still displayed on my screen, as I am watching Tomb Raider on BBC1, so I haven't hit refresh yet. The source does not have any comments either.
Google
Error
Server Error
The server encountered a temporary error and could not complete your request.
Please try again in 30 seconds.
I've been using GMail without error from about 0800 - 1500MST.
What outage again? Didn't see it. Must not be as widespread as reported...
deleting the extra space after periods so i can stay relevant, yeah.
So much for handing your email over to Google because it's more reliable than hosting locally...
Yeah. As my subject heading says...
Seriously, though: it probably depends on who's doing the hosting. I'm sure there's slashdot readers for whom setting up (and maintaining) their own mail server is a short task done before breakfast without breaking a mental sweat. I'm further sure I could learn to be one of those people, but I'm betting the time I'd invest in doing that is less than the amount I've time I've spent waiting for google to come up.
Tweet, tweet.
We are experiencing 503 errors and timeouts from Dell websites.
Welcome to the promise of Cloud Computing.
The future is here.
4:37 PM
The problem with Google Mail should be resolved. We apologize for the inconvenience and thank you for your patience and continued support.
I've not received any emails via my gmail address since yesterday. I do, however, get emails that gmail fetches from my POP3 and IMAP accounts. According to my exim logs, gmail accepts the mail, it's getting lost internally. I'm now getting mail delivery delay notifications from 10.90.242.1 somewhere inside Google.
At the same time the delivery issues started, gmail started complaining that it wasn't able to load my contacts list either. But my contacts list on Google Voice appear to be just peachy, and I thought they were the same list.
Eh, who knows, I just hope they get it fixed. I'm not going to complain about something I get for free.
For what its worth, I wasn't having any access issues all morning on Gmail.. this is, not until I read about the outage and went to check (NOT EVEN 5 MINS SINCE THE LAST TIME I CHECKED MY MAIL!) and lo and behold, it was down.. not responding.. telling me "can't connect to Gmail and to check my connection"
BTW, It is fixed and back up here for me now.. outage lasted approx 45 mins out west where I am.
PPN
No, twitter's always down...
They even made it part of the SLA, and a ritual of passage.
Hell, it has its own meme
2^3 * 31 * 647
... I submitted to Ask Slashdot about Google Enterprise Support earlier today. Guess that won't get posted.
I expect and can live with occasional outages but when mail disappears as has happened with a paying, Google Apps customer of mine it is another matter.
Google tech support has been slow and woefully inadequate in helping to resolve the issue or even determine what happened. Also, while the assumption has always been "backups are not necessary with gmail" I can't get a straight answer from Google about the possibility of restore without Postini services in the case of malicious data deletion as appears to be the case in this instance. It's hard to say because Google still hasn't given me basic information about the missing data. They were able to tell me that it was all deleted at once by some one who legitimately logged in but the won't tell me when.
Anyone else have encounters with Google support over missing mail?
"It states a resolution is expected within the next 1.2 hours ..."
Why the surprise at this? All estimates include their Google 20% one way or another, right?
along with me who are sick of hearing, "we should switch to google" or "google gives me a trillion gigs of storage for mail why dont you?!" this outage proves a point: all services fail from time to time. the difference is when mine fails you can call me and ask WTF? When googles service fails you still have to pay me for network operations, but you also have to pay google for the privilege of asking "so whats wrong?"
and despite your hardest whining or assertiveness, you may never get an answer.
Good people go to bed earlier.
but you also have to pay google for the privilege of asking "so whats wrong?
Or, you could NOT pay Google at all, and when something goes wrong, realize that being able to call and ask what is going wrong is not going to get it fixed any sooner, and wait until they fix it.
Having someone soothe you over the phone during the process is a waste of money.
paintball
Why so serious?
So does all this stuff only happen in America? Because if you hadn't have mentioned it, I wouldn't have known it was going on.
I'm a Brit, by the way, pip pip.
No sooner do you come out of beta than ....
I'm sure there's slashdot readers for whom setting up (and maintaining) their own mail server is a short task done before breakfast without breaking a mental sweat.
Not really. The problem is that, as with most hard tasks, it's easy to trivialize in the abstract. In 10 seconds, I can type a command-line script that will answer port 25. In a slightly longer time I can pull down the appropriate packages for the Linux distro of choice and configure them with whatever domain name. In slightly longer, I can configure appropriate countermeasures and firewalling. Given budget and time, I can deploy a suite of additional features including redundancy (local and/or remote), various protocols for access to the mail, a Web front-end, calendaring, mailing list handling, archival, SOx-compliant retention management, monitoring, escalation paths, and so on...
Or I can sign up for Google Apps and have all of the above deployed in under a half hour for a company of nearly arbitrary size with customizations (logo, URLs for local support, internal documentation updates, etc.) being done within a week and larger-scale work (changing deployment manifests for new systems to ensure compatible browsers and pre-configured IMAP clients, etc.) being done over the course of the next month or two in conjunction with other parts of the organization.
After running my own mail servers for a decade, I finally gave in and went the Google route for my personal domain, and I'd recommend it for any size organization. There are pitfalls. You'll have to adapt or replace pieces of what Google gives you (their mailing list management is atrocious). But I feel that the work they leave in your lap is a very small trade-off given what you get.
Do you at least have an upskirt photo of your foul-mouthed girlfriend to tide us over until Fyzzler's gmail account is working?
This is exactly why cloud computing is probably one of the worst ideas to come about. There was a distinct reason that computing moved from a centralised model to a descentralised one. Imagine being in the position that you were depending upon Google Apps for your small to medium sized business and you can no longer take orders and communicate with vendors and customers. I could imagine the loss would be quite heavy and the impact felt. This is why it is always better to retain control over your computing. It is destiny best left in YOUR hands.
Difficult to coordinate? Are you telling me the engineers there use the system they're supposed to be running as their sole means of communication?
Egads man.
or else!
What's a good Windows backup program that I can use to download all my Gmail messages to Thunderbird?
I don't know for everyone, but I had GMail outage for a few hours, both HTTP and HTTPS, yet my iGoogle GMail app worked the whole time.
Seems like the outage was very specific.
...and as someone else wrote, we're now seeing the reason why.
Cloud computing is exactly the kind of buzzword-laden, idiotic fad that tends to be loved both by corporate marketing droids and technophobic Baby Boomers, both of whom have roughly equivalent levels of intelligence.
All it is going to take is a single major, successful DDoS attack against Google or some other cloud provider, and the cloud will go to the memetic rubbish bin where it belongs.
If you're one of the intellectual cripples who has difficulty understanding why cloud computing is a bad idea, ask yourself the question of whether or not you're going to be able to access your email if Google goes down, or if web access outside your ISP's own subnet does.
Yes, I have a Gmail account, but it is a convenience linked to my WoW blog, and a spam trap at best. It isn't something which I rely on for anything truly important, because I'm old enough to remember decentralised email, and to have more fucking sense.
Darn fool kids; they never learn. We keep seeing the same old mistakes being made, over and over and over again. I'm reminded of the old Frantics song, here.
Dumb terminal/"cloud" computing? Boot to the head. Creating a single, centralised point of failure which is just waiting for a DDoS attack. Genius.
XML/binary format RPC in GUIs? Boot to the head. Opaque, undiscoverable, uneditable, and totally unnecessary, except in the minds of marketing suits, or post-pubescent CS grads who've been fed corporate Kool-Aid. Use sockets, morons.
Binary subpackaging of libraries? Boot to the head. Given what bandwidth and disk space is at these days, any claim that it saves space is totally bogus, and the only thing it does do is add needless complexity, and reduce reliability. Put the whole thing in a single package, and stop thinking you're smart for doing otherwise. You're not.
Writing opaque package management in C, with a dep list a mile long, when a system written in shell, awk, and using the graph/dep management ability of Make itself would work probably more effectively? Boot to the head. Although sorry; I keep forgetting that Awk isn't considered a "real," programming language. You might want to let the guys using it for AI research know that, though; they could forget otherwise.
Being a snot nosed, latte sipping, yuppie CS graduate who thinks they know how to code, and then spawning attrocities like Dbus? Boot to the head. The kernel hardware notification system and udev work perfectly well by themselves. Adding more daemons when you don't need to simply adds unnecessary complexity, which again potentially reduces robustness.
Writing opaque, non-standard, dynamic GUI "automounter" garbage for Crapbuntu instead of teaching users how to edit /etc/fstab? Boot to the head. Use things which are easily locatable, and written in text which can likewise be edited easily. Then again, I guess I can't expect the Stallmanite 14 year olds who code Linux's userland these days to know about real UNIX philosophy, now can I?
Causing GRUB to default to "quiet splash," in Crapbuntu so that when the boot process inevitably fails due to the distro coming with Bit Torrent servers by default, the user can't see the daemon that is causing the boot process to fail, and are thus left with a totally opaque, unfixable black screen that they can't recover from? Boot to the fucking head, x100.
Plural second person future perfect:
all'ya'll'll've
Usage:
All'ya'll'll've been doin' it wrong if all'ya'll do what yer plannin' on doin'.
The possessive form of "yall" is "yall's". Here is an example sentence.
"I saw the car outside and figured it was yall's."
"Yall's" is a contraction of Yours (all of yours).
In the northeast, a variation is "youze guys'es". In the deep south, another variation is "your'n".
Gotta love English.
Most of the long distance in the country dropped that day, triggered by 4ESS switches hitting a bug, detecting, it, going offline (with load shifted to other switches). Increased load made the bug in question more likely to be hit, so those switches would in turn drop and shift load away (sometimes back to the originator). 9 hours of basically no long-distance service.
And just think, it was a year and a half before Berners-Lee announced the "World Wide Web" and Linus announced that he was working on this "Linux" thing.
fencepost
just a little off
Even though it was done, I was able to send and receive email via Thunderbird with IMAP.
The GMail Mail Service did not appear to have any problems today at all... You could IMAP or POP your mail all the while... and use SMTP to send..
What was down was the GMail Web Service. For reading your email online... it of course is just another client of the GMail Mail Service.
When Google mail goes down, how do they tell each other at Google?
That's why its still it beta... oh wait >_
If it does, then let's contract it:
"you all will"
"y'all'll"
The apostrophes indicate the missing letters "ou" and "wi".
As much of a prescriptivist grammarian as I am, I recognize that English lost something when singular "thou" was merged into the plural "you" into a numberless second person. Meanwhile, German got to keep "du" for singular. Words like "y'all" and "youse" are simply attempts to re-establish number in the second person. I prefer the former, but that may be my Midwestern bias showing through. I do like the apostrophe to be put in the right place, though.
Or dost thou shit me with thy comment?
[100% ISO 646 Compliant]
SVM, ERGO MONSTRO.
IMAP was still working when I noticed it go down.
I just logged on igoogle, read my gmail without a problem...
SCIREV.NET - fanfics,reviews & more
This episode made me really glad I use Google Gears. Yes, it makes my Google Apps experience noticeably more wonky, but I've taken to using Safari as my day-to-day Gmail/Docs/Calendar app, firing it up in Firefox + Gears every week or so to keep the offline backup synced. To each his own, but as a guy who just wants a mindless backup solution and doesn't mind having copies of his life floating around Mountain View, I can't recommend Gears highly enough. YMMV.
...using Gmail.
sigs are for nerds
Well it IS still in beta! :rolleyes:
Why on Earth would anyone buy a treadmill? Don't you have any streets, parks, ground of any kind where you are? Maybe you should have bought an albatross while you were at it.
It looks like they are at 16 hours and counting of interrupted service. I also see that I can connect via POP but not the web interface.
Damn_registrars has no butt-hole. Damn_registrars has no use for a butt-hole.
I think it's translated in New Jersey as "All Youz".
SJW: Someone who has run out of real oppression, and has to fake it.
taking our limited life scope into consideration, it is ridiculous to worry about a... 2h gmail outage...
I could access correctly with IGoogle gmail gadget!!!
This Gmail outage is provoking concerns over the reliability of cloud computing. However, there is nothing to be concerned about. Gmail actually has little to do with cloud computing. It is a hosted service. The appropriate paradigm for Gmail is black box.
Gmail is single point of failure. Your data is stored at one location. When that location is unavailable your data is inaccessible. An opaque, inscutable black box is the correct analogy.
If you were actually applying the principles of cloud computing to email then your data would be replicated among several black box vendors. The outage of a single vendor would not cut off your access.
In short, we dream of the promise of cloud computing but very few true cloud computing services have been implemented. The most conspicuous example of a working cloud computing service is IP packet routing and IMHO it works great.
This was a tad late :) during the downtime, both my python google scripts and my android G1 were functioning correctly with the odd garbled text in the python script instead of an "unread" number.
the G1 didn't have any issues updating itself, i am therefore going to assume it uses imap, but don't quote me on that!
"Gmail is single point of failure." - all singular email services and hosting companies are a single point of failure, in this case, merely webmail access was down. businesses who relied on google via pop/imap did not even notice. Not to mention, google offer convenient backups of all your data in a tarball, if there was ever a failure, it is your own fault for not downloading these on a regular basis, you can also re-upload these tarballs in the event of a failure or to move to a new login.