Slashdot Mirror


Outages Leave Google Apps Admins In the Hotseat

snydeq writes "This week's Google outages left several Google Apps admins in the lurch — and many of them are second-guessing their advocacy for making the switch to hosted apps, InfoWorld reports. The outages, which affected both Gmail and Apps, 'could serve as a deterrent to some IT and business managers who might not be ready to ditch conventional software packages that are installed on their servers,' according to the article. 'If we began to experience a similar outage more than about two or three business hours per quarter, we'd probably make Google Apps and Gmail a backup solution to a locally hosted mail system, if we used it at all,' said one Apps admin. 'And it would likely be years before we'd try a cloud-based collaborative system again from any vendor.' Coupled with recent Apple and Amazon cloud issues, these Google outages are being viewed by some as big wins for Microsoft."

260 comments

  1. why "big win" for microsoft ? by unity100 · · Score: 3, Informative

    isnt there any other vendor out there providing business solutions ? its not like everyone is going to jump into exchange wagon because they couldnt do with google apps. geez.

    1. Re:why "big win" for microsoft ? by Ritz_Just_Ritz · · Score: 3, Insightful

      I agree. Openoffice is still "locally installable" and 100% free on the applications front. And any business that relies on an outside free webmail service for their corporate email needs is just asking for trouble...loss of the service from time to time is but one of the gotchas.

      Cheers,

    2. Re:why "big win" for microsoft ? by lukas84 · · Score: 5, Insightful

      Google Apps Premier is not free - it's 50$ per year per account.

      I'm using it for my private mail. I like it. But i don't expect 100% uptime - especially for just 50Ã per year per account.

    3. Re:why "big win" for microsoft ? by Anonymous Coward · · Score: 0

      I don't see it either, it's not as if an exchange solution operates without downtime. It's a big win for hosted solutions with SLA's, that's for sure. It really doesn't matter if you have everything in-house or in a datacenter, shit happens and there's only so much anybody can do.

    4. Re:why "big win" for microsoft ? by jabithew · · Score: 5, Insightful

      Because it's a refutation of Google's business model (cloud based, for want of a better way of phrasing it) compared to Microsoft's (locally based tech).

      I remain sceptical, as it it would seem that Google would have to be less reliable than local kit in order to make it worth switching back, even before you take into account extra costs for doing it locally. (How much more do you want to spend to get an extra hour per quarter in reliability?)

      Nevertheless, IANASA so I don't know the data behind this decision.

      --
      All intents and purposes. Not intensive purposes.
    5. Re:why "big win" for microsoft ? by johannesg · · Score: 5, Insightful

      There are only two IT solutions out there in the minds of too many people: Microsoft, and non-Microsoft.

      To go with Microsoft is the easy, sure road. It is the standard. It is what is expected, what is known to be safe, what will always work. Any problems you encounter here are met with "well, computers always have problems don't they?"

      To go with non-Microsoft is hard and uncertain. It is not expected, nor "the standard", and suspected to be extremely unsafe. The smallest problem will be countered with "you and your stupid ideas. Now go and call LocalRetailerInc for a certified Microsoft solution, and be glad I don't fire your ass over this fiasco!"

      Google is not Microsoft, so according to the business logic described above, if it doesn't work the only possible alternative is to use Microsoft.

    6. Re:why "big win" for microsoft ? by lukas84 · · Score: 1

      That mostly happens because decision makers never can make up their mind with what they want.

    7. Re:why "big win" for microsoft ? by gullevek · · Score: 1

      If you have a lots of locations around the global and not a central mail system and instead a lot of locals, where some are still POP and then something like google mail is still a much better solution.

      --
      "Freiheit ist immer auch die Freiheit des Andersdenkenden" - Rosa Luxemburg, 1871 - 1919
    8. Re:why "big win" for microsoft ? by thermian · · Score: 2, Insightful

      Its only a big win if Microsoft don't have similer problems.

      I'm personally very dubious about these online apps as anything but utilities for occasional use.

      The main issue for me is that they exists primarily to benefit the hosting company (google, Microsoft or whoever). We don't need them, they need us to use them, otherwise they can't make money from us.

      The current 'install on local machine' application model works perfectly well for end users, but there's less profit for them if you can buy something then use it for years without paying again.

      --
      A learning experience is one of those things that say, 'You know that thing you just did? Don't do that.' - D. Adams
    9. Re:why "big win" for microsoft ? by chthon · · Score: 4, Interesting

      Non-Microsoft can be :

      • IBM mainframe
      • IBM System/i
      • IBM AIX
      • Sun
      • HP
      • Solutions using Red Hat or SUSE (however despised they might be)
      • I am pretty sure there are other solutions...

      I think the basic problem is impatience. I can understand that people want for business purposes something that is quickly implemented, but my experience is that when a Microsoft implementation is chosen, you have two long-term issues : you will time and time again have to solve the same problems over and over, and you can be sure that Microsoft will try to pressure you into upgrades, willing or not.

      My experience with Linux and associated programs is this. Over time, everything gets better and better. Sometimes, you might need some time to investigate a problem and solve it, but once solved, it will not recur again (be sure that you have a good system to record such findings, but that would be same when using Microsoft).

      I have already three people (not much, yes, but important for me) using Linux : my father, my brother (who shares with my father's PC) and my sister. Unless there is a hardware problem, I can be sure that I do not have to solve software issues on a regular basis, only help them with functional questions : what software to use and how to use it.

      They use on a regular basis :

      • OpenOffice
      • GIMP
      • SANE based scanners
      • HP Deskjet printing
      • Firefox (Iceweasel)
      • Evolution and Sylpheed-Claws
      • Skype
      • Google Earth

      I am pretty sure that for most parts of a business, this would be enough.

      Now, I think that the usage of Exchange is more of a perception thing, than a real technical obstacle. At my work, Lotus Notes was swapped for Exchange, but I do not consider this a progress, as it reminds me too much of PCTools 4.0 or 5.0 (about 1990) : I really do not see anything innovative in this area (and while some people here seem to loathe Lotus Notes (mostly without any reasons given), it was much faster than Exchange, I find speed very important for computer programs).

      Anyone here which as implemented or is using alternatives to Exchange ?

    10. Re:why "big win" for microsoft ? by Instine · · Score: 5, Interesting

      Precisely. And while I use Gmail most of the time, and the rest of my office use an Exchange server hosted in same said office, guess who has the better uptime...?

      That would be me. They frequently (3-4 time a month) loose half a day, as the under resourced, high maintanence, auto-destructing, sorry updated, blackhat honey pot splutters in the corner. I've lost two half days in the however many years I've used Gmail.

      --
      Because you can - or because you should?
    11. Re:why "big win" for microsoft ? by Anonymous Coward · · Score: 0, Insightful

      You need a new exchange admin. Perhaps you should look into one of the ASPs that offers exchagne hosting with SLA guarantees such as intermedia, mailstreet, usi, etc, folks who host exhcnage with 5 9's of uptime. If they manage it, and they DO indeed manage it, in spite of the crap slashdotters like to spread, then it is possible, and its a matter of someone who is not qualified acting as the admin.

    12. Re:why "big win" for microsoft ? by lukas84 · · Score: 1

      No matter how good the admin is, running it on an old gaming machine provided by the CEOs Son won't give you five nines. You can be happy to get 80%.

    13. Re:why "big win" for microsoft ? by JayAEU · · Score: 1

      I really have no idea how the parent got modded (Score:4, Funny), it should rather be (Score:5, Insightful)!

      I couldn't agree more with the point he's making. Most of the CIOs I know would rather go blind-foldedly with a Microsoft solution than making an informed choice about which system would suit them best.

    14. Re:why "big win" for microsoft ? by blincoln · · Score: 3, Informative

      No matter how good the admin is, running it on an old gaming machine provided by the CEOs Son won't give you five nines. You can be happy to get 80%.

      How is that the fault of Exchange?

      I've backed up our main Exchange engineer for over five years now in an enterprise environment, and out of our 10+ servers I've seen 2 outages. One was due to the system board on the server failing, so that leaves one where Exchange was at fault (one of the databases became corrupt and had to be restored from a backup).

      I attribute this to three main factors:

      - We run it on enterprise-class hardware.
      - Despite rumours to the contrary, most of Microsoft's enterprise-level software is pretty solid, unless it's a 1.0 or 2.0 release.
      - Our Exchange implementation was engineered by someone who knew what he was doing, and is now supported by someone who knows what he's doing.

      Anyway, this article just makes me more convinced that we've done the right thing by sticking with our own system instead of using a hosted product.

      --
      "...always new atoms but always doing the same dance, remembering what the dance was yesterday." -Richard Feynman
    15. Re:why "big win" for microsoft ? by smallfries · · Score: 1

      It's been quite a few years (err, back in 2001 if memory serves) since I've used microsoft products. Back then *only* two or three hours of downtime per quarter would have been a dream. How are they for reliability these days? I hear the OS side stays up a lot better than win2000 used to. What about the Office suite? Does it still crash every couple of hours and hose work?

      --
      Slashdot: where don knuth is an idiot because he cant grasp the awesome power of php
    16. Re:why "big win" for microsoft ? by Anonymous Coward · · Score: 0

      Yes, and if no one here has ever used Ulteo, then you haven't computed in the cloud yet (just kidding). They also host the Openoffice cloud editors, just like Google docs!

      http://www.ulteo.com/home/en/products?autolang=en

      They even allow you to run your own desktop in the cloud, and perform all normal computing tasks from that cloud hosted desktop.

      I have played with their cloud based desktop for over a year, its a little slow but fun and works well.

      Woops, my Comcast connection went down for a couple of hours if anyone cares. Not like I can even get to the cloud whenever Comcast goes down.

      So, what's the big problem with Google's apps experiencing outages. I would think that in the beginning, it's not going to work at peak performance. Give it some time to evolve. Of course, outages do not discriminate.

      As of now, if our Exchange servers go down at work, then we go to a browser and fire-up our Iron Mountain hosted mail servers and push to personal email addresses, no matter what domain they live on - Microsoft, Google, AOL...any! Yes, we do pay for this but its worth the up-time.

    17. Re:why "big win" for microsoft ? by lukas84 · · Score: 1

      How is that the fault of Exchange?

      It isn't.

    18. Re:why "big win" for microsoft ? by fuzzyfuzzyfungus · · Score: 3, Insightful

      I think, in this case, that it is less a matter of absolute downtime, and more a matter of people's feelings of control over that downtime. Look at cars vs. planes. Flying is safer, but people feel safer driving because they feel like they are in control of the situation.

      My suspicion would be that google hits higher reliability numbers than many in-shop setups, particularly small ones; but the feeling of sitting there, twiddling your thumbs, and waiting for the remote service over which you have no control to come back up is a terrible one. It is much nicer to have to fix a local problem, which requires more effort; but makes you master of your fate(to the degree that anybody ever is).

      The smaller, but ultimately more intractable, issue for remote hosted stuff is that it necessarily suffers more potential points of failure than does local stuff. If google screws up, google goes down. If somebody between my desktop and google screws up, google is down to me. If WAN goes down, but LAN stays up, local apps are still substantially useful(since a vast amount of email and document shuffling is company internal); but remote stuff is useless.

    19. Re:why "big win" for microsoft ? by __aaqvdr516 · · Score: 1

      I admin 2 Windows Server 2003 networks. I've only been the admin for about 8 months so far, but I've only ever restarted for problems from non-MS software and for updates. Before I took over, the admin was just a supervisor who had no formal IT training what-so-ever. He managed to keep things running smoothly for the previous year with no snags as well.

    20. Re:why "big win" for microsoft ? by rabbit994 · · Score: 2, Funny

      OS stays up heck alot of better and Office 2007 is pretty stable. I haven't heard of it crashing at complete random hosing up work. When it does crashes for no reason, it's generally the computer is hosed up with Spyware and Viruses pretty bad. Exchange 2007 is stable and unless you use it in some wierd way that Microsoft doesn't recommend, it stays up most of the time.

    21. Re:why "big win" for microsoft ? by Anonymous Coward · · Score: 0

      ... and you can be sure that Microsoft will try to pressure you into upgrades, willing or not.

      In the long-run upgrades are good because it forces you to keep tabs on the system and re-examine it every so often. I've had to baby sit too many systems where the original designers (and the group after them) have come and gone, and no one quite knows how things work and doesn't want to touch it.

      Don't touch it because it works is a valid argument for not upgrade; don't touch because we don't know what it does is not.

      Of course, it should be you choosing and planning the upgrade, not an external entity, but at least it prevents stagnation.

    22. Re:why "big win" for microsoft ? by Dynedain · · Score: 2

      I am pretty sure that for most parts of a business, this would be enough.

      I keep hearing this argument over and over, and it doesn't hold water. Every industry has its own set of "industry standard" applications (aka "vertical stack") which are never easily replaceable and are always a core requirement to how the companies in that industry do their work.

      Examples:

      • Architecture: Core work is done on CAD of which the only reasonable solutions are AutoCAD, Revit (both from Autodesk and Windows only) and ArchiCAD (Win/OSX). The CAD solutions available for Linux are a joke.
      • Movie Special Effects: This industry can run on Linux, but only because all the big companies use their own in-house software that was originally written for UNIX stacks. The back-end accounting and business management departments all use tools written for Windows
      • Law Firms: Good luck getting versions of their research and case management tools for anything other than Windows
      • Accounting: Again, the enterprise-level financial reporting, organizing, and filing tools are all Windows-centric.

      It isn't just about MS Office. While an office suite is an important part of any business (even my OSX office of 75 people uses MS Office), there is always something that ties the industry to a specific platform. It is usually a very niche product, and only available from 1 or 2 vendors. And because it's so ingrained to their workflow, it won't be replaced unless their primary vendor goes under.

      --
      I'm out of my mind right now, but feel free to leave a message.....
    23. Re:why "big win" for microsoft ? by man_of_mr_e · · Score: 1

      There's something to be said for being responsible for your own problems. When you outsource, you expect 100% reliability. When it fails, you are helpless. There is nothing you can do. When phone calls come streaming in, all you can say is "I don't know" when people ask when it will be up again. That makes you look bad.

      If you are handling it yourself, you know what's going on. You are responsible if it fails. You're not twiddling your thumbs waiting for someone else to fix the problem. You can give estimates and tell your bosses about progress.

    24. Re:why "big win" for microsoft ? by LinuxDon · · Score: 1

      We run Novell Groupwise 7 on Suse Linux Enterprise Server. In addition to getting excellent uptime and compliments from users (yes, really!) it also saved us quite some money compared to MS Exchange. Although the real reason I chose to use it is reliability.

      Also, Groupwise Mobility Server/Intellisync is included with the product for free. Enabling you to synchronize your Windows Mobile, Palm, Symbian etc. devices with Groupwise over the air (GPRS/UMTS). Thus being an excellent alternative to Blackberry.

    25. Re:why "big win" for microsoft ? by encoderer · · Score: 2, Insightful

      The fact that you've got a horrible sys admin for your exchange server says a lot more about your company than it does about Microsoft and Exchange.

      Fact is a lot of companies are running exchange w/ very little downtime at all.

    26. Re:why "big win" for microsoft ? by Anonymous Coward · · Score: 0

      You should know that "Erris" and "twitter" who replied to you below are both the same person. And also, you'll probably be added to the list now as well because you dared claim that something Microsoft did is not evil and hopelessly broken.

    27. Re:why "big win" for microsoft ? by bn-7bc · · Score: 0

      Well correct me if I'm wrong, but when I checked earlier today Google apps (including mail hosting) was still in BETA (as in Don't use in a production environment). It must be said that I'm using the free version as this is for a private domain so I don't feel the need to pay as the free version gives me what I need.

    28. Re:why "big win" for microsoft ? by Billly+Gates · · Score: 1

      Your I.T. support staff needs to be fired.

      WHat you are described is hundreds of thousands of lost dollars in productivity.

      Either your business is cheap and penny wise and dollar dumb by not having redundancy or they are incompetent or both.

      Good thing they do not work for me.

    29. Re:why "big win" for microsoft ? by Billly+Gates · · Score: 1

      If they were clustered and used a switch there would be no outage. I assumed you had that installed as well so they could be serviced without the other workers noticing anything wrong.

      I am sympathetic to the former poster where the bean counters put in trashy low end servers with no backup to save money only to have the systems go down. However its the job of the I.T. managers to demand and convince them they need the proper equipment. If not then they need to use an ASAP so your ass is covered in an outage.

      Maybe I am old fashioned and cynical but any downtime is unacceptable as workers are useless without a working computer system.

    30. Re:why "big win" for microsoft ? by dave562 · · Score: 1
      I was going to moderate but I have to post. Just because your IT staff can't keep their Exchange server working doesn't mean that Exchange is worthless. I used to consult for the SMB market and we had dozens of Exchange boxes hosting thousands of users. Downtime wasn't an issue. Backups weren't an issue. Security wasn't an issue. Email archival for the clients that required it (SEC regulated broker/dealers for example) wasn't an issue. Exchange works if you have admins who know what they are doing and a company that will devote the resources to properly specced hardware. (Free hint. You can get a decently specced HP Proliant ML370 that will easily host a couple hundred Exchange mailboxes for well under $10,000)

      If you used Google's financial resources to build your Exchange infrastructure, you wouldn't be having the problems you were having with your particular Exchange infrastructure.

    31. Re:why "big win" for microsoft ? by jsight · · Score: 1

      How is that the fault of Exchange?

      It isn't. The point is that adding more 9s to your uptime tends to be very expensive, and most companies are completely unwilling to shell out the money for adequate hardware and administrative resources to achieve 99.999% uptime for their mail server. For those people, the few outages at Google are far lower than the outages that they would have running it on their own.

      Nevertheless, for various reasons, I suspect that ultimately the market will demand 99.999% reliability out of Google for paid hosting services. I also expect they will be able to deliver it.

    32. Re:why "big win" for microsoft ? by Stephen+Ma · · Score: 0
      Our Exchange implementation was engineered by someone who knew what he was doing, and is now supported by someone who knows what he's doing.

      In other words, Exchange is not for the "rest of us". We may as well use Linux then. A Linux solution would be even more reliable -- and once set up, wouldn't need constant, expensive babysitting.

      On the other hand, if you are being paid handsomely to do the babysitting, I can understand why you love Exchange.

    33. Re:why "big win" for microsoft ? by neonsignal · · Score: 3, Insightful

      Interesting that people are more uncomfortable with a 3 hour downtime on gmail than they are with a 3 hour downtime on their local mail server. My guess is that it is the feeling of being out of control. If it is a local problem, there is someone to curse; if it is remote, then you don't even know when it is going to be fixed. This is a good example of how we are psychologically more adverse to unknown failures than we are to known ones.

    34. Re:why "big win" for microsoft ? by SuperQ · · Score: 1

      A couple of hundred? For an "under $10,000" I could build a fail-over pair of Linux servers that could host tens of thousands of accounts. I could probably host a couple hundred accounts on my Soekris router.

    35. Re:why "big win" for microsoft ? by foxylad · · Score: 1

      It's probably final proof that I'm not a born sysadmin, but I would far rather sit twiddling my thumbs (actually I'd probably go for a walk) waiting for Google's world-class admins to fix a system problem than be responsible for fixing it myself.

      --
      Do as you would be done to.
    36. Re:why "big win" for microsoft ? by Cramer · · Score: 2

      That's exactly it. When gmail fails, you don't know if it's going to be 3min, 3hrs, or 3days. Or if it will ever be fixed. You are left with no information and no control. When (if) it does come back, you don't know what state it's going to be in... how much of your data is now screwed up and completely gone? What choice(s) do you have in the matter? (none.) With a local server, everything is right there in front of you. You have people you can talk to. You have people to make it right again. You have control, and you are part of the information loop.

    37. Re:why "big win" for microsoft ? by dave562 · · Score: 1

      With full calendar, tasks, mobile/PDA support and everything else that Exchange does? Or are you talking about simple POP3/IMAP? Whether or not you can do whatever you can do with Linux has nothing to do with the competence or lack there of on behalf of the OP's IT staff.

    38. Re:why "big win" for microsoft ? by Tubal-Cain · · Score: 1

      You definitely do not have the adming gene.

    39. Re:why "big win" for microsoft ? by SuperQ · · Score: 1

      No, it says nothing about IT staff, it says everything about Exchange's scalability.

    40. Re:why "big win" for microsoft ? by ozphx · · Score: 1

      Its a web 2.0 beta, which means stable. You probably mean an alpha ;)

      Or a gamma. I forget. God knows what we do for web 3.0, we'll be out of greek letters and totally screwed :P

      --
      3laws: No freebies, no backsies, GTFO.
    41. Re:why "big win" for microsoft ? by Anonymous Coward · · Score: 0

      yeah, we know. My friend is blind and he knows. We really don't need the twitter sockpuppet alerts anymore. The posts speak for themselves.

    42. Re:why "big win" for microsoft ? by Firehed · · Score: 1

      How big is your organization? Is $50 * that number less than your salary? About about $50/yr/head as compared to $outlook/3yrs/head+you?

      While I'm certainly not doubting your abilities, one of the two outages you experienced could have been prevented by using a hosted solution from someone with hardware infrastructure like Google's. Is it worth the other risks (privacy, availability, data confidentiality and portability, etc)? It depends on the situation, but I'd suggest probably not for most large companies.

      On the flip side... there's that whole Outlook thing. For whatever reason, even the MS-hating Slashdot folk tend to moisten slightly at the thought of a good Exchange server, but I've never had anything but bad experiences with it (both through Outlook and OWA). Maybe it was the fault of the server's configuration, but in my experience it's remarkably slow, has terrible spam filtering, and I could hardly draw up a clumsier interface (though that, of course, is personal opinion). Gmail, OTOH, is always quite zippy for me, has secretary-quality spam filtering, has not only a useful search but a good one, doesn't cause god-awful conflicts with catalogs for the indexing service, etc. For me, it just works so much better - I can get more done in less time and with fewer outbursts of carnal rage *ahem* err, less frustration.

      As good as you may be at keeping your Exchange setup happy, I'd bet there are at least a dozen other people in similar position that aren't as qualified to do so. While you've been able to deliver five nines of uptime, most setups aren't going to experience that level of bliss. For personal and small biz use, Gmail has been fantastic. Including the brief service interruption last week (that lasted what... half an hour? I certainly didn't notice any more if it went longer), there have been maybe two hours where I've been unable to get to my gmail account since... 2003? Four and a half nines sure as hell isn't bad for something that's cost me exactly $0, especially considering that most of my experience with Exchange has shown it's lucky to hit three.

      Does it have its limitations? Sure. There's still no push service, and I always find the calendar invites to be a little funky (and, of course, you can't just tab between calendar and email like you can in Outlook unless you actually have two browser tabs open; this happens to work better for me but that's again personal preference). You've entrusted your data to Google and more significantly to a third party, but then again there are about a dozen companies on the planet with their level of hardware infrastructure (so that whole enterprise hardware thing is a non-issue) and any possible software corruption at their end could just as easily happen on a local system - unless you WROTE Exchange, you can't really trust it more or less than any other system.

      By all means, if what you have works then use it. I personally have only had negative experiences with Exchange-based systems; quite honestly, something like that could be a deciding factor for me between two reasonably matched hypothetical employers.

      --
      How are sites slashdotted when nobody reads TFAs?
    43. Re:why "big win" for microsoft ? by Techman83 · · Score: 1

      I miss our groupwise server, it was so much nicer than exchange. The important lesson there is that the business has to drive decisions, it has to want it. Reliability and speed is not enough to convince rouge Senior managers from whinging when option A is in a different spot compared to Outlook and that isn't good enough..... I could go on all day :(

      --
      # cat /dev/mem | strings | grep -i cat
      Damn, my RAM is full of cats. MEOW!!
    44. Re:why "big win" for microsoft ? by Anonymous Coward · · Score: 0

      eeek, for such a pricetag I can get webhosting + email + huge storage + fez extras, with good availability... gotta really love Gmail interface...

    45. Re:why "big win" for microsoft ? by Anonymous Coward · · Score: 0

      Try www.zimbra.com, it is free but they have also a supported version and it is developed by yahoo. Who said yahoo was dead?

    46. Re:why "big win" for microsoft ? by dbcad7 · · Score: 2, Informative

      You want a horror story... Excite, which had (at least in my opinion) pretty reliable web mail.. decided to "upgrade" their email interface, and have it hosted by a company called Bluetie.. You would figure in such a change that you might at the most be down for a day, maybe two... 33 days is what it took before I finally got any email coming into my inbox.. Now for me this was just a side account, but I had some things tied to it that I liked to keep tabs on.. but there were many people who had excites email tied into their businesses, and personal things like banking and job searches.. many many unhappy people dumped excite for good over this fiasco.. Worst planned and poorly executed upgrade I have ever seen.

      --
      waiting for ad.doubleclick.net
    47. Re:why "big win" for microsoft ? by Thundersnatch · · Score: 1

      There are a large number of financials packages that will run on Linux servers (Oracle for example). But they typically require at least one Windows server for reporting services (Crystal/Business Objects/whatever), and the clients are often WIndows-only as well. And many of the BI tools plug in to Excel - and only Excel.

      The major problem is that open source programmers code for "fun" mostly, but coding back-office applications like financials and ERP is not fun and generally not interesting. So there will never be a viable open-source competitor to SAP or the Oracle application stack unless a major vendor goes under and open-sources their stuff before closing the doors.

      This is a shame really, because these back-office apps are the very applications that almost every business must customize to some degree to make it fit. Open source would be great for this market segment. An open source desktop office suite is nice, but the "free as in beer" part is the only thing that makes it nice. The fact that the code is open has no real benefit to 99.99% of the users.

      The same can be said of most "business infrastructure" software besides financials: HR systems, payroll, compliance packages, BI suites, marketing, medical systems, insurance systems... these will likely always be closed source, commercial offerings.

    48. Re:why "big win" for microsoft ? by dk.r*nger · · Score: 1

      - Our Exchange implementation was engineered by someone who knew what he was doing, and is now supported by someone who knows what he's doing.

      That's exactly the point. If you don't have those people, and most SMEs don't, you're very likely to be wasting money and exposing yourself to an unnecessary risk if you insist on doing your own e-mail.

    49. Re:why "big win" for microsoft ? by dave562 · · Score: 1
      Without the facts of the case neither of us can really comment any further. Given that the guy is "doing his work" with Gmail while the rest of the staff is using hosted Exchange it's pretty fair to bet that the guy isn't in a company of any reasonable size. If that is the case, it shouldn't be very hard to setup a stable Exchange environment.

      I'm impressed with the way you dodged the question about whether or not your Linux boxes would do calendaring, mobile/PDA integration, webmail and everything else that Exchange does.

      The Proliant that I quoted for "$10,000" would also include an LTO backup drive, RAID array, redundant power supplies, and 24x7x4 onsite support for 5 years. Things like that a pretty standard when you want to do it right. The Proliant will also run Linux with full driver support from the manufacturer. When I tossed the $10,000 number out there I wasn't trying to start a debate about costs of brand name, enterprise class hardware versus some white box you can build in your basement. In the grand scheme of running a business, $10,000 for a stable messaging/collaboration platform is nothing compared to the cost of the downtime when your employees can't communicate with each other and the outside world.

    50. Re:why "big win" for microsoft ? by rtb61 · · Score: 1

      What is interesting is how the thread was shifted to email rather than the complete range of office applications. Email is just one small area of office applications and sure when you ISP is down and you can't even get the hosted apps, it makes no difference as email is impossible but of course all you other local applications could still function.

      For a start there is the whole accounting and bookkeeping range of software, and of those are considerably safer when locally hosted. So if you are already running sufficient hardware for those other applications why bother.

      Also in calculating down time for hosted apps you have to add in all the possible faults, including loss of connection (the full route, from you to a host possibly thousands of kilometres away) and, power outages (laptops can still function) etc. rather than just the host servers going down.

      Cheap hardware free software, it really does seem like they are fooling themselves trying to solve problems from the previous millennium that really no longer exist (very expensive hardware and software and server administration costs).

      --
      Chaos - everything, everywhere, everywhen
    51. Re:why "big win" for microsoft ? by SenseiLeNoir · · Score: 1

      Although gmail does not have a exchange like push service for all information, it does have push imap support (for mail) and SMS support.

      --
      Have a nice day!
    52. Re:why "big win" for microsoft ? by Anonymous Coward · · Score: 0

      Anyone here which as implemented or is using alternatives to Exchange ?

      Java Messaging by Sun Systems. Its a great replacement.

  2. Incredible Expectations by bigtallmofo · · Score: 5, Insightful

    When my boss tells me he wants 0 downtime (or even five-9 downtime), I show him a quote for the 7-figure cost of creating such a system.

    Apparently Google is expected to hit that level of uptime all while charging either nothing for their standard edition or $50 per user per year for the premier.

    I wonder how much downtime the companies that are using Google Apps would experience if they had to pay for their own redundancy?

    --
    I'm a big tall mofo.
    1. Re:Incredible Expectations by lukas84 · · Score: 2, Insightful

      Depending on the size of your company, you can have 0 unexpected downtime with a single server, if you are lucky.

      Statistics don't matter for the individual case.

      We have many customers with SBS Server or smaller Windows environments with just redundant Domain Controllers, and out of our entire customer base, we only have one or two unexpected downtimes per year.

      Of course this doesn't invalidate your point it all - it just may explain where the execs delusional ideas come from.

    2. Re:Incredible Expectations by jimicus · · Score: 2, Insightful

      Depending on the size of your company, you can have 0 unexpected downtime with a single server, if you are lucky.

      The key phrase here is "if you are lucky".

      The whole point about building a system which is designed to have zero downtime is that it doesn't depend upon luck in order to achieve that level of uptime.

    3. Re:Incredible Expectations by darth+dickinson · · Score: 1

      Depending on the size of your company, you can have 0 unexpected downtime with a single server, if you are lucky.

      Exactly. I admin a GroupWise mail system for a private school here in Birmingham, AL, and the *only* time the email system is down is when ArcServe hoses itself and we have to reboot the server to clear the session. And, to be honest, if I put more effort into finding the cause of the backup program hosing, they wouldn't have that downtime.

    4. Re:Incredible Expectations by Anonymous Coward · · Score: 0

      You're missing the point.

      Google's marketing the cloud as a way to address redundancy problems. But if Google can't even keep one of its own, primary, market offerings online 100% of the time, why should anyone with less networking experience trust the cloud?

      In business, lost time = lost money. Which is why most businesses have *backup* systems that easily interface with the primary systems. Google didn't have backup systems for this.

    5. Re:Incredible Expectations by gad_zuki! · · Score: 1

      Are they really making a profit at 50 dollars per user per year? It seems that this is all subsidized by their search and text ads, which is an unrelated business and may have some anti-trust issues in the future. Id like to see them compete on the real economics of running this kind of thing. Id be worried about a scenario like suddenly raising the price once theyve done damage to microsoft.

    6. Re:Incredible Expectations by myowntrueself · · Score: 1

      When my boss tells me he wants 0 downtime (or even five-9 downtime), I show him a quote for the 7-figure cost of creating such a system.

      I think you mean 'uptime'. Five 9's of downtime would be pretty sad.

      Apparently Google is expected to hit that level of uptime all while charging either nothing for their standard edition or $50 per user per year for the premier.

      If google claim to offer five-9's of uptime on this then they would be lieing.

      It is not possible to offer more than about three (3) nines of uptime on, get this:

      Any service delivered over the INTERNET.

      If you are on a LAN or on a specially provisioned network link then, yes, you can get into five 9's.

      But if the service you provide has to traverse the public internet, just apply some common sense and realism.

      --
      In the free world the media isn't government run; the government is media run.
    7. Re:Incredible Expectations by CBravo · · Score: 2, Insightful

      That depends on the number of users / server. Suppose a server costs 2000 dollar/year to run. You would need 2000/50 = 40 concurrent users/year (excluding managing the systems).

      Well, 40 is not a lot. A decent application can service 1000 users/system. Maybe a user is online for 8 hours a day. This means you can service 3000 users per server. Maybe you need a db server and a failover ratio of 2. That still serves you 750 users/server on average.

      Suppose you have a 90% ratio of demo to payed subscriptions. That still earns you 35*50 dollar per server (=1750). Decent margin. The real question becomes: can you manage your servers efficiently?

      --
      nosig today
    8. Re:Incredible Expectations by SuperQ · · Score: 1

      The pay-for Google Apps ($50/mo) has a 99.9% monthly SLA.

      http://www.google.com/a/help/intl/en/admins/sla.html

      The outage was 3 hours, so that's 99.6% uptime for the month. Looks like anyone paying for service can get the first level of service credit. Personally I don't think this is a great credit.. 3 hours of downtime in one shot should IMHO give you atleast a month added to your service.

  3. Google will release app servers by QuietLagoon · · Score: 4, Interesting

    It is not a big win for Microsoft, it is a big win for corps hosting their own app servers. I would think that eventually Google will release google apps on a server that corps could install in their own data centers.

    1. Re:Google will release app servers by Anonymous Coward · · Score: 0

      If they do that, they'll have to open source a lot of stuff since they'll be distributing it...

    2. Re:Google will release app servers by Anonymous Coward · · Score: 0

      It's a big win if the doze servers are under the guillotine for replacement by "cloud" services. The cloud is currently about on par with shared hosing for $7/month and toy projects, despite it's great potential. MS doesn't have anything to worry about for a very long time.

    3. Re:Google will release app servers by Anonymous Coward · · Score: 0

      No, they won't. I thought so, and I asked the enterprise app team if they would, and they said "never". Their entire strategy is based on a multi-tenant model and they will keep pushing that no matter what sort of setbacks or objections.

    4. Re:Google will release app servers by DeeFresh · · Score: 1

      >they'll have to open source a lot of stuff since they'll be distributing it

      Not necessarily. Google sells licenses for their "corporate search" software, and that is not open sourced. When you pay for for the license - which, as of four years ago, was going for about $40,000 for a two year license - you also get a google server with the software already installed on it. We used it a few years ago to set up a customized search for our website, and we never had any performance issues with it. I question whether the return on investment was worth it, however.

  4. Hosted apps are always a bad idea by lukas84 · · Score: 1

    The issue is simple:

    How do you make money with hosting applications? Simple - the more customers you have, the more money you make. It scales with the size of the customer base.

    That means you, as a single customer, are insignificant. And that shows daily when dealing with any large service provider.

    On the other hand, with internal infrastructure, you either have a infrastructure service provider (most likely a local company, not to small and not to big), which cares about each of its customers.

    Or, if you're a bit bigger, you have your own employees. These depend on doing their job because they need to eat - or pay that new LCD TV they bought ;)

    Of course, hosted apps are cheaper as long as everything works. Which it won't, sooner or later.

    1. Re:Hosted apps are always a bad idea by lottameez · · Score: 1

      With any "service" there comes a point where it no longer makes economic sense to produce it yourself. Would you suggest we should all make our own electricity too so that we can feel "significant"?

      --
      Yeah? Well I think you're overrated too.
  5. No planned downtime? by bigtallmofo · · Score: 4, Insightful

    we only have one or two unexpected downtimes per year

    What about your planned downtime? If you're running Windows, you're rebooting to install patches on a regular basis or you're running unpatched systems. What about software installs?

    In the context of the article, do you think the users of Google Apps (or any users) would be happy with, "Oh, no you don't understand. This is PLANNED downtime. This doesn't affect you or our downtime numbers."

    you can have 0 unexpected downtime with a single server, if you are lucky.

    You can win the lottery too, if you are lucky. How many people win the lottery though?

    --
    I'm a big tall mofo.
    1. Re:No planned downtime? by lukas84 · · Score: 1, Interesting

      What about your planned downtime? If you're running Windows, you're rebooting to install patches on a regular basis or you're running unpatched systems. What about software installs?

      A non-issue for these customers, as they do not run 24/7 businesses. Larger stuff can be done over the weekends, smaller stuff after everyone left.

      For a 24/7 enterprise with distributed locations etc. things might be different.

      But then again: This is "just" e-mail. While becoming more and more critical even in the smallest of businesses, there are worse things that could crash. For instance, your production control application that controls machines (if you are a producing company), or your ERP software if you're mainly selling oriented.

      There also might be some companies that depend on E-Mail as their main business application, but these should then invest into providing highly reliable internal E-Mail. That costs more than 50$ / year / account, though.

      You can win the lottery too, if you are lucky. How many people win the lottery though?

      The chance of having a single server run through a year is much, much higher than winning the lottery.

    2. Re:No planned downtime? by Stormwatch · · Score: 1

      The chance of having a single server run through a year is much, much higher than winning the lottery.

      That depends. What OS is it running?

    3. Re:No planned downtime? by CaymanIslandCarpedie · · Score: 1

      Two completely different things (planned vs unplanned downtime). Planned downtime in your own corporate data center is an annoyance sure, but since it is planned it can be sure to be done at times not effecting or with minimal effect to the company. Very different animal from unplanned downtime. Planned downtime on large hosted services may be comparable to unplanned downtime as Google, Yahoo, etc have never asked my company when would be a convenient time for planned downtime. However, in an internal environment it isn't really comparable IMO.

      --
      "reality has a well-known liberal bias" - Steven Colbert
    4. Re:No planned downtime? by Computershack · · Score: 1

      What about your planned downtime? If you're running Windows, you're rebooting to install patches on a regular basis or you're running unpatched systems. What about software installs?

      What about it? With those you know WHEN it's going to happen. You can schedule it for out of hours. With the Google debacle and similar, you get no warning. If they do need to suspend the service for maintenance, it is they who say when, not you, and in a global internet you can't possibly do it for "out of hours" for everyone.

      --
      I only please one person per day. Today is not your day. Tomorrow isn't looking good either. - Scott Adams
    5. Re:No planned downtime? by wlandman · · Score: 1

      I currently work for a company that uses Exchange to host their own email in the office. The solution is not the best solution we could possibly have had, but we already have it. The system works, it does not incur a monthly hosting cost. Yes it has its downfall (we have to manage our own spam and virus filtering), but it works for us. Windows Updates will usually get installed in the middle of the night when nobody is checking the email. Also, what is the big deal with having to reboot to install patches? I'd imagine most customers don't require zero downtime, and those who do would not trust the application to a single server....

    6. Re:No planned downtime? by Maxo-Texas · · Score: 1

      Yes.. but how many people PLAY the lottery hoping to get something for nothing.

      --
      She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
    7. Re:No planned downtime? by Rearden82 · · Score: 1

      You can win the lottery too, if you are lucky. How many people win the lottery though?

      One of our servers running RHEL:

      16:48:46 up 499 days, 7:58, 1 user, load average: 0.02, 0.02, 0.00

      It has never once been rebooted since the day we set it up. Another server was up even longer, but it was powered down last month to add a couple more hard drives. Guess I should be buying some lottery tickets!

    8. Re:No planned downtime? by bill_mcgonigle · · Score: 1

      That depends. What OS is it running?

      One without current security updates.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    9. Re:No planned downtime? by lucifuge31337 · · Score: 1

      Good point.

      [daryl@SFWebApp01 ~]$ uptime
      23:55:05 up 371 days, 10:36, 6 users, load average: 0.10, 0.17, 0.17

      sfrouter02 uptime is 1 year, 17 weeks, 6 days, 9 hours, 48 minutes

      --
      Do not fold, spindle or mutilate.
    10. Re:No planned downtime? by caluml · · Score: 1

      That depends. What OS is it running?

      One without current security updates.

      One without any security updates that require reboots to become effective. See the difference? On Linux, it's almost exclusively kernel updates that require reboots. And even then, if you've built your own kernel from source, and the problem is in a module, you can usually just patch the code, and modprobe -rv module ; modprobe -v module.
      Course, if it's a module you don't use, you can just delete that module, and not load it.
      Also, there are kernel patches that make a large percentage of exploits fall over.

    11. Re:No planned downtime? by caluml · · Score: 1

      $ ssh *hostname* "uptime; uname -r"
      Password:
      10:25:44 up 1150 days, 22:45, 0 users, load average: 0.00, 0.00, 0.00
      2.6.11-hardened-r14

      Sure, it doesn't do anything. But doesn't the uptime look great.

    12. Re:No planned downtime? by Jozef+Nagy · · Score: 1

      The chance of having a single server run through a year is much, much higher than winning the lottery.

      You have a point. My own home Linux server could easily stay up all year if it weren't for the rare power outage that lasts longer than my UPS.

    13. Re:No planned downtime? by bill_mcgonigle · · Score: 1

      On Linux, it's almost exclusively kernel updates that require reboots.

      yeah, I was thinking of vmsplice. I think that needed a reboot.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    14. Re:No planned downtime? by Slashdot+Parent · · Score: 1

      How much did you pay the electric company over the last few years in order to make that post?

      --
      They don't grade fathers, but if your daughter's a stripper, you fucked up. --Chris Rock
  6. What are you comparing uptime with??? by Anonymous Coward · · Score: 0

    if your apps require 99.999 then you sure as heck shouldn't be using the cloud. Likewise, if you can provide similar capabilities in-house at $50 a seat.

    Neither of the above applies to vast majority of businesses out there. Get used to having to balance cost, risk and features if you want to manage IT...

  7. Google's Service Level Agreement by Animats · · Score: 5, Informative

    Google has a Service Level Agreement. If they have excessive downtime, you can get up to 15 days of free service. No refunds.

    Tell that to your boss. It's not your problem. That's what the company signed up for. Welcome to "cloud computing".

    1. Re:Google's Service Level Agreement by Lynchenstein · · Score: 3, Insightful

      The last few places I worked had periodic network outages, random print server crashes, workstation blue screens. This caused hours and hours of downtime for dozens of people over the course of a year.

      When Google Apps or Gmail goes down, exceedingly rare as it is, people threaten to "abandon the cloud". I wish we had threatened to abandon the lame infrastructure that our parent company refused to update or spend money properly maintaining. For my $0, Google does one hell of a better job than the three helpless infrastructure guys could do with almost zero budget.

      For places that either can't or won't put cash into a proper local infrastructure, relying on the cloud is a cost-effective option. Even with occasional downtime.

      P.S. I've just started playing with Gears, and it seems to bridge the gap nicely so far.

    2. Re:Google's Service Level Agreement by Anonymous Coward · · Score: 0

      The last few places I worked had periodic network outages, random print server crashes, workstation blue screens. This caused hours and hours of downtime for dozens of people over the course of a year.

      And with "the cloud", you'll have all of the above PLUS the threat that your hosted apps (and possibly any data they are storing) can vanish into the ether. You will still need a physical infrastructure. You may be able to simplify it to some degree (e.g., use thin clients instead of desktop computers), but you will still be vulnerable to (local) network outages, print-server crashes, and workstation blue-screens (or the thin-client equivalent).

      Hosted Apps help with application and data management, and may possibly be financially advantageous, but don't think for the moment they are a replacement for a proper infrastructure; they are dependent on that infrastructure. If the foundation is already unsteady hosted applications are going to make things worse, not better. They are adding another point of failure to a structure that is already about to come tumbling down.

    3. Re:Google's Service Level Agreement by notaprguy · · Score: 1

      Google only has SLA's on GMAIL, not the rest of the Google Apps "bundle." Also, they only provide https support for GMAIL, not Docs and spreadsheets etc.

    4. Re:Google's Service Level Agreement by antirelic · · Score: 1

      As an IT professional this cuts like a double edged sword. On the one side, you can always tell that CIO or whatever that "this is what you bought" when they went over the IT departments head and made "everything" a "web app". On the other hand, it sucks because as an IT professional, you want your shit to just work.

      Lets face it, like EVERYTHING ELSE, web apps has its place. Maps, dictionaries (wiki's), and collaborative tools belong on the web. Word processing, spread sheets, presentation software... belong on the desktop and should remain separate from the network infrastructure. The point is easy to make: Applications that are constantly updated and provide collaboration are useless without the network, hence they can stay "web apps"... if there is no web, the web apps are useless. Other tools are "neutral" to the presence of the web, and should remain as such.

      Perhaps I'm old school, but some things make alot of sense, others dont. Making everything web apps just doesnt make any sense.

      --
      20th century Marxism is not progress...
    5. Re:Google's Service Level Agreement by Anonymous Coward · · Score: 0

      It costs less. The more you can save, the more decision makers can stand to risk downtime.

    6. Re:Google's Service Level Agreement by Lynchenstein · · Score: 1

      Yup, I agree. My point was that a few outages with no loss of data that I'm aware of (looking at YOU Mobile Me & RIM) shouldn't be sufficient grounds to abandon Google Apps. I trust that Google has adequate propeller-head power to keep things running smoother than virtually everything else out there, and so far I've been very satisfied. Plus, when the DHS steals my laptop en route to the US, I can still access most of my data and files after coughing up a few hundred at Best Buy for a cheap POS to get me through with little lost billable time.

    7. Re:Google's Service Level Agreement by OneFix · · Score: 1

      So, what about all of the schools that migrated to Google Apps and don't pay anything? What do they get?

  8. Networks crash just like software by frisket · · Score: 1
    Why is this surprising?

    Are the proponents of cloud apps so stupid they don't realise that a network can go down just as easily as a local app? I wouldn't mind betting that Google's outage rate is considerably less than the amount of time the average Word user has to go without Word for some reason.

    What you have to take into account is the failure rate of all network segments between you and Google (or wherever). With the best will in the world you're not going to get 100%, ever. It's just a matter of comparing the figures and making the call.

    1. Re:Networks crash just like software by NeverVotedBush · · Score: 3, Insightful

      Another issue is web/network attacks. They are going up big time and are even state-sponsored. Look at what Russia is, and has been doing to Georgia.

      I don't understand how anyone in this day and age can justify going with remotely-hosted applications. The ability to reach remote servers can be taken away even by morons and botnets who might not like your company.

      In my opinion, remote web hosting of applications that are presumably important for a company to be able to run is just asking for trouble. I wonder how many fingers will get pointed when some critical deadline looms and nobody can run their applications to be able to meet it.

      It's reckless and risky for business to expose themselves like that. As others have pointed out, OpenOffice is free and it is good. Why waste money on training people on both the Google (or other) remotely-hosted application and OpenOffice (if that is your emergency backup). Just train people on OpenOffice and now you don't need a backup plan in case the network goes down and you can't run the remote stuff.

      Remote applications may have been a solution before the Internet got nasty but these days, running business-critical stuff over it when you don't need to does not make sense to me.

      Maybe I'm missing the huge economic advantages that justify the unknown and growing risk, but I see network (Internet) applications as being at huge risk for outages, a security risk, a data privacy risk, etc.

    2. Re:Networks crash just like software by aaarrrgggh · · Score: 1

      Any monoculture has huge risks. If you want to improve reliability, you provide diverse, (at least partially) redundant systems and DR plans as to what you do if systems go down.

      A DR solution isn't "someone else's problem."

    3. Re:Networks crash just like software by bcrowell · · Score: 2, Interesting

      Another issue is web/network attacks. They are going up big time and are even state-sponsored. Look at what Russia is, and has been doing to Georgia. [...] I don't understand how anyone in this day and age can justify going with remotely-hosted applications. The ability to reach remote servers can be taken away even by morons and botnets who might not like your company.

      What you're saying makes sense for something like google apps, but it's exactly backwards for something like gmail. A small organization is much more vulnerable to a DOS attack than google is.

      Maybe I'm missing the huge economic advantages that justify the unknown and growing risk, but I see network (Internet) applications as being at huge risk for outages, a security risk, a data privacy risk, etc.

      This is more complicated than it might seem at first glance. Google, for example, has a published privacy policy. It may or may not be acceptable to a particular organization, but I'd expect Google to do a pretty good job of following it competently. On the other hand, many organizations that manage their own IT services do a really lousy job of managing security and privacy. For instance, Ameritrade had a problem for years where people would sign up for accounts, and immediately start getting pump and dump spam. Ameritrade tried to blame it on dictionary attacks, viruses, etc., but users thoroughly and publicly documented the fact that it was happening to single-purpose email accounts that were not vulnerable to dictionary attacks and were not on Windows boxes. Years later, Ameritrade finally admitted that there was a problem, and said it looked like it must have been an inside job -- some employee selling the addresses to spammers. You also get issues with employees bringing home laptops with sensitive data. Realistically, most of the security issues that IT departments deal with on a day to day basis are issues with users getting their machines infected with malware. I would expect that kind of thing to be less of a problem if your apps are remotely hosted. Your machine is probably less likely to get infected from clicking on a malware attachment, and if worst comes to worst, you can always do a clean install on the infected machine, meanwhile using a different machine to access the web app. No downtime, no lost data.

    4. Re:Networks crash just like software by Anonymous Coward · · Score: 0

      > Look at what Russia is, and has been doing to Georgia.

      You've been eating the propaganda unfortunatley.

      South Ossetians view themselves as Russian.

      When Georgia invaded South Ossetia, Russia responded by protecting its people.

      If you are referring to the "cyberattacks", those were amongst teenagers.

    5. Re:Networks crash just like software by NeverVotedBush · · Score: 2, Interesting

      Some good points but they can also be turned around. Something like GMail will definitely be more robust than trying to get the mail down to a local server. But web applications are subject to those same kinds of service interruptions. Even if Google has the bandwidth and distributed systems to be that robust, the choke point is the link in/out of the company and a DOS attack there can still close off access to the apps people need to run.

      And I think we're all starting to get a feeling for what other company's privacy policies are worth. While a local server at your company might be more likely to be penetrated depending on the skill of the admins and how well it is hardened compared to Google, other companies and the links between you and them are still subject to being compromised. You can also have issues with malicious insiders and I'm sure that Google is no different in that respect. Looking just at that, there could be a bigger risk at Google just based on the numbers of people that have access to your data. And your point with Ameritrade is just more proof of that risk.

      But malware will be a risk regardless of where the data is hosted. Even if you are working on some document remotely, you are still seeing it locally and if that system is exfiltrating data, you are still compromised.

      I am sure that Google has good security policies, good backups, good admins. But I stand by myself not wanting to risk the added exposure and possibility of being shut down by events outside of my control. I tend to think that with remote applications, I still have all of the local risk that I had before and add extra risk by using remote applications. About the only good I see is that a place like Google really should have excellent data backup practices that probably exceed what most companies call adequate.

    6. Re:Networks crash just like software by NeverVotedBush · · Score: 1

      Marcus Sachs at SANS has a post up where he says he doesn't think it is so much a war but others piling on and doing their own personal attacks to help out. He also admits that he might be being cynical about the actual scale of Russian state involvement.

      http://isc.sans.org/diary.html?storyid=4903

      But lots of other computer security places are reporting it as a real cyber attack by Russia against Georgia. It really doesn't matter all that much where the attack is coming from - the end result is the same. Georgian government websites are being DDoSed and the country's network is pretty well clogged.

      And the points about why this is happening are irrelevant. Anyone who has followed this understands the South Ossetians are trying to break away and Georgia was trying to prevent it and that's when Russia decided to attack Georgia. That's not news.

    7. Re:Networks crash just like software by NeverVotedBush · · Score: 1

      I agree that people should have disaster recovery plans. For me, I would think moving to Google web applications might be a good strategy to continue operations in the event of some disaster.

      Maybe it would even be worthwhile to encrypt and push backups up to Google, or Amazon, or anyone else offering storage solutions. That could make resuming operations much easier depending on local backup integrity, etc.

      Storing at Google would be kind of a setup to transitioning to Google Apps if the need came up.

      I agree that good DR is extremely important because things do happen. I don't say anything against disaster recovery. I just personally don't think the risk of relying on remotely-served applications is worth it. As an interim measure during some kind of disaster, sure. But for me, not as standard operating procedure.

    8. Re:Networks crash just like software by bcrowell · · Score: 1

      I am sure that Google has good security policies, good backups, good admins. But I stand by myself not wanting to risk the added exposure and possibility of being shut down by events outside of my control.

      I'm sure you're highly competent. But there is a general human psychological tendency to discount risks that they believe they have some control over, and overestimate their own level of control. That's what's going on with the SUV tailgating you at 80 mph in the carpool lane -- the SUV's driver is psychologically biased to believe that this huge, hurtling mass of metal is under the control of his hands and feet, and he can make it do whatever he wants it to do. When airbags and antilock brakes came in, they were supposed to reduce the number of deaths, but actually what happened was that people started driving faster, because the safety features made it feel safe. It's utterly predictable that every IT staff will believe itself to be more competent than the other guy, will want to keep everything in-house, will want to maintain control, and will overestimate the level of quality and uptime they can provide. Every time a manager outsources something like this, it's because the manager has come to the opposite conclusion.

    9. Re:Networks crash just like software by BIGELLOW · · Score: 1

      I don't think you are missing the huge economic advantages. Instead, I think you are missing the technological advancements that have been made. I use Google Apps and many other hosted services/apps.

      When my network goes down, or I am completely disconnected from the Internet, I am still able to use these hosted apps just fine. Applications such as Gears (previously known as Google Gears) make this possible. Every bit of functionality of the app... the hosted code... the data (including all of my hosted files) are stored locally in a local store and local database on all of my machines that I work from. When I lose connection on any given machine (or all of them,) I can continue to do my work. All of my changes are stored locally and then when my network access is restored, the changes are synched in "the cloud"... and these changes are further synced back to all of the other machines I work from.

      Using DropBox, I am also able to do this with files. I can drop a file in my DropBox at work... and later, when I am at home, I can access this same file, even if I am not connected to the Internet... without needing to use a USB memory stick or email files to myself.

      The picture you are painting is how things were a year or two ago. It's time to catch up to now.

    10. Re:Networks crash just like software by NeverVotedBush · · Score: 1

      I guess you are right - it is time to catch up. I wasn't aware of Gears and the ability to keep working even if the network connection was down.

      That does take care of a lot of the issues but I still don't think I will move to hosted applications - at least for the time being.

      There are still a number of good arguments against them voiced by others on this page.

    11. Re:Networks crash just like software by BIGELLOW · · Score: 2, Interesting

      I think a lot of the "good arguments" that have been voiced are just recycled arguments that could also be used to suggest that using computers in general is a bad idea. We should go back to pen and paper and horse drawn carriages. Simpler times back then.

      To be honest, the only valid argument I could make (that I haven't seen mentioned before) is that a hosted app has multiple points of failure in terms of network availability. If Google's servers go down, the service is unavailable. If any of the three or four Internet backbones between you and Google's servers has an issue, the service is down. If your own Internet access goes down, the service is down.

      So, there are more things to possibly go wrong in that respect. However, all of these same arguments could also be said if you were trying to reach your company email from home.

      The thing that keeps getting overlooked are the reasons WHY people are switching to Google Apps. They aren't switching because they just want to use some other system. They aren't switching because the price is so low (or free.) They aren't switching just because you can store a lot of data and search lightning fast. They are switching because there are collaboration and revision services. They aren't switching because it is accessible from all over the world with the same ease as accessing it from at work. They aren't switching because of the excellent spam filters. They're switching because of ALL of these.

      It's a cost/benefit thing. Telling a Ferrari owner that a Hyundai is much more reliable is missing the point that the person probably doesn't own the Ferrari only for its reliability.

      When Google Apps (as a service) is running well (which is the majority of the time,) it isn't just an alternative to software solutions. It is leaps and bounds beyond it. Gone are the days where people are emailing attachments to a group, trying to collaborate through a spreadsheet or specification in a Word Doc. Gone are the days where one must connect through a VPN first, then remote desktop to a machine, just to access certain files remotely. Gone are the days when admins have to stand over people's cubicle walls and say, "Do you know that you're using 10 gigs in your email? Can you please start clearing some stuff out, or we'll have to clear it for you."

      When things aren't running so smoothly, and Google Apps is inaccessible, then you end up with a pretty good (but not amazing) set of software (thanks to Gears.) Thankfully, this is very rare.

      But again, if you're ok with the software you're currently using and the price you are currently paying, there is absolutely no reason to switch. This shouldn't be a case about Hyundai owners trying to get Ferrari owners to switch to Hyundais and Ferrari owners trying to get Hyundai owners to switch to Ferraris. Everyone should use the software and services they are comfortable with.

      I just don't understand that instead of someone saying "it's just not for us at this time" they instead talk about the impending doom that is just around the corner. In reality, there is simply a technology shift taking place... but it's still happening. For a time, it's still ok for VHS owners to keep hanging onto their VHS collection while DVDs start flooding the market. For a time, it is still ok for those with black and white televisions to hang onto them a while longer even though color televisions have been out for a while. They're nothing wrong with diversity, taste, and opinion.

      The time has not come yet where those who are still using local software are out-of-touch. We're still a long way from that. But there is a certain personality type known as the innovators. The early adopters who are willing to take the risks needed to gain the bigger rewards. Sure there are some learning curves to deal with and the growing pains. But in the end, the innovators consider these as worthwhile costs to justify the end result. Eventually the time will come where the late adopters will be paying money to the early adopters to help them make the switch. To make their VCR stop flashing "12:00" so-to-speak.

    12. Re:Networks crash just like software by Anonymous Coward · · Score: 0

      > Anyone who has followed this understands ... Russia decided to attack Georgia. That's not news.

      Then you are watching the wrong news.

      Russia didn't attack Georgia. Russia responded to an attack against South Ossetia by the Georgians,

      Georgia attacked first.

    13. Re:Networks crash just like software by tuomoks · · Score: 1

      Monoculture is always bad, not just in reliability. I have seen even NonStop systems going haywire after one year up-time, Murphy playing with hardware. Fortunately, in one very big case the customer had anticipated that, we had built a full switchover capability, needed just a flip of a switch and the backup systems took over - no data loss. Yes, a little more costly but not much if done right.

      DR - tell that to a couple of my (late) bosses, it was always "someone else's problem". Even a VP, a know-it-all hacker from -80's, who's responsibility was just that because he was the "specialist", was always saying it and didn't plan for it. After the inevitable failure, loss of data, blamed first the vendor and then the developers. Vendor first because the warm backup takeover lost some data, developers because they didn't journal the data - he had forbidden it for "performance" reasons? Funny, because after I hacked (to the live system) the journaling, the throughput did go up about %30 - better parallelism!

      When you talk about reliability, security, capacity, etc - there is no such thing as "someone else's problem"! The "someone else" is the company / corporate.

    14. Re:Networks crash just like software by NeverVotedBush · · Score: 1

      An excellent comment, BIGELLOW. And you have some very good points.

  9. You can't do it better than Google by Alereon · · Score: 4, Insightful

    Do you honestly believe that you or your employees are going to build a system with higher availability than Google? In the magical fantasy world we all wish we lived in, you may have the budget, skill, manpower, and infrastructure resources to do this. In the real world it is not even remotely possible. I know how much it sucks when your system is down and there's nothing you can do but wait on some status dashboard to from Red to Green. That said, we should recognize that while being frustrated at this lack of control is normal, that doesn't mean you actually could do it better. It's easy to say "this would have never happened if we were self-hosted" while never thinking about the bullets you dodged by running hosted applications.

    That means you, as a single customer, are insignificant. And that shows daily when dealing with any large service provider.

    The only thing that my service provider should care about is the availability of the platform. I am completely insignificant, but the only reason my hosted app would be down is if the platform is down, and that sure as hell is significant to them. The advantage of hosted applications and cloud computing is that no one needs to ever look at or touch my app, the platform is all that matters.

    1. Re:You can't do it better than Google by lukas84 · · Score: 2, Insightful

      The system being completely down is one point.

      But what about annoying behaviour, bugs, changes, etc.?

      If you're self hosted, you'll have people looking into solving the problem and actually trying to do so. In the end, it might not happen because the cost may to high or because of something else.

      When you call Google you'll reach some guy in india that doesn't give a shit about your problem.

    2. Re:You can't do it better than Google by CaymanIslandCarpedie · · Score: 1

      Also have to remember Google (or any host) isn't the only variable. Every company between you and Google (from your personal ISP through all providers up to Google) also has to have the same uptime as Google for you to be able to benefit from Google's uptimes. Doesn't matter is Google's servers are up 100% if companies between you and Google don't also meet that.

      --
      "reality has a well-known liberal bias" - Steven Colbert
    3. Re:You can't do it better than Google by silanea · · Score: 2, Interesting

      Do you honestly believe that you or your employees are going to build a system with higher availability than Google? In the magical fantasy world we all wish we lived in, you may have the budget, skill, manpower, and infrastructure resources to do this. In the real world it is not even remotely possible. [...]

      Google has to run a massively sized setup catering to a vast diversity of customer types. Sure, they have more manpower and know-how than my employer's IT dept. But they have to distribute this manpower across a very wide field, working on dozens of products and issues in parallel. They have to deal with and prepare for basically any issue imaginable to the IT savvy part of mankind.

      My employer's IT infrastructure, communications system and document/information management system are tailored to our needs. We have everything we need, but nothing we don't. We follow a safety and recovery protocol that reflects our business structure and priorities.

      Short of the annihilation of Western Europe there aren't too many scenarios that would compromise our infrastructure in a way that would impact business. Why should we trade this situation for a little more convenience?

      (Notwithstanding the fact that for legal reasons we won't actually even consider outsourcing anything more delicate than delivering lunch to our IT folk. Mere uptime is not our greatest concern.)

      --
      Rudolf Hess edited Mein Kampf. He was the very first grammar nazi.
    4. Re:You can't do it better than Google by bitslinger_42 · · Score: 3, Interesting

      Do you honestly believe that you or your employees are going to build a system with higher availability than Google? In the magical fantasy world we all wish we lived in, you may have the budget, skill, manpower, and infrastructure resources to do this. In the real world it is not even remotely possible.

      Do I believe it? You betcha! While my company doesn't have 100% uptime for every employee all the time, we haven't suffered an across-the-board outage of a critical system (i.e. email, ERP, core business applications, etc.) in the 11 years that I've been here. Sure, we'll lose an email server once in a while, but we have many such servers, so the loss of a single system only impacts a few thousand employees tops. That's far better than impacting ALL our employees if Google has an outage. And don't get me started about the idea of not being able to do word processing just because a WAN link is down. How on earth could you run a business that way???

      And it's possible to provide uptime even in the event of widespread events, such as flooding, tornadoes, etc. We have multiple datacenters, geographically dispersed. Each center has multiple Internet connections through multiple providers carefully chosen such that the lines go to different cities (i.e. one link to Chicago, one to Denver). Similarly, our power is connected to multiple grids, with the feeds coming in on opposite ends of the buildings. Critical centers have on-site generators spec'd to handle 100% load of the datacenter and requisite support stations, plus enough battery backup to allow for all systems to continue running between loss of grid feed and when the generators are spun up, not to mention on-site diesel sufficient for several days of operations and contracts to get more as needed.

      Was this cheap? Not in the least. Was it worth it? Definitely. We kept our main datacenter running without interruption during a week that saw multiple weather events (i.e. tornadoes, flooding, lightning-related power loss, etc.) when every building around ours for multiple miles was without power.

    5. Re:You can't do it better than Google by rmm4pi8 · · Score: 2, Insightful

      You know, everybody keeps saying this, but it doesn't match up with my experience. If you're running a company of ~25 people or less, such that a decent server and quality colocation are likely out, let alone redundant server hardware, then yeah, you're almost certainly going to have better reliability in the cloud.

      Over the past four years, however, my systems at companies in the ~100 employee range, with redundant servers in quality colo with offsite backups, but no dedicated DR setup, have averaged more than one full 9 better uptime than Google/Amazon, for pretty similar pricing (to $50/user/year, eg with Zimbra $28/user/yr allowing $22/user/year for admin time, hardware, and colocation fees). Of course if you are only hosting internal corporate apps and thus don't need the services of a full time admin to amortize, then your admin costs will likely be higher than this--but for a full extra 9 of uptime (4-9's vs 3) that could be worth it.

      Now you might object that without a dedicated DR site, should my colo fail (which obviously happens, eg when Sun/Craigslist went down and Rackspace also) I'm out at least a day, and that I've just been lucky that hasn't happened to me in the last four years. Probably true, but first of all, there are a ton of major colos in the U.S., and since it's basically front page news when one of them goes down, I'm not at all clear that the average one is down a day every four years. Second, if you look at Amazon's recent 6+ hour S3 outage, etc, cloud computing downtime can quickly add up to the time to bring a colo back on line anyway.

      Third, there is an offsetting risk to cloud computing--in the unlikely event that Google really loses my data (Is that more unlikely than a Tier 1 datacenter going down? Unclear.), who's to say that they won't just cut their losses? Certainly consumer gmail accounts have disappeared before without explanation or recourse. Even if my datacenter dies in a fiery explosion, my company has darn near infinite will to make sure that the offsite backups get brought up somewhere sooner or later. Basically, when services are cheap/utility, that means that you tend to get more out of it than it costs, which is awesome, but the flipside is that when the chips are down, it's worth more for you that your data come back than it is for them to fix it.

      Now you might think that there has to be something wrong with this anecdote, since Google/Amazon/whomever clearly have more layers of redundancy than I ever will, and so just logically should have better uptime. But there are two problems with this analysis. First, they have way more complexity than I do, and so a problem elsewhere in the system (again, look at the recent S3 bit-corruption outage) at the software layer can quickly propagate across all those layers of hardware redundancy, and obviously their software setup has to be way more complex to cope with all that distributedness in the first place. Second, a lot of issues where the hardware and data are intact can be fixed, worst-case, by someone just rebooting the darn system (like it or not) or restarting the hung daemon, etc. For me, this is just logging into a portal and doing the deed when my pager goes off, which is likely to be a darn high priority and done quickly. For Google or Amazon, as we've seen, the procedure may be basically the same, but takes hours in order for them to get enough hardware back on line (and sufficiently isolated from the stuff that doesn't work) to start offering service again.

      So while for small and large businesses the usual Slashdot answers probably suffice easily, I think that at least for tech-savvy firms with other tech needs (the only kind I've worked at, and admittedly a minority), even medium businesses may be far better off insourcing than you seem to think.

      --
      U.S. War Crimes blog. Email for free Mandriva support.
    6. Re:You can't do it better than Google by Free+the+Cowards · · Score: 1

      Over the past four years, however, my systems at companies in the ~100 employee range, with redundant servers in quality colo with offsite backups, but no dedicated DR setup, have averaged more than one full 9 better uptime than Google/Amazon, for pretty similar pricing (to $50/user/year, eg with Zimbra $28/user/yr allowing $22/user/year for admin time, hardware, and colocation fees).

      How are you running such a system on only $2200/year for admin time, hardware, and colocation fees? This seems to me to be at least an order of magnitude too low.

      --
      If you mod me Overrated, you are admitting that you have no penis.
    7. Re:You can't do it better than Google by BIGELLOW · · Score: 1

      Well, that's like saying that when there was an issue of food poisoning with jalapenos from Mexico, you ate a raw one and had no problems, then tell everyone that they're just being silly.

      Just because YOU haven't experienced this problem doesn't mean OTHERS haven't.

      Likewise, when this Google Apps problem occurred, I never noticed it. I guess that during the down-times, I didn't need to check my email at that moment. Just because I didn't notice it, I'm not going to suggest that the countless others who have posted about it were not affected.

      Like-wise, maybe you haven't had any bad luck with the setups you have experienced. That's great. Keep doing what you're doing. In the meantime, the countless others who are reporting about their experiences are just stating the facts as THEY experience them.

      Our company has built an in-house facility with gas-powered generators for power backup, lots of redundancy, battery backups, etc, etc... Everything was running fine. There were occasional hiccups, though. Sometimes it was a piece of hardware that was going bad. Sometimes it was an admin making a goof in a config. Each time a problem would happen, the management would consider putting it all in a colocation facility.

      There just happened to be one down the street from us, so we started moving everything into the co-lo. One day, there was a problem at the co-lo facility. We headed over there to find out what the issue was. There was an eviction notice on the door, and the door was unlocked. Needless to say, we got our stuff out of there and never looked back.

      Could we have gone with a much more expensive co-lo facility to ensure that it was a company that would stick around forever? Sure. But then our equipment would have been a 3 hour drive away.

      Sometimes, the unexpected happens. The power goes out and THAT is when you find out there is a problem with one of the many UPS battery backups. The diesel generator kicks on, but it's too late, and part of a rack has already lost power. It turns out this rack has a main router on it, preventing anything from working correctly. Once you restore power, you find out that the router just didn't come up all the way. Is there a problem with the config? Did something fry it? Admins are scrambling around trying to figure it out. In the meantime, the only alternative solution is to purchase a $30k replacement which can't be bought at your local Office Depot. At best, you could have one overnight. Then, it turns out, there isn't enough money left in the budget for it. Does this make sense? No. But sometimes corporate politics never make sense.

      In a nutshell, stuff happens. Sometimes, some people never have to experience this type of stuff. That's great. In the meantime, to all of those who repeatedly deal with this stuff, Google Apps is a great alternative. It's a matter of "set it and forget it" and on the occasion when it DOES go down, while you may feel a little lost sometimes, you can know that Google's engineers are hard at work resolving the issue. Maybe they are trying to find a $30k router in the middle of the night at Office Depot.

    8. Re:You can't do it better than Google by fyoder · · Score: 2, Interesting

      Do you honestly believe that you or your employees are going to build a system with higher availability than Google?

      Our qmail/vpopmail based mail server is much more reliable than google. So why have we moved many accounts to Google if we have better availability? Because Google rocks when it comes to spam filtering. I wouldn't recommend Google for high availabilty and performance, but if you've got the too much spam blues, Google can take that headache off your hands. The perpetual battle against spam isn't something we want to devote extensive resources to beyond a few sensible, easy to implement measures.

      --
      Loose lips lose spit.
  10. big wins for M$... by toby · · Score: 1

    Yeah because we all know Microsoft's hallmarks are reliability and stability... bwahaha

    --
    you had me at #!
  11. It's not just email. by bigtallmofo · · Score: 1

    But then again: This is "just" e-mail.

    GMail was down and that's "just" email as you say, but it was also Google Apps. Many businesses depend on that for their word processing, spreadsheeting and other Microsoft Office replacement needs.

    The chance of having a single server run through a year is much, much higher than winning the lottery.

    Sure, if you don't include planned downtime. But interconnected networks require higher security which requires regular patching which makes having a single server run through a year without any downtime at all nearly impossible (just like winning the lottery). Back in my Novell days, I had several Netware 3.12 systems with uptimes of 2-3 years.

    --
    I'm a big tall mofo.
    1. Re:It's not just email. by Dan541 · · Score: 1

      I have no sympathy for companies who outsource office applications. What the hell do they expect to happen?

      Not only can your local machine go down, but you ISP could go down, Google went down.

      If world processing and spreadsheets where important they would use a local set-up.

      --
      An SQL query goes to a bar, walks up to a table and asks, "Mind if I join you?"
  12. Re:escaping hostages leave corepirate nazis broke by Anonymous Coward · · Score: 1, Insightful

    Why yes, some raspberry vinaigrette or even a nice oil and vinegar would go wonderfully with that word salad.

  13. downtime by toby · · Score: 1

    we only have one or two unexpected downtimes per year.

    Just like Google. You're making the parent's point nicely.

    --
    you had me at #!
    1. Re:downtime by lukas84 · · Score: 1

      Erm, no.

      We have multiple customers - of these, only one or two have unexpected downtimes per year. That means that there is an awful lot of customers without any downtime.

  14. Where are the stories about the outage itself? by yuna49 · · Score: 5, Interesting

    I scan Slashdot nearly every day and didn't remember seeing anything about outages at Google this past week. A search through the story history confirmed that fact. So I thought I'd visit google.com and see what Google itself had to say. Nothing on the blog; nothing in the press section.

    So why is this the first time these outages have been discussed here? From reading the article it appears we're talking about multiple outages over the past couple of weeks. Doing a Google search for "google outages" brings up one blog posting about these recent events. The blog posting includes this unsourced quotation, "Google spokesman Andrew Kovacs said via e-mail that 'a small number' of Gmail users and 'some' Apps users were impacted by the problem, which is still outstanding and being worked on as of 5:30 p.m. U.S. Eastern Time on Friday."

    So all these events seem rather shrouded in mystery. How big was the outage? What explanations did Google give for the outage? I've certainly had servers go down, lost network connectivity, etc., etc., but I don't maintain huge server farms with enormous redundancy and multiple high-bandwith connections to the Internet. I don't recall search on Google ever going down; what's up with gmail and Apps?

    The suspicious among us might start to think that outside parties might be responsible. After all, if companies start migrating to the "cloud," disrupting those services could have a substantial, economy-wide impact.

    1. Re:Where are the stories about the outage itself? by Anonymous Coward · · Score: 3, Informative

      There was a GMail outage on Monday, which was reported in their blog:

      [blog entry]

      I've read rumors about other Google Apps outages later last week, but nothing official and saw no evidence of them myself.

    2. Re:Where are the stories about the outage itself? by yuna49 · · Score: 1

      So gmail has its own blog; you'd be hard-pressed to discover that fact on the "About Google" page. You can find a link to it on the Google Blog page, but it's buried among dozens of other blogs.

      So I did miss this one, but it's not like Google felt the need to explain themselves in a visible manner.

    3. Re:Where are the stories about the outage itself? by Anonymous Coward · · Score: 1, Insightful

      So gmail has its own blog; you'd be hard-pressed to discover that fact on the "About Google" page.

      If you use gmail, then take a look on the Web Clip line on the top of the page. It shows entries from a set of rss and atom feeds. By default the gmail blog is one of the sources it uses, so you should at least know, that it exists. I have seen the entry about the outage show up a few times there.

    4. Re:Where are the stories about the outage itself? by Quixote · · Score: 0
      So why is this the first time these outages have been discussed here?

      I'll get modded into oblivion for this, but the simple answer is: Slashdot editors and the crowd are huge Google fanboys. According to them, Google can do no wrong.

      I can't even imagine the reaction here if Microsoft or Yahoo had screwed up like this.

      Face it: Google's halcyon days are over. It's just another company now, with bumbling middle-management and mediocre engineers who are biding their time waiting for their shares to vest.

    5. Re:Where are the stories about the outage itself? by Jeff+DeMaagd · · Score: 2, Insightful

      There aren't any gDoc outages that I've seen. The stories so far are about gmail outages, and it's leading people to question whether gDocs will suffer the same.

      That said, I don't remember the last time I've had any Google service down. It happens but not so often. My problem is that my internet service is a tad flaky, in part because wireless is my only partly decent broadband option.

      And that flakiness leads me to avoid "cloud" computing. You're relying on a service that has no credible assurances of uptime, and if your internet service is down, then what? My experience with T1 service is such that I might be lucky to get same-day repairs on that internet service. I'm not fond of the VOIP idea for the same reason either, if my internet is down, phones are down too, leaving no way to get in contact with people, except for mobile phones whose signal is weak inside the building.

    6. Re:Where are the stories about the outage itself? by roedelius · · Score: 1

      yeah. I was about to write, if they had their act together they'd have a centralized system status URL (like any professional hosting company does), but this seems to pretty much do that. However, it took until today for me to find that, and I spent over an hour on Monday trying to find updates or even any word of an outage, with no luck. That URL should be front and center on gmail's error page, and in general needs to be publicized a lot more.

    7. Re:Where are the stories about the outage itself? by Sun+Chi · · Score: 1

      My Gmail account was fine on Monday, but down most of Friday (08/15/2008) with something they called a "502" error. I sent them an email (from another service) detailing the problem and got a response back about 4 hours later, and hour or so after my email was accessible again.

      The Friday outage that hit me was only being reported by users in the Gmail support forums at http://groups.google.com/group/Gmail-Help-Discussion. I didn't see any Google staff answering those posts. I also couldn't find any news sites (including Slashdot) carrying this story, even the ones that had Monday's outage front-paged.

    8. Re:Where are the stories about the outage itself? by lucifuge31337 · · Score: 1

      They aren't rumors. 4 of like 25 people on my gmail for domains, including me, could not access mail via web, pop, or imap.

      --
      Do not fold, spindle or mutilate.
    9. Re:Where are the stories about the outage itself? by Anonymous Coward · · Score: 0

      Funny. All I get when I do a Google search for "google outages" is "There never were any outages. Google is perfect!"

    10. Re:Where are the stories about the outage itself? by Anonymous Coward · · Score: 0

      You mean that?

      The official "Updates and alerts about your Gmail service" on Google group.

      For stories about the problems:

      NYT

      Google News

      Google search problems have been mentioned a few times on Slashdot

      No very big deal by the way. Just don't jump to the "it's a conspiracy" conclusion right away, will you?

    11. Re:Where are the stories about the outage itself? by panaceaa · · Score: 1

      Google released an explanation and apology on the Gmail public blog. In fact, there were announcements on the downtime status throughout the event, but they've since been deprecated for the final blog post.

    12. Re:Where are the stories about the outage itself? by dangitman · · Score: 1

      I can't even imagine the reaction here if Microsoft or Yahoo had screwed up like this.

      Maybe you couldn't imagine it, because there would be none? Slashdot doesn't typically report on network outages, unless there's something noteworthy about them.

      --
      ... and then they built the supercollider.
  15. I did not even notice it... by mrboyd · · Score: 4, Informative
    We use google Apps for email and to be really honest no one here noticed the issue and I trust the email that could not reach gmail server during the outage will be retransmitted in time. The reliability of our mail server was far worse when we hosted it ourselves, particularly when some of the SEA-ME-WE cables got cut and our provider lost all connectivity for a couple of days. I am certain that if I had big money to waste I could build my own email servers farms and target the five nines but right now we are paying $0 and we are getting a pretty decent service.
    Those IT manager using the free service and expecting mission critical uptime should really go out more often and get a grip on reality.
    Let's see, to set up my own five/nine email servers I would need at least two hosting location on different backbone, each of them should have at least two redundant servers. And of course I should have one spare that I can ship express whenever one fail.

    Fixed Cost (Investment)
    • Decent server (RAID, Redudant PS): $3,500x5= $17,500
    • Operating system license: RHEL Standard subscription: $799 (optional of course)
    • Software license: $0 (sendmail etc..)

    Monthly Recurring Cost

    • Hosting with decent SLA: $500x2= $1,000
    • Email Administrator (IT Admin): $10,000(?)
    • Replacement Parts: $100(?)

    Implementation time

    • 2 to 6 months (including, research, documentation)

    Of course I pulled the numbers out of my hat but it should be enough to show that there is no way a SOHO will ever have the mean to do it and that it is unrealistic to expect that kind of service for free or cheap.

    1. Re:I did not even notice it... by gullevek · · Score: 1

      Yeah, and imagine a company that doesn't have the money to do this and has just one sever with perhaps some cheap backup MX somewhere.

      Google apps is just the best solutions for this ...

      --
      "Freiheit ist immer auch die Freiheit des Andersdenkenden" - Rosa Luxemburg, 1871 - 1919
    2. Re:I did not even notice it... by mrboyd · · Score: 1

      I don't need to imagine it. I worked there. :)
      Google Apps is as far as email hosting goes a few orders of magnitude better than what any ISP cares to provide. It's a god sent gift to any SOHO. Probably not the ideal solution for a fortune 500 or companies with privacy issue (lawyers, Al-qaeda).

    3. Re:I did not even notice it... by SaDan · · Score: 1

      No, Google Mail is the EASIEST solution for this scenario.

      Yeah, shit happens, but I've managed to not incurr significant downtime on any of the mail systems I've administered over the years due to geographically separated backup servers. I've been through extended power outages, tornadoes, internet provider failures, you name it.

      If you plan it out, and implement a good solution, it's hard to go offline completely. Google must have had something serious going wrong in their backend systems for this to have happened. I never lost access to any of my Google apps (personal stuff) during the outages.

    4. Re:I did not even notice it... by thalassinos · · Score: 2, Interesting
      That's roughly my estimate too.

      I am currently in the process of starting a new company. At the moment we only have four persons as staff, two if which (including me) work mostly from home.

      We could never afford a dedicated server at this time.

      Signing up for Google Apps was a no brainer for us and we are very happy with it so far.

    5. Re:I did not even notice it... by vbraga · · Score: 1

      I'm doing the same (starting a company), can you describe more your experience with Google Apps? I'm somewhat reluctant to use it. Not only because of Google uptime, but since I must setup some infrastructure (SVN server, something for nightly builds - we're doing software) setting up OO.org for everyone doesn't not seem much more trouble than going Google.

      Do you feel OK without a dedicated servers? I think I need at least one, for SVN and stuff like that.

      I'm sorry for the questions, but I've been thinking a lot on things like this these days.

      Thank you in advance and sorry for the bad English!

      --
      English is not my first language. Corrections and suggestions are welcome.
    6. Re:I did not even notice it... by Anonymous Coward · · Score: 0

      Not sure where you get your numbers from, but I've been running a highly available linux based solution that costs about $500 for a used HP Proliant box (which includes raid5 disks, redundant power), and redundant internet connections are $50/month x 2...

    7. Re:I did not even notice it... by jonbryce · · Score: 1

      If cables get cut, you won't be able to access GMail or Google Apps either.

      You still have that problem, and in addition, you have to add the reliability problems at Google's end.

    8. Re:I did not even notice it... by Anonymous Coward · · Score: 0

      strange... there were many hours this entire past week I couldn't access my gmail account at all.

      It definitely was a pain in the ass and I was quite disappointed that google can't even keep one of their bigger services operational. The biggest disappointment to me though was the lack of messaging.

    9. Re:I did not even notice it... by mrboyd · · Score: 1

      We do in fact have a dedicated server for subversion and a couple other for demo/testing/playground whatever.

      When I say Google App, I'm only talking about the email service. I don't believe in "the cloud" for everything and there is no way I would use their crude online text editor and spreadsheet. I do most of my work in plane and airport and I need to have my data and software with me. Heck, I'm reading my mail in outlook or thunderbird (depending on the OS) with google app IMAP. Never used the gmail interface unless I need to do some deep search that neither outlook nor thunderbird can handle.

    10. Re:I did not even notice it... by Anonymous Coward · · Score: 0

      You certainly did pull the figures from your ass. You're looking at $220-$450/month (depending on your requirements) for a decent dedicated server in a monster server farm. Over the last 3 years or so, I've made some clients very happy by setting up their apps in a professional farm, compared to having to take care of it locally. They have better support (which is sad), better resilience, and better net connection. The cloud was the "great white hope" for those services that need scaling on demand. Alas, it's turned out to be complete shit for anything other than trivial blog/wikis, toy "hello world" crap.

      What we need is for the "cloud" service companies to step up with some balls, and offer a professional level virtual dedicated box where capacity isn't limited to a single server purchase, but an amorphous entity that handles your applications and charges you based on usage. Until that happens, the "cloud" will remain a piece of shit, where monsters like Amazon and Google are trying to generate some income from their huge over-capacity resources.

    11. Re:I did not even notice it... by gullevek · · Score: 1

      Perhaps its location based. I had twice problems accessing mail or calendar, no idea why. Perhaps because I am in an Asian region.

      --
      "Freiheit ist immer auch die Freiheit des Andersdenkenden" - Rosa Luxemburg, 1871 - 1919
    12. Re:I did not even notice it... by thalassinos · · Score: 1
      Our main use of Google Apps is for email, but we do use the calendar, word processor and spreadsheet apps.

      Heavy duty work is done using MS Office / OOo but for sharing documents or forms we use Google Apps. We found it very convenient, but there are some limitations that you must keep in mind.

      The word processor (Google Write?) does not have the rich editing options of a full blown word processor. I believe that internally it saves the documents as an HTML+CSS file, so document formatting is limited, but perfectly adequate for internal documents. Personally, I use a text editor for editing most of my documents offline, and then email the document to a special email address that Google Apps creates, which automatically inserts the document into Google DOcs.

      Furthermore, there are limits to the file size of the documents that you can import (for example IIRC 512Kb for text files).

      Also, you cannot run macros and you cannot automate some repetitive tasks.

      We did not use the presentation module (other than for sharing funny pictures), but it feels underpowered.

      The calendar is more than adequate for most needs. I do not know if it syncs with programs other than Outlook though. SMS notification is very handy.

      Having said that, document sharing works and works well. For a virtual company like us, who we still have no permanent office, this is *very* important.

      I would also not trust the "cloud" for my important documents; I want to be in charge of my retention and backup policies. But, as a sharing and secondary storage medium, I found Google Apps a very convenient and cheap option.

    13. Re:I did not even notice it... by SaDan · · Score: 1

      I don't think that is the case. I know people in the same city using the same ISP who were offline with Google.

  16. Compared to local apps Google is doing top notch. by miffo.swe · · Score: 1

    I don't know what these people compare to but Google in particular has stellar performance when it comes to keeping their stuff running. I could only dream of getting those uptimes and availability on our servers. First of all failsafe systems is very expensive, mostly insanely so. Second of all they demand enormous amount of staff and maintenance. Tossing a service into the mix or upgrading is a year long process.

    The admins who complains about outsourced services are just trying to keep their jobs. When enough managers see that the service they paid through their nose to get is a bargain from Google admins will be in the hot seat indeed.

    Other outsourced services might not be that good but Google is a very bad example if you want to badmouth cloud computing.

    --
    HTTP/1.1 400
  17. The Illusion of Control by Hangtime · · Score: 4, Interesting

    We have all seen it. Ebay a couple of years ago going down due to Oracle corruption. Royal Bank of Canada failure due to an improper software upgrade. Now, Google with Gmail and other Google Apps failing. All of these organizations were geared towards having the highest uptimes available and failed spectacularly.

    Whether you host your own or use someone else its the illusion of control that somehow clouds our judgment into believing that it would somehow be different if I did it. Example: Is it better to drive or fly? Pure numbers state that its safer to fly on a commercial carrier by an order of magnitude but somehow we feel safer when we drive. Whether we choose to acknowledge it or not the world is full of 6 sigma events. As long as you are doing everything you can and within your budget when your hosting your own apps or auditing your provider to ensure they have, backup systems, redundancy, offsite bunker, etc. then you have done everything you can to prepare for this inevitability.

    In a lot of ways designing systems is like playing poker. You can play your hand perfectly, design all the systems redundancy and recovery you like, but sometimes even after all that your opponent (risk) draws a lucky card on the river to beat you. Just because you got beat doesn't mean you shouldn't continue to play the same way, it just means you hit one of those events that you cannot plan.

    1. Re:The Illusion of Control by EastCoastSurfer · · Score: 1

      The term you're looking for is a Black Swan Event

    2. Re:The Illusion of Control by canuck57 · · Score: 1

      We have all seen it. Ebay a couple of years ago going down due to Oracle corruption. Royal Bank of Canada failure due to an improper software upgrade. Now, Google with Gmail and other Google Apps failing. All of these organizations were geared towards having the highest uptimes available and failed spectacularly.

      Two of the most commonly missed points about high availability are simplicity and use the basic tools first. HA solutions are often complex, error prone and ignore the basics such as good system management practices. And when the complexity goes wrong, it is a mess.

      For example, many systems in need of HA share storage on a SAN that is changing daily for other systems in the big SAN cloud. If it was important, why not directly attach the disk? Must everything be on a SAN to keep the egos happy? No cables to get pinched, moved, switch configuration issues etc. Mirror the disk, RAID 0+1 and don't get fancy and cheap with RAID 5/50 etc. Oh, and make sure you mirror across controllers, and do the nasty IT thing, test it.

      And manage access control, the fewer people into a system, and the more qualified helps a lot. Once I saw a HA project that failed miserably, a well meaning DBA needed more space so they "mkdir /v14" and thought that was all to making more file space, until it filled up / on both the main system and the fail over at the same time. LOL. Process has more to with high uptime than does complex clustering. Critically review all the changes for technical (not political) sanity goes a long way.

      But to Google, they are actually doing a good job. Anyone remember the MSN issues? Took many many months to get stability back if I recall correctly.

    3. Re:The Illusion of Control by Anonymous Coward · · Score: 0

      "Failed spectacularly?" Are you for real?! Gmail being down for SOME people for a few hours is a "spectacular" failure?

  18. power by epfreed · · Score: 5, Insightful

    Two weeks ago a transformer blew out in the building I work in. First there was no power for 3 hours, then temporary power as a large generator was hooked up, but it was not big enough to run the AC, so we did no turn on the servers. It took another day to get a large enough generator (about the size of a tractor trailer). In total, our business was shut down completely for a day and a half due.

    I don't think you can even get a SLA from the power company.

    Google Apps went down for 3 hours.

    Shit happens.

    1. Re:power by lukas84 · · Score: 1

      I don't think you can even get a SLA from the power company.

      Well, here you can. Of course, it won't be cheap.

    2. Re:power by DerekLyons · · Score: 1

      I don't think you can even get a SLA from the power company.

      If you're willing to pay for it, you certainly can.

  19. Rethinking Google by HangingChad · · Score: 4, Insightful

    We ran into one of these "gotcha" features in hosted Gmail that's been giving me fits and it all started with a simple mistake. I misspelled a user name. You can change the spelling in the admin module, but it doesn't change the spelling in the contacts and the misspelling still showed up when she logged in. So I tried deleting the user name and recreating the account.

    Big mistake.

    When you delete a user name you can't recycle it for five days, which pushed us past our roll out date. Their crip work-around is creating a mailing list with that user name. But that has its own set of problems, especially when trying to migrate a large number of users. There's no support unless you get the premium edition. So now we're stuck in the position of paying for support on a service we're not certain will work for us. I'm not inclined to throw money at something to see if it will work when what we're already paying for is working.

    Unfortunately, it was one of our key sales people who already had that account name on her business cards. Rolling without her is a non-starter.

    It's frustrating because I'm the one who recommended Google and I feel really let down. It's a stupid problem that shouldn't exist in the first place. Even if there's a good reason for it, there should be a giant warning banner with a flashing red neon border warning you that deleting a user results in a five day lock out. Actually, it's been more than five days and I still can't recreate the account.

    This one niggling little incident is making me rethink hosted applications. So, yeah, it does sort of benefit MS. Not in our case, we're using hosted SendMail instead of Exchange, but if this type of "feature" deters other companies already using MS solutions, then yeah. Who wants to take a chance on looking bad? There will still be outages with any solution but no one gets fired for recommending MSFT. There's a certain period of time that users are looking for an excuse not to like a new service, just because it's different. If you can get past that time frame, then a small outage can be overlooked. But those first few months have to be smooth. Maybe not flawless, but close to it.

    It would almost be better if the free version was a trial and corporate users could get support from day one. This is just maddening. Shape up, Google.

    --
    That's our life, the big wheel of shit. - The Fat Man, Blue Tango Salvage
    1. Re:Rethinking Google by Anonymous Coward · · Score: 1

      You couldn't print new business cards with new email?

    2. Re:Rethinking Google by Anonymous Coward · · Score: 0

      So you're suggesting to replace physical objects because a *policy*, somebody pulled out of their ass, forbids you to re-create an immaterial object. ...great solution.

    3. Re:Rethinking Google by gullevek · · Score: 1

      is sure nice when John Smith has an email called john.wmith, that sure makes someone that works in marketing/sales super happy.

      --
      "Freiheit ist immer auch die Freiheit des Andersdenkenden" - Rosa Luxemburg, 1871 - 1919
    4. Re:Rethinking Google by mbaciarello · · Score: 2, Interesting

      I feel for you.

      I'm trying to set up a collaborative network for a small non-profit organization. Right now, 'free (at least) as in beer' is not an option for any such tool.

      However great Gmail's interface, Google Apps is not really ready for serious corporate/pro team use IMHO.

      You may recall that up until a few days or weeks ago, members contacts were not automatically populated for new accounts--everyone had to manually fill them in for keeps. Although that was fixed, there's no way to create and propagate contact groups (as opposed to mailing lists) automatically--and mailing lists won't just cut it as users can't see who actually is on the list. Nor can they make new groups and propagate them to their sub-team.

      Also, the inability to "force" chosen calendars into members calendar areas is almost a showstopper for us. I wonder how many larger corporations can cope with that. The way I'm working around this is adding calendar widgets to relevant sections and asking users to click the button and add the agenda to their calendars. We're still testing, but I'm not seeing satisfactory compliance...

      Finally, support is egregiously non-existent. They have an apparently smart policy on the discussion groups: if you post a lot (presumably in response to people's queries), you get benefits. Well, I have yet to receive a single answer as to why "naked domain" addressing (http://mydomain.com/) used to work on my host but doesn't after CNAME modifications. And I'm getting 404's, not DNS errors! I may be getting what I'm paying for, but then again, my EUR 0 are worth a lot more on most other freeware communities around the Web.

      For one, I've gotten better support and answers from the guys at Zoho.com, while on my free plan. Their offerings are also way more complete and functional, though slightly worse performance-wise, than Google's. Too bad they don't have 2nd-level domain customization (AFAIK) and, more importantly, they have a price for multiple projects we can't afford as of yet.

      And don't even get me started on the lame Google Pages -> Sites app... Either you have a full-time coder dishing out Google Gear applications for you, or you're much better off clicking away at Wordpress or Joomla GUI admin pages... Layout templates? They look all the same. CSS customization? Severely limited. Actually I think you can customize your Blogger.com site more than you can Google Sites.

      All in all, organizations of all sizes considering/using Google Apps have a lot more to worry about than a few sparse hours of email downtime...

      Ok, enough with the tedious rant, but just a quick reminder to those using the free Apps edition: be advised that one of the main selling points of Google Apps, unified logins, is closed unless you sign up for the paid plan. You'll have to pay to let users login from your actually-usable-and-professional-looking blog/CMS into their Gmails, Docs and Calendars using the same account.

    5. Re:Rethinking Google by Anonymous Coward · · Score: 0

      It would almost be better if the free version was a trial and corporate users could get support from day one. This is just maddening. Shape up, Google.

      Did you do a trial setup and tested all the various failure scenarios before doing the jump of your main domain? Typos in usernames is the biggest source of headache we have at work, simply because HR staff sometimes type it wrong when filling the data for a new hire, which in turn causes logins to be generated with the typo and cause a lot of work to have the user renamed. And that's all with in-house built systems (about 90% of the systems) and a few third-party systems....

      As for the free version being a trial, I gotta disagree. There are people who can deal with unmanaged solutions (no wonder the hosting companies offer similar packages with managed and unmanaged versions). A lot of companies have their sysadmins already who are responsible for doing the testing and QA of solutions before they are deployed. For these types of companies, a free version of Google Apps is more than enough.
      There's also the case of non-profits and small companies that simply have a better use for their money than paying whatever value is charged by Google or any other company to have their e-mail/site.

      If you want support, pay for it. Or do you expect Google (or any other company, for that matter) to have thousands of support staff dedicated a non-profitable service? ( I'm assuming the free gmail in apps is non-profitable, since the cost alone for storage, BW, energy and cooling probably isn't paid just by the number of ads clicked by the gmail users. Or do you want your users to spend several hours per day clicking in the gmail ads instead of working, just to make sure google have money to hire support staff to support a totally free service? )

      It may not be as full of features as Exchange or other enterprise mail solutions, but keep in mind that most of those have been around longer than Gmail and it's quite likely that they have development teams bigger than Gmail may have... After all, when you charge big $$$$ just for licenses to install the software, then another load of money for licenses based on the number of users, you end with a nice profit that you can re-invest in the product.

    6. Re:Rethinking Google by Anonymous Coward · · Score: 0

      How many of your other vendors let you go live with their service without paying them, just to see if you like it, and are happy to spend time and money supporting you before you agree to pay them? You're being incredibly unreasonable here. If you have a critical need for support with a vendor, sign a contract.

    7. Re:Rethinking Google by DerekLyons · · Score: 2, Insightful

      Its Google's fault you set everything up at virtually the last minute?

    8. Re:Rethinking Google by BIGELLOW · · Score: 3, Insightful

      That makes little to no sense. It sounds to me that, in general, you are just second-guessing using technology at all.

      Think about it.

      Imagine there was some sort of known flaw in Outlook, Exchange, or some other email-based application. Then, imagine this flaw came at a terrible time for you, right when you were dealing with an important client.

      Would your response be, "It's a stupid problem that shouldn't exist in the first place. This one niggling little incident is making me rethink software."?

      Again, it isn't the fact that it is a "hosted app" that has caused this problem. It's a bug or a design flaw, that ANY piece of software could be prone to, and isn't just limited to the idea of hosted apps.

      The only types of flaws that one could attribute specifically to "hosted apps" are service-level down-times. However, these could always be compared to service-level down-times when running servers on an internal network. Google Apps have had fewer network problems in its entire lifetime than our internal network has suffered for the past two weeks.

    9. Re:Rethinking Google by Anonymous Coward · · Score: 0

      There's no support unless you get the premium edition. So now we're stuck in the position of paying for support on a service we're not certain will work for us. I'm not inclined to throw money at something to see if it will work when what we're already paying for is working.

      I haven't tried Google Apps, but it seems they provide 30 day free trial for Premier Edition (the one with phone support). I suppose this should be enough for you, if you're creating accounts less than 5 days before going live...

    10. Re:Rethinking Google by lucifuge31337 · · Score: 1

      You couldn't print new business cards with new email?

      This is why people in IT typically don't make it into management or any other business positions.

      --
      Do not fold, spindle or mutilate.
    11. Re:Rethinking Google by Anonymous Coward · · Score: 0

      Only due to time constraints someone mentioned. I don't think that you can convince Google to change
      their email policy within 5 days.
      At my company we have two people with the exact same name. We don't have John.Smith@gmail.com and John.Smith1@gmail.com
      we can think of some other email naming convention. I'm sure that you can use a middle initial,etc until
      you fix the email naming problem with google or your 5 days are up.

    12. Re:Rethinking Google by ozphx · · Score: 1

      Would your response be, "It's a stupid problem that shouldn't exist in the first place. This one niggling little incident is making me rethink software."?

      Yes. In fact this is what leads me to bring transparencies to critical sales presentations, after another engineer's laptop died in transit.

      "Laptop fried, so no pretty ROI charts for you" doesnt sell shit. At least you can look prepared and use an ancient OHP ;)

      --
      3laws: No freebies, no backsies, GTFO.
  20. Re:Incredible Expectations? by King_TJ · · Score: 3, Interesting

    Expecting five-9 or 0 downtime for a system used by only ONE company might be a very high expectation with a high cost vs. usage obtained from it afterwards.

    But how many companies rely on Google's systems? When you offer your application or suite to the whole nation or WORLD, and campaign for its use - then YES, you do need to keep a very near-0 downtime to be really successful.

  21. Re:Second guessing? by Anonymous Coward · · Score: 0

    Dude ... the term is used exactly as it is supposed to in the summary...

    "This week's Google outages left several Google Apps admins in the lurch - and many of them [use hindsight in criticizing] their advocacy for making the switch to hosted apps, InfoWorld reports."

    Try knowing what the heck you're talking about another time.

  22. Bandwagon in the Cloud by TimeTraveler1884 · · Score: 2, Insightful

    Seriously now, WTF? Why is everyone acting like they've never had a BSOD on windows, a failed harddrive, a driver problem, or a vendor discontinue support? I use AWS, GAE and Google Apps and while there is a certain loss of control, the downtime I have experienced is far less than I would incur trying to roll my own infrastructure.

    I've worked in a few companies with large IT budgets and have experienced more downtime in those environments than I have so far "in the cloud." I think the biggest problem with cloud computing, is when there is downtime, IT admins don't have anything else to do which frees up a lot of time for bitching about the downtime their blogs. Seems familiar from when I was an admin, except on the other side, it was my users bitching at me about an couple of hours of downtime a year.

    1. Re:Bandwagon in the Cloud by Anonymous Coward · · Score: 0

      or a vendor discontinue support?

      See, back in the day, you got a CD, you entered the key that was printed on the CD's package, and you installed the app locally.

      It didn't matter if the vendor "discontinued support". Your local copy still ran just fine.

      When your hard drive crashed, or you got a new motherboard (this was before XP's "operating system is DRM-locked to one specific hardware instllation", as well as before DRM mechanisms based on phoning home), you restored it from backup.

      About the only cases where "vendor support" mattered would be applications with time lags of 10-20 years. Most 286-era character-based DOS apps will run just fine on anything still sold today. Apps tied to specific hardware (data acquisition boards and ISA slots, for instance) worked fine in DOS, Win3.11, and often Win9x -- and motherboards with ISA slots were commonly available from the days of the first IBM PC through to around the Pentium III era. (If you really wanted to run that old MFM drive, you could even stick the MFM controller into an 8-bit ISA slot, and boot from that!) Piece of old ISA hardware that's timing-loop-critical because the DOS code used a busy-wait? Go into BIOS and force the ISA bus to run at 7.19 MHz, or the specced 8.33 MHz.

      Running something that works, but is really important? After the first year and you're convinced that you've got the only stable hardware configuration on the planet, buy another motherboard and stick it in the closet.

      How often have you had a problem where a vendor helped you by fixing the problem? Usually, all you get is a salesweasel telling you to "upgrade", wherein the upgraded version has a whole lot more bloat, changes all the features you do use, and faithfully preserves the bug you were originally pissed off about.

      Once you get away from the network and the cloud, it's easy to run a locally-installed stable hardware/software configuration that can be expected to work for 10 years, if not 20 years. Fuck vendor support, and fuck the cloud. They're both just DRM by other names. Locally-hosted (and backed-up, with spare hardware for swapout) solutions for the win.

    2. Re:Bandwagon in the Cloud by Bender0x7D1 · · Score: 1

      Seriously now, WTF? Why is everyone acting like they've never had a BSOD on windows, a failed harddrive, a driver problem, or a vendor discontinue support?

      However, the cloud doesn't make these problems go away. If I have a failed hard drive, I still have downtime while I go find a different machine to use or repair the one I have.

      Also remember that it isn't just the servers you have to worry about. There are a lot of miles of fiber out there and a lot of idiots with back-hoes.

      --
      Reading code is like reading the dictionary - you have to read half of it before you can go back and understand it.
  23. Uh-huh by woohootoo · · Score: 1

    Guess the lessons learned in the good ol' mainframe/dumb terminal days still apply, eh?: The network is fallible, and when the network croaks, you're royally forked.

  24. MS is DEPENDABLE! by mrSteveBallmer · · Score: 0, Flamebait

    MS servers don't crash! http://fakesteveballmer.blogspot.com/

  25. train crash analogy by ajb44 · · Score: 3, Insightful
    Train crashes happen much less frequently than car crashes, so trains are, on average, safer. But every single train crash is news, because more people die in an individual event than in an individual car crash.

    Cloud apps have the same problem. When google apps or EC2 go does, it's news.

    1. Re:train crash analogy by Tim+C · · Score: 1

      But every single train crash is news, because more people die in an individual event than in an individual car crash.

      Actually they're news because they're rare; I have certainly seen reports of train crashes and derailments in which few or no people were killed.

  26. irrational by speedtux · · Score: 1, Informative

    The amount of downtime each individual user experiences from their local Microsoft Windows and Microsoft Office installations is far higher than the few hours per year people may experience with hosted apps.

    1. Re:irrational by speedtux · · Score: 1

      Ah, I see, Microsoft's paid corporate moderators are in full force again.

      I'm not being sarcastic, though: add up the number of hours you spend installing, upgrading, and maintaining Windows and Office locally, and compare it with Google's downtime. In fact, just waiting for Microsoft Office to load probably adds up to more downtime.

    2. Re:irrational by wertigon · · Score: 2, Insightful

      That's true, but there's another side to it; imagine a company with 500 employees. Each employee has their own workstation. Now imagine 1% of those are down constantly. That means five employees will, at any given moment, not be able to perform any work. That's an annoyance, but if a workstation is down for on average 1 hour, then it's still ok.

      Now, the important thing to remember here; It's never the same five employees suffering from downtime, and the company as a whole still keeps doing what it does best; earn money. But with a centralised, hosted app, the *entire company* will be down during those three hours of downtime. Might as well give everyone a free day off.

      Hosted apps aren't going to fly until this very basic problem is solved. 'Nuff said.

      --
      systemd is not an init system. It's a GNU replacement.
    3. Re:irrational by speedtux · · Score: 1

      But company-wide outages happen with regularity with non-hosted applications as well: corporate servers go down, corporate networks go down, worms infest every machine at once, etc.

      Google does need to address this because people perceive it differently. But I think even given these outages, you're still better off with hosted apps. Besides, Google offers off-line features as well.

    4. Re:irrational by Rakishi · · Score: 1

      corporate servers go down, corporate networks go down

      None of these should keep everyone from getting their work done. I can still use my computer and almost everything I need is on that computer. Hosted applications would be even more vulnerable to a network outage as well as vulnerable to internet outages and any network server outages.

      worms infest every machine at once, etc.

      Worms rarely kill machines although they may kill the network. See above.

    5. Re:irrational by Billly+Gates · · Score: 1

      But the illusion you can do something about it. Waiting for them to fix it does not make you look good in the I.T. field as people want it fixed 5 minutes ago.

    6. Re:irrational by Xuranova · · Score: 1

      This coming from a Google Rep? Valid points that don't agree with you and you result to name calling? Tell tell signs you aren't on the winning side of things.

      --
      "There is no real right or wrong, just what the majority accepts at the time."
    7. Re:irrational by ozphx · · Score: 1

      I find that the imaging of a new PC takes less time than an OS install. In addition the updates come down overnight while I'm busy fucking someone elses wife.

      Only downtime I've had is due to hardware failure.

      --
      3laws: No freebies, no backsies, GTFO.
    8. Re:irrational by speedtux · · Score: 1

      None of these should keep everyone from getting their work done. I can still use my computer and almost everything I need is on that computer.

      A lot of companies have centralized file servers and servers like SharePoint or Notes. When the servers or the network goes down, everything stops: nobody can get at their files, etc.

      Worms rarely kill machines although they may kill the network. See above. ... which stops everything. See above.

    9. Re:irrational by speedtux · · Score: 1

      Valid points that don't agree with you and you result to name calling?

      Name calling? Where?

      Tell tell signs you aren't on the winning side of things.

      You seem to have trouble with the English language, but piecing together your ungrammatical tidbits, it seems to me that you disagree with me on the facts.

      If we add up all of Google's downtime and extrapolate to a year, it's about eight hours. Everywhere I have worked, we've had a lot more Windows downtime than that per year.

      coming from a Google Rep?

      I think your posting history tells us just the kind of person you are:

      http://slashdot.org/comments.pl?sid=468416&cid=22572924

      http://slashdot.org/comments.pl?sid=634461&cid=24463119

    10. Re:irrational by wertigon · · Score: 1

      In such a setup, it's not uncommon to have the workstation cache documents locally since most people's entire work directory (or the "current projects" as opposed to "archived") is only around 100-150 MB or so, and there's still things you can do locally - There's always things to do, and if the parts requiring online access can't be done, the offline access can. So while the work will be hampered, it still won't be completely off limits the way losing your entire app catalog is.

      Sorry, but I'm still extremely unconvinced about portable apps. The risks are just too great right now.

      --
      systemd is not an init system. It's a GNU replacement.
  27. Give me a break by DustoneGT · · Score: 4, Insightful

    In my company Google Apps is the most reliable thing we use. Microsoft products are my biggest headache. We have clients that need their work done and I don't have any more time to waste on these crappy machines. We will be switching to Apple for all mission-critical machines in the next three weeks.

    If my MS computers could have only 3 hours of downtime a quarter I would be really happy. I used to work for an IT company and they primarily used MS servers for their clients. Big mistake. MS products are a nightmare. Their clients would have been happy with 3 hours of downtime instead of days and days down dealing with MS server issues. I would only avoid cloud computing if there were serious concerns with privacy or hacking.

  28. You CAN do it better than Google by Anonymous Coward · · Score: 2, Interesting

    Do you honestly believe that you or your employees are going to build a system with higher availability than Google?

    Why, yes, I do. I've worked as an enterprise technical architect for 2 of the baby bells and a 3 hour outage is outrageous.
    I've designed systems that will fail over within 2 minutes with with under 30 seconds of data loss. The users just need to re-login and the load balancers (also redundant) will redirect them to a different data center 600 miles away from their primary location.

    This solution is possible regardless of the crap code provided. And when you build the entire network, you know where the weaknesses are - and you aren't at the whim of some ISP for connectivity. Redundancy, management, monitoring and good overall system designs are your friend. Cost and cocky software developers are your enemy. Having fully tested DR solution for the price of a Prod/Test set of systems is win/win, if you ask me. Most of the time, executive management agreed with me and we built systems with less than 30 minutes of downtime for disasters even on the cheapest projects. We test fail over every other week by swapping the primary location as a matter of course.

    Google's weakness is in believing that having 1,000 of CPUs is all you need to deal with redundancy.
    You have to plan for outages.
    You have to practice your fail over plan - at least every other week or on game day, when it counts, YOU WILL FALTER.

    "Hope is not a plan." -JG

    1. Re:You CAN do it better than Google by Anonymous Coward · · Score: 2, Interesting

      I've designed systems that will fail over within 2 minutes with with under 30 seconds of data loss.

      Which is worse, three hours of unavailability with no data loss, or 30 seconds of data loss every time you fail over? Redundancy is a lot easier if you are willing to tolerate 30 seconds of data loss on fail over.

      This solution is possible regardless of the crap code provided.

      It is a major misunderstanding to assume, that redundancy protects against crappy code. If you run a crappy piece of code you are likely to have data dependent crashes. What good is it to have two redundant instances, when both are running the same crappy code? Eventually you are going to process some data that triggers the same buggy code path in both instances. IIRC the Ariane 5 rocket blew up because of exactly that.

      Two redundant instances running independently developed software is no solution either, because any redundancy with just two instances is making lots of assumptions about the nature of failures. In fact it is proven, that if you don't make hard assumptions about the timings of the network between your instances, you need at least four different instances to tolerate a single failure and keep the rest in a consistent state. (In general you must have stricly less than one third of failures, so to tolerate two failures you would need seven instances). Good luck with finding four independent implementations of a reliable protocol for such redundancy.

      Google's weakness is in believing that having 1,000 of CPUs is all you need to deal with redundancy.

      That comment was just hilarious. Now could you please point me at the webpage explaining how gmail implements redundancy, so I can verify your claim?

    2. Re:You CAN do it better than Google by v1 · · Score: 2, Insightful

      my DSL was down for FIVE DAYS recently due to flooding. The brilliant bell decided to place ALL their DSL centers in the state within 2 blocks of wherever the local river was. D'oh. We got a "500 year flood" and it buried every single one of them.

      If 3 hours is outrageous, what does three days classify as?

      The irony? I used my gmail while they were down.

      They have yet to restore my "backup dialup account", a month later. Sure, 56k isn't exactly a good backup, but they didn't even have THAT.

      --
      I work for the Department of Redundancy Department.
    3. Re:You CAN do it better than Google by BIGELLOW · · Score: 1

      So your systems were also accessible from the outside, could return searches across gigs of data in a fraction of a second, and allowed simultaneous collaboration between authenticated users?

      That's awesome. Why don't you just start competing with Google, then? Seems like it would be much more profitable and more beneficial to society then just talking about it online.

  29. Maybe not a big wing for MS by plopez · · Score: 1

    http://www.informationweek.com/news/software/crm/showArticle.jhtml?articleID=172900624

    http://news.cnet.com/8301-10784_3-9985201-7.html

    If MS really gets on the band wagon, they will be in the same boat as the other providers. In fact it will be worse due to their lack of institutional competence and the fact that they will be charging $$$$$$ for the service. If one copy of Word crashes, no problem. If an entire large companies version of Word crashes then it won't be long before people start screaming bloody murder.

    Low cost hosted apps make some sense for travelers or people who can't afford full office suites. In other cases, esp. when you factor in the lack of backups, it doesn't.

    --
    putting the 'B' in LGBTQ+
    1. Re:Maybe not a big wing for MS by notaprguy · · Score: 1

      The IW article you reference was from 2005 dude. You can try out hosted Exchange, SharePoint etc. today at http://www.mosbeta.com/Welcome.asp. Their pricing is pricing is pretty competitive. For a basic version of Exchange Online mail they charege $3/user/month. A suite that includes Exchange, SharePoint, IM and LiveMeeting is $15/user/month. They provide SLA's on everything, not just mail like Google does with GMAIL. They also provide https support for everything vs. Google which only uses https for GMAIl. Details at http://www.mspmentor.net/2008/07/08/microsoft-online-services-saas-pricing-partner-strategy-announced/

  30. Hooray for Hazel by Anonymous Coward · · Score: 0

    The thing that bothers me is that Google Apps might be fairly reliable, BUT:

    1. Whenever thay have downtime, they don't want to come clean unless thay are forced to. This is not the kind of behavior that I want to see from my business partners. And they can yank the service completely without notice, which means that if any of our infrasructure lives on Apps, I get fired.

              1a. When Apps fails, I'm not told why, and there is nothing that can be done to mitigate future failures. No XP is gained.

    2. For servers, any individual member of a cluster can go down for a patch without affecting the integrity of the cluster, so the only downtime I can incur is due to infrastructure failures (hasn't happened yet) or admin stupidity (there have been a few instances of this, but nothing that broke more than a single server and merely degraded service). It's a tradeoff between a pretty good service that is "free", and an excellent service that costs money.

    3. My confidential data lives on their network. Google has a terrible history with privacy issues. In the event of litigation and discovery (in my industry, the probability of such an event approaches unity), I simply would not trust Google to behave in a manner consistent with our best interests. If we lose control of sensitive data that we otherwise would not have due to Google receiving a subpoena and disclosing EVERYTHING (too much) in an effort to keep their hands clean, then I have a Problem. If I use Exchange, well then, we have highly paid and very good attorneys who have our best interests in mind to handle things.

  31. Two problems by Target+Practice · · Score: 1

    Firstly, why the hell would you stick something important to you off site? We do our web development through an external agency, not only because people just aren't impressed with text editors anymore, but because it's not that mission critical to our business. Communication over e-mail is, and you would have better luck trying to remove our mail admin's comb-over than putting his servers in off-site care.

    Secondly, anyone who thinks two to three hours of productivity downtime per quarter are that extreme should go visit the helpdesk in their company sometime. Microsoft Office installs that went bad, crappy hardware, a smart phone that won't cooperate, Windows Vista: these things disable my cow orker's productivity just as effectively, and in most OS or Office cases for two to three hours. I know, it's different when the whole company is on it's knees, which brings us back to my first issue with these cloud demands.

    --
    There's a 68.71% chance you're right.
  32. I am losing in all cases... by mattMad · · Score: 1

    As someone who hasn't been able to access his home directory for the complete weekend due to some weird server hosting it at my company being down, I can confirm that relying on others sucks.
    Remembering the last time I had a hard drive die without me having done backups for a long time, I can confirm that relying on myself sucks as well.
    So I loose in all cases...

  33. YES, you can do it better than Google by CaymanIslandCarpedie · · Score: 2, Insightful

    Hmmmm..... not long after introduction Google apps have 15 hours of unplanned downtime. We have apps that have been deemed critical and have had zero unplanned downtime since introduction (knock on wood). Our system was designed for absolute maximum 1 hour RTO and 1/2 hour RPO. Thus far, we haven't had to actually use DR plan in real life, but tests show we beat those numbers.

    I'm sure Google "can" build better systems than I have, but like any other company they did a cost/benefit and decided what they have is good enough. For my company 15 hours down time isn't good enough for systems so we spent the money for a better system.

    So.... yes you can at least do it better than Google "has" regardless of if they "can" do better or not. That isn't to say hosted apps aren't good enough in some cases, but to say you cannot provide better if needed is a bit silly.

    --
    "reality has a well-known liberal bias" - Steven Colbert
    1. Re:YES, you can do it better than Google by BIGELLOW · · Score: 1

      I'd be interested in reading the statement from Google that said "what they have is good enough," or was that just an assumption or opinion on your part?

      Anything I have read that came from Google said that they don't think this is acceptable and are taking steps to be sure that this problem gets resolved for the long-term.

  34. The uptime percentage is very clear... by slk · · Score: 4, Informative

    The sign-up page for Google Apps Premier says you get 99.9% uptime. That's about 1/3 of a day downtime per year, or a couple of hours per quarter.

    Google seems to be managing to hit that 99.9% uptime, just not exceed it. VERY few in-house e-mail systems actually manage 99.9% uptime, especially when you consider scheduled maintenance and downtime (remember, Google's 99.9% is for all downtime)

    In fact, I have seen very few Exchange systems that manage much more than 99% uptime. However, for those organizations, there are other compelling advantages to Exchange.

    --
    ERROR: Null .sig, core dumped.
    1. Re:The uptime percentage is very clear... by afidel · · Score: 1

      99.99 uptime isn't that hard to hit, we've managed it over the last 2 years in our Lotus Notes environment and now that we have clustering to our DR site fully configured we should easily get 99.999+% uptime. The only downtime we have had in the last 2 years was caused by a bad dat update from our AV vendor that made the systems extremely slow but still answering user requests, took us a while before we pulled the plug on production and had them fail over to DR.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    2. Re:The uptime percentage is very clear... by Slashcrap · · Score: 1

      99.99 uptime isn't that hard to hit, we've managed it over the last 2 years in our Lotus Notes environment and now that we have clustering to our DR site fully configured we should easily get 99.999+% uptime.

      You're proud that you manage to subject your users to Lotus Notes 99.99% of the time? You sick fuck.

  35. First downtime I have seen. by Anonymous Coward · · Score: 1, Interesting

    We use Google Apps for our email hosting. We use email all day long, especially because many of our automated processes during the day kick out emails with various status reports.

    What happened last week is the first time since we began using it (1 year ago) that I have not been able to get into my google mail. I'd say that's not too bad.

    And further, I've been using gmail since it was released 4 (?) years ago, and I can't recall a single other time I haven't been able to access it.

    That's pretty darn good uptime.

  36. Why blame Google ? by billcopc · · Score: 4, Insightful

    I love being the asshole, but let's be honest here: how many in-house systems actually deliver better uptime than Google ?

    Not that many. If they did, all us sysadmins would be out of a job. Apps are not perfect. The fact that you can pay Google a few pennies to manage your email, even with some downtime, makes it several orders of magnitude cheaper than an in-house solution for most people.

    Give them a break, people can survive without email for a few hours.

    --
    -Billco, Fnarg.com
    1. Re:Why blame Google ? by pleasegetreal · · Score: 0

      Well, obviously you haven't worked in many corporate environments of any size. Our Exchange/Outlook cluster once went 4 years without any unplanned downtime. For companies of any size that depend on e-mail (and practically all do), hours of email downtime is a major disaster.

    2. Re:Why blame Google ? by ozphx · · Score: 1

      Handling your own systems means you usually get to choose those hours, excluding cockups.

      If Google decides to do 3 hours of downtime in the middle of your national conference then you are probably totally screwed, and likely too small for Google to give a flying fuck about.

      --
      3laws: No freebies, no backsies, GTFO.
    3. Re:Why blame Google ? by billcopc · · Score: 1

      Maybe I'm not enough of a capitalist, but I figure if email goes down, you can always grab a phone and call the person if it has to be done RIGHT EFFING NOW.

      Actually, the disconnect probably comes from the fact that I'm extremely easygoing about many things. If I don't have email for 4 hours, well whatever... I'll do something else and catch up later.

      --
      -Billco, Fnarg.com
  37. Migrated in Dec 2007 by Anonymous Coward · · Score: 3, Interesting

    I migrated my company of 80 users to Google Apps hosted email about a year ago, and yeah, sometimes there has been interimitent issues. People want to use it like Exchange via IMAP, but there are quirky issues, like Thunderbird sending the wrong delete command, Thunderbird somehow corrupting the user's password (the only way to correct is to login to the user's account on the hosted Gmail site), etc. So there definitely are some quirks sometimes.

    That said, it's free. Somebody a few posts back posted the cost of an RHEL install with server costs etc. Using Exchange, the price increases even moreso (license costs, CALs, etc.). Ultimately, you're getting a hosted, web-based email solution with the capability for shared calendars and document collaboration, all for absolutely $0.00.

    Free vs. $20k+ solution? In my oh-so-humble-opinion, users can deal with (and quite frankly, should continue to periodically expect) some downtime.

  38. Speaking of Gears by Anonymous Coward · · Score: 0

    Google Gears is supposed to help with all of this, and doesn't Google make servers that you can install at your business?

  39. Nothing wrong with hosted apps... by SCHecklerX · · Score: 1

    just host them in your own datacenter, not at google. This makes administration and scaling pretty much effortless, I would think. I assume that google sells an appliance for exactly this? If not they are missing a huge opportunity.

  40. Google Apps are actually quite good by Anonymous Coward · · Score: 2, Informative

    I'm a professional writer and a recent convert to Google apps. I've been using Gmail since its inception for my business and personal email, and have recently been investigating using Google Docs. The word processor started off as little more than a text editor but nowadays is pretty balanced in terms of features.

    The main benefit is that it's all cross-platform, and I haven't got to worry about where my docs are stored (no messing about with a USB key stick, for example). I can access my work from any computer, running virtually any OS (provided Firefox is installed), virtually anywhere in the world.

    I really do think this is one possible future route for productivity applications on a computer. When viewed in this light, online apps are very compelling.

    The only issue is, as mentioned, outages. Every now and again (maybe twice a year), Gmail is inaccessible. If Google Docs is inaccessible, I'm stuffed and can't work. This is why I use Google Gears to hold local copies of docs, but this is still in beta testing. But a local backup is, of course, always a good idea.

  41. Re:You can't do it better than Google (no troll) by teknopurge · · Score: 4, Interesting

    Our mail platform has beaten google in uptime and security "bugs" for the past 40 months. Why? I attribute it to using proven technologies and not everyone wanting an account being able to get one: we charge every system user. You would be surprised how much this cuts down on spammers/excessive usage.

    Google has had their mail in beta for years. The last time I checked SMTP was ratified as an RFC over a decade ago.

  42. You don't get bread with one meatball by Anonymous Coward · · Score: 0

    It's free or nearly free. What do companies expect they're getting for free?

  43. Must work in small shops by bigtallmofo · · Score: 2, Interesting

    With those you know WHEN it's going to happen. You can schedule it for out of hours.

    The position you're touting is completely foreign to me. I don't want to discount it, I just think it must be because you work for a small company and don't have any experience administering widely used web sites.

    Even for medium sized companies, I have to imagine that "out of hours" are few and far between.

    --
    I'm a big tall mofo.
    1. Re:Must work in small shops by Anonymous Coward · · Score: 0

      He is talking about SBS aka Small Business Server. Out of hours is generally late Saturday night for my clients.

      PS With SBS, redundant Exchange install and a redundant domain controller, you can reboot with 0 downtime (unless you use some of the other SBS apps - most of those can be made redundant as well).

    2. Re:Must work in small shops by CaymanIslandCarpedie · · Score: 1

      Size, scale, criticality of the systems don't matter. If it is planned you can take steps to mitigate the risks, if it is unplanned you cannot to the same level simple as that. That isn't to say you cannot mitigate risks associated with unplanned down times with redundant systems, etc but it it is planned you can always mitigate further ensuring all critical staff are on site, etc, etc.

      Down time is down time, but the risks associated with down time can be mitigated to different levels depending on if it is planned or unplanned. Granted if you are just dealing with some generic web sites perhaps the risk of random sub-minute downtimes aren't major business risks for you. However, if you move up to larger more critical international financial market systems these are major issues. Even with these systems redundancies upon redundancies the unknown is always more of a concern than the known which you can plan for.

      --
      "reality has a well-known liberal bias" - Steven Colbert
    3. Re:Must work in small shops by iamhigh · · Score: 2, Interesting

      I hear this quite a bit on the internet. It seems people that work in large environments don't realize how many people work with small computer networks. Half of the US work force works for a company with under 500 employees. You can check that here Census info. Since there are more small companies, and fewer large companies, there is a higher percentage of the total small/medium (under 500) workers that will be in a decision making position. It is also very likely that these smaller companies are the kind of business that can have all their systems shut down for a weekend a couple times a year.

      My anectodal evedence is that I current provide IT services for 3 places. All in that under 500. 1 is 24/6, the others are M-F 8-8. However, they are all manufacturers in some way. So that may also have something to do with it.

      --
      No comprende? Let me type that a little slower for you...
    4. Re:Must work in small shops by ozphx · · Score: 1

      Thats exactly right. In addition you can plan your downtime around your requirements.

      I, for one, wouldn't welcome the dubbing-my-objections-to-downtime-next-week-as-unimportant google overlords :(

      --
      3laws: No freebies, no backsies, GTFO.
  44. what this really seems to be about by nimbius · · Score: 2, Interesting

    is in-site and outsource. failed in house tech tends to put alot of pressure on the in house support staff hired to maintain the tech, but im thinking most management is wondering if they could withstand the black eye of losing something like this if they hosted it at google



    this would be much less of a concern if they open sourced the entire group of apps, and offered hosting as an option. IT Managers could evaluate it on a more level cost benefit ground.

    i guess another question, is this really something that should be web based?

    --
    Good people go to bed earlier.
  45. Google vs. MSFT by notaprguy · · Score: 1

    Unlike in search, hosted services for businesses is an area where Google is going to be playing catch-up with Microsoft for a long time. Google is attractive to individuals and some small businesses and a very small number of bleeding edge companies but most will choose to either stick with their on-premises software or will look to vendors like MSFT and IBM who have more enterprise experience. Microsoft is offering a "beta" of hosted versions of Exchange, SharePoint, Office Communications (IM, presence) and LiveMeeting now (http://www.mosbeta.com/Welcome.aspx) and already has some big companies using it including Coca-cola. Google's offering is actually pretty compelling in some ways. It's cheap to get into ($50/user/year although that doesn't include a lot of things that most companies would want such as directory integration, support for smartphones etc.). Google Apps are simple and easy to use. While they don't have a lot of features that many companies will want, for task workers with limited needs they made work. But their biggest gap - which they probably have no intention to fill - is that they ONLY offer hosted services. Microsoft can offer companies a choice of hosted, on-premises or a mix. Want users at HQ to use on-premises mail (Exchange)? No problem. Want remote workers to use a hosted version? No problem. Want integration with your on-premises Active Directory? No problem. Want to give users a choice of browser-based interface or Outlook for mail? No problem. This flexibility is something that will ultimately win over a lot of customers who consider Google.

  46. trusting a third party by NynexNinja · · Score: 1, Informative

    Based on my own personal experiences with dealing with google, I would never trust anything besides their search engine... If you have ever tried to make contact with google staff about a real issue, you'll soon notice there is no customer service, no help desk, you will be greeted by an arrogant 16-year-old who tells you to goto the google.com site to resolve whatever issue you're calling about. Also, if you've ever tried using Google Checkout (what a joke), they put arbitrary holds on the money and attempts to resolve issues (again, no customer service here) take weeks and months. Google has a great search engine, but thats about it. Don't put your eggs in one basket by using anything that they put out. They're good at writing crawlers and indexers, not good at much else.

  47. YouAreNASA? that's impressive! by Anonymous Coward · · Score: 0

    IANASA = ?
        I am NASA?
        I am not a System Administrator?
        I am not a Secret Agent?
        I am not a Secret Acronym?

  48. Re:Second guessing? by Anonymous Coward · · Score: 0

    > So one ad-laden website has a definition? Wow, yeah, you *must* be right.

    All the dictionaries I've checked contain both definitions.

    Suck it up - he *is* right, and you are wrong. Just admit it and move on.

  49. Re:Incredible Expectations? by BIGELLOW · · Score: 3, Insightful

    The part that is being misunderstood is simply this. Instead of just complaining about Google Apps... compare it to the alternatives.

    How many companies rely on Microsoft Outlook with Microsoft Exchange Server? When you offer an application or suite to the whole nation or WORLD, and campaign for its use - then YES, you do need to keep a very near-0 downtime to be really successful.

    Except, Microsoft Exchange (while often reliable) does have its moments. Sometimes, just from getting clogged by tons of spam, it can come to a crawl. The server can become unavailable to do network issues. Microsoft Outlook has a tendency to run slowly on some machines, or crash regularly. Expecting ANYTHING that uses computers to work 100% perfectly all of the time, although desirable, is completely unrealistic.

    I don't think the people here are saying "expect downtime and just deal with it." What is really being said is, "when MS Exchange goes down... or there are internal network hiccups... or when Outlook locks up on your machine... complain loudly on the Internet instead of to your local admin... that way, the world can get a real comparison between Google Apps and the alternative."

    The only reason Google Apps seems like the "bad one" here is because people go posting on blogs and news sites about it. Why? Because it's news... it's rare... it's not what people expect of Google. When Exchange server craps out, Outlook locks up, your computer gets a blue-screen-of-death, a hard drive goes bad, a router needs restarting, power goes out to the building, a UPS battery goes bad, etc, etc, etc... nobody bothers posting this on blogs or news sites because, well, it's an every-day occurrence... it's not exactly news.

    Then, when you compare systems that are "always up and available 24/7, can be easily accessed from outside of the company without a complicated VPN, have admins that don't gripe if they are taking up dozens of gigs of storage, with the capability of searching through millions of emails in a fraction of a second" to Google Apps... you'll likely notice that these other systems (with you take into account the cost of the servers, routers, admin hours, electricity, software, etc) cost much much more than $50/year per user.

    What's happening here is people are comparing Apples to Orangutans and are creating unrealistic expectations. If these companies really have that much cash to just waste on something they have been brainwashed into thinking is perfect, then they're next likely step in these economic times is to lay off some of their admins because, after all, why do you need admins if the systems are perfect?

  50. Uptime still better than at most places by ianmh · · Score: 2, Insightful

    I don't know about anyone else, but the fact that downtime is such a shock on Google is testament to how great the service usually is. Most companies I've worked for don't have an up time record that could even come close to Google.

    --
    www.ianhoar.com My blog about geeking out.
  51. Re:XKCD about M$ Protection. by Anonymous Coward · · Score: 0

    LOL, enterprise class funny.

  52. NOT a "big win for Microsoft"... by macraig · · Score: 2, Insightful

    ... but rather a big win for locally installed and controlled "personal software", as well as - HOPEFULLY - another loss for the evil forces of greed trying to indoctrinate users to the concept of a software subscription model.

    Selling software as a subscription is the REAL reason why companies like Microsoft, Google, and so many others are experimenting with Web apps. It's their latest attempt to re-brand software as "content" and convince people to pay for it every month, just like they do cable TV. If they succeed, software publishers will be making far more profit than they do now, and their accountants will be boastful about how regular and predictable the cashflow is.

    Just say no to Web apps and every other attempt to sell software as subscriptions.

  53. Then why not Linux? by mangu · · Score: 4, Insightful

    - Despite rumours to the contrary, most of Microsoft's enterprise-level software is pretty solid, unless it's a 1.0 or 2.0 release.

    Linux has been rock-solid from version 1. Version 3 isn't being planned yet.

    - Our Exchange implementation was engineered by someone who knew what he was doing, and is now supported by someone who knows what he's doing.

    The main complaint against Linux is that it requires someone who "knows what he is doing". If the same is required of Microsoft solutions, then why not just use Linux?

    1. Re:Then why not Linux? by Cramer · · Score: 1

      For starters, linux is not a "Microsoft enterprise-level software" -- it is something completely, and entirely different.

      It's easy to find thousands of people who call themselves "exchange admins", and it's very likely they'll all come waving a peice of paper saying they're "certified". The problem is, more often than not, they're worth less than that paper. The linux camp is similar without the thoundands of paper wavers, as there aren't that many certifications -- and most real linux people won't touch them. (certs are for people who want decorations.)

      Bottom line: It's often very difficult to find someone truly qualified for what you need done.

    2. Re:Then why not Linux? by Anonymous Coward · · Score: 0, Insightful

      Linux has been rock-solid from version 1. Version 3 isn't being planned yet.

      Name an active MS product that's been on version 2 for 12 years, and you might have a point.

    3. Re:Then why not Linux? by discogravy · · Score: 1

      Linux has been rock-solid from version 1. Version 3 isn't being planned yet.

      Saying that linux is at version 2 is disingenuous at best. If you're going to play at that, let's start by saying that Linux (the OS) doesn't /do/ mail. Exchange (not an OS) would be competing against a variety of MTA and mailbox formats and protocols -- sendmail, qmail, postfix, exim, mbox, imap, pop3.

      PS if you think anything running the linux kernel v 1.0 was rock-solid, chances are you weren't using it then (but you're welcome to rock it like it's 1994 again: here. NB that only single-cpu i386 machines need apply; nothing else was supported until 1.2 in 1995.)

    4. Re:Then why not Linux? by kimvette · · Score: 1

      See, the thing is, with a Windows enterprise you can get away with a paper-MCSE providing someone who knows what they're doing installed and deployed it all and set up the backup/recovery regimen, along with writing some custom offline maintenance scripts along with scheduling accompanied downtime windows. Your paper MCSE needs to do little more than create active directory accounts, add computers to the domain, and maybe tweak a login script or answer RTFM questions all the time. Providing it never breaks, your average void with a pulse can "administer the network." When it breaks, you're SOL. Hell, even with an EXPERIENCED Windows admin (MCSE or not, although most good Windows admins seem to be not MCSE-carrying folks) you often have to resort to reformat/reinstall when Windows does break, and may God have mercy on your soul if you don't have the configuration well documented because restoring is a pain in the ass if you're at different patch levels. Oh sure it might work if the patches are different but there is good chance of encountering an instability sooner rather than later.

      Ever try to repair an Exchange Info Store when eseutil and isinteg refuse to do anything with it? Ever try to force SQL Server to mount a hot-backup or a broken database file even after the tools refuse to do it? I have -- successfully on both counts. It's a pain in the ass though, and no paper MCSE is going to be able to figure out how to do it, and if they call Microsoft they would tell you reformat/reinstall and push data up from pst/ost files.

      Now, when it comes to Linux - maintenance, backup, and even much of recovery can almost always be done live. Maintenance windows? Scheduled down time? HA! Adding users, computers, etc. to the network? A little more tricky than Windows. What distro are you on? Which protocol are you using? NIS? LDAP (or SMB, LDAP's low-functioning bastard cousin with Down's Syndrome)? NFS? Which printer protocols are you using, and if supporting multiple platforms, how are you making it possible to map the printers on Windows clients and where are the drivers located? Again, is it SMB? LPD?

      Chances are when you're all set up, it won't break. If it does break, it's usually due to hardware (or firmware) and not the OS. Backup/Restore on a Linux/*nix system is FAST and nearly painless. However if a system DOES go down due to software, even if rooted, it's often possible to repair the system without going to reformat/reinstall or reformat/restore. Even if a database or mail store breaks you can nearly always repair and remount it. Depending on the GUI you might get by with someone who is the equivalent of an MCSE, but would you want to? Chances are if you have a good unix admin, almost all routine tasks will be fully automated and all he or she will have to do is read crond log file/summary emails in the morning to check for problems, and chances are those emails will include RAID and/or SMART health as well so problems can be dealt with proactively -- oh, and also chances are your databases were probably integrity-checked and shrunk/optimized overnight as well, with no down time required.

      SMARTD is available for Windows, along with hacks to query some RAID controllers. What are the chances that your paper-MCSE admin is going to even know what S.M.A.R.T. is, let alone think to proactively keep an eye on it?

      Sure you can get by with a cheaper admin on Windows, but again would you want to?

      --
      The Christian Right is Neither (Christian nor right). See: Matthew 23, Matthew 25, Ezekiel 16:48-50
    5. Re:Then why not Linux? by ducomputergeek · · Score: 1

      Because linux can't run exchange. And no one has yet to come up with something in the OSS that can easily replace it. I used to be more anti-microsoft as well, but the past few projects it seems like we've been deploying PHP/MySQL apps on Windows 2003 servers. And I have to admit that we've had no problems what so ever.

      Also, for most businesses it is far easier to find someone that can deal with the MS setup. Where I live now, there are 3 IT services firms. All three are Microsoft solution providers. If you don't like one, you have two more to choose from. In the Unix world, there is me....and me. I do the Linux, Unix & Mac consulting for all 3 firms when needed.

      So if one of their techs gets hit by a bus tomorrow, they have replacements. If a medium sized business's windows based IT person gets hit by a bus, they can go to one of those 3 firms at least for a while until they find a replacement.

      If I get hit by a bus, the clients I support are screwed. There are a couple other Linux enthusiasts around, but none with over 10 years of experience dealing with various unix platforms.

      --
      "The problem with socialism is eventually you run out of other people's money" - Thatcher.
    6. Re:Then why not Linux? by kimvette · · Score: 1

      The linux camp is similar without the thoundands of paper wavers, as there aren't that many certifications -- and most real linux people won't touch them. (certs are for people who want decorations.)

      Actually I've considered getting certs for both RedHat and Novell, but purely for my own edification. I've been using Linux off and on since it was a 7-floppy install image (and it's been my only OS since 2003 or 2004, since then I've only booted Windows for games and once for data recovery from PST files), and I may know quite a bit and run many different distros at levels ranging from home to small business and up to enterprise, but I do not know everything - not by a long shot. So, the certs may be useful for my own satisfaction. I wouldn't consider them the basis to get a job (I hope to never work for anyone else again in the future anyhow) nor a basis for hiring anyone. There are two things I consider important in the hiring process, in the order of importance:

      1. Thought process: How are your problem-solving skills (i.e., how good of an engineer are you) and how do you use your resources (man pages, books, search engines, etc.)

      2. Experience: what have you worked with?

      Now, #2 is less important than #1 and here's why. If you are a good engineer, you can learn any tool. You can learn how to put together a network, or to write bash scripts, or whatever. Experience is less important because without #1, even if you've created new accounts a thousand times, that doesn't mean you know to read .bashrc or check permissions if a user has problems logging in, or to check .ssh/* and/or /etc/sshd/* if a user has problem sshing out or a problem logging in remotely.

      Actually there is one more criteria I consider more important than both #2 and even #1: the ability and integrity to say "I don't know." When I've interviewed network admin candidates I'd put together a list of random but very difficult/esoteric networking problems, and on the spot I'd rule out anyone who tried to make it up to sound intelligent. I'd consider the ones who knew or figured out the solution, but for them I'd pick another problem and run that by them. The ones who said "I don't know" would receive strong consideration; the ones who said "I don't know, but I'd RTFM or search knowledgebases and search engines" would definitely get the second interview. The network admin we hired for that position was one of those people who knew how to think, how to research, knew his stuff solid, but on top of that, he knew how to admit "I don't know." The ability to admit not knowing something is far more important than most PHB types realise.

      Oh, and by the way: the sysadmin I hired for that company was not an MCSE and knew more than every MCSE I interviewed except for some of the mundane things like "what does PCMCIA stand for?" -- who cares if you can memorize what an acronym stands for if you don't know how it works or what it's used for or how to troubleshoot the devices? In that respect certs are worthless; they, like school, teach you to memorize; not how to think.

      Logic is not taught in our schools. Thinking for yourself is not taught in our schools. That is why we have become weak in the sciences and ultimately economics.

      --
      The Christian Right is Neither (Christian nor right). See: Matthew 23, Matthew 25, Ezekiel 16:48-50
  54. Whaddya Want For Nuthin? by TinPigeon · · Score: 2, Informative

    I'm quite happy with Google Apps and all the uncertainty that comes with beta applications. I give credit to Google for keeping as much uptime as they do for such a robust, free suite. Sure, I've seen a few outages with Google. But I never lost any mail as with MobileMe. I actually dropped my MobileMe account in favor of Google Apps. Uptime was one reason, and so wasn't the fact that MobileMe mail isn't searchable beyond subject line. Occasionally losing connectivity is one thing. Paying $99/year for for that sort of service is quite unreasonable.

  55. Google is not the Internet by Anonymous Coward · · Score: 0

    Hosted apps are convenient, but if people are getting paid on performance (commission etc), downtime costs EVERYONE money.

    I think a lot of what google sells is b.s. - 3 years ago, it worked, I don't think google will enjoy as much success online in the coming 3 years. They see this - it's why they are getting into the mobile space. They have to.

    With this mobile space, they may release an ad sponsored app server because that's further growth for them.

    Oil has gone up, do you think Internet based services will go up? Nope, they'll come down - people expect them to, or won't pay for them because there is so much free shit on the Internet nowadays with geek trying to beat geek.

    Foundation supports foundation - so pick your foundations carefully.

  56. I did by Anonymous Coward · · Score: 0

    I JUST switched our small business's email from a real second rate email host to Google apps. The outages affected a small subset of emails, which in our case happened to be a mission critical email address for almost 2 full days.

    I'll say this, our boss was NOT happy, and I was taking my vacation at the time. I left them all the information necessary incase something should happen. Even the google premier phone-line wasn't able to help them out. (Downtime is downtime). I tried to advocate to stick with them, although my boss isn't having it, and now I'm stuck switching email providers again.

    Google's loss, not mine.

  57. Re:Enterprise Class Hardware. by Anonymous Coward · · Score: 0

    > Is it really good or are you some kind of M$ munchkin that
    > has to smear hardworking administrators to make up for the
    > M$'s horrible reputation.

    Wow, who modded this up 'interesting' so it shows up in the page view...?

    I swear Slashdot is really going to the dogs lately.

  58. Forget the service level; consider current law by Flexagon · · Score: 1

    Until this is resolved properly, there is no way I will use an e-mail system that wants to keep my e-mail on its servers (Gmail tries hard to discourage us from deleting our e-mail, even after downloading). This situation has been an open sore for years, and not just for Gmail. It seems that the best that can be done is to limit the time on in-transit servers to the bare minimum. For me, that's a hard prerequisite before any service level guarantee by an online provider. The law (or its interpretation) has to change first.

  59. Re:XKCD about M$ Protection. by Anonymous Coward · · Score: 0

    Twit, my friend, I don't think you understand what it is that they are doing wrong.

  60. Re:XKCD about M$ Protection. by ozphx · · Score: 1

    Good point that applies for any OS.

    I'm starting to realise why most people around here think you are a retard, and I'm not even trying to get involved in /. drama.

    Get a job. You'll have less time for trolling, and the amount of software you can afford will increase.

    --
    3laws: No freebies, no backsies, GTFO.
  61. Re:Enterprise Class Hardware. by ozphx · · Score: 1

    Are you $uggesting that Google runs off a single commodity box?

    Oh they use a cluster of thousands of machines, and its more reliable than a single server. Funny that, but hey, lets ba$h m$!!!

    lol$

    --
    3laws: No freebies, no backsies, GTFO.
  62. Re:XKCD about M$ Protection. by Anonymous Coward · · Score: 1

    I use Windows without an AV, and don't get any malware. If you've used Windows and got infected, you were doing something wrong. If you haven't, you're trolling.
    But we only need to look at your user name to answer that question.

  63. Email is NOT Critical people. by lewko · · Score: 1

    Get a grip. 99.999% (there's your five nines) of email is just not that critical.

    It's amazing how many people will insist their email server is a mission critical system, and yet it goes down for a day or so and poof.... They *don't* go out of business! Fancy that.

    Pick up a telephone or (heaven forbid) talk to someone in your office face to face. There's a really good chance you'll actually get more stuff done that day.

    (Yes, I know Google Apps is more than email, but what I said about email probably applies to manyof them as well).

    --
    Do you or your partner snore? - Visit www.snoring.com.au
  64. *Yawn* by infochuck · · Score: 1

    So what? The idiots got what they deserved. Anybody who thinks this is a good idea is a complete moron. "Gee, store all of my data at a remote location where any of a half-dozen places having an outage can keep me from my business? Where do I sign?"

    Oh, the guy in the article beta-tested for nine months. Surely, if is doesn't go down in nine months, it'll be up forever without a hitch!

  65. Re:Incredible Expectations? by King_TJ · · Score: 1

    Very valid counter-argument, except I think a company trying to implement something like your example of MS Exchange, in a near 0 downtime secnario, would take into account that the product itself is going to potentially go down once in a while. Like you say, it isn't really "news" that Microsoft Windows-based server apps aren't 100% rock solid reliable.

    I would assume a "proper" implementation would involve numerous servers running cloned copies of the environment, with the ability to do hot-failover in the event of any component, hardware or software, failing.

    Truthfully, I've never worked for an employer who was really interested in achieving "near 0" downtime, seriously enough to spend the money on it that it required. But I believe most people opting for that would be looking more at "big iron" minicomputers or mainframes from the likes of IBM ... not Intel x86 based servers running on microcomputer architectures.

  66. Re:XKCD about M$ Protection. by Anonymous Coward · · Score: 0

    If you need an AV you are doing something wrong. Get a real OS and you get rid of most of your problems.

    Go, Go, Gadget Total Reading Comprehension Failure!

  67. Fog computing by HTH+NE1 · · Score: 1

    The outages, which affected both Gmail and Apps, 'could serve as a deterrent to some IT and business managers who might not be ready to ditch conventional software packages that are installed on their servers,' according to the article.

    Split the difference: run it locally, but over your LAN instead of the WAN, and call it "fog computing". The fog system occasionally syncs with the cloud system as available.

    --
    Oh, say does that Star-Spangled Banner entwine / The myrtle of Venus with Bacchus's vine?