Amazon, MS, Google Clouds Flop In Stress Tests

Eponymous writes "A seven month study by academics at the University of New South Wales has found that the response times of cloud compute services of Amazon, Google and Microsoft can vary by a factor of twenty depending on the time of day services are accessed. One of the lead researchers behind the stress tests reports that Amazon's EC2, Google's AppLogic and Microsoft's Azure cloud services have limitations in terms of data processing windows, response times and a lack of monitoring and reporting tools."

Comments

what the fuck is services engineering?

[Desler]

Anna Liu, Associate Professor in services engineering at the UNSW School of Computer Science told iTnews she was excited by Cloud Computing as it could potentially enable organisations to "outsource a certain amount of their risks and costs and tap into new economies of scale."

Sounds more like she has a degree in buzzword engineering.

Cloud Computing? Why?

[Ralph Spoilsport]

I still don't get it. Terabyte drives cost as much as my bi-weekly beer budget, and less every day. Computing power is off of Moore's Law, but is still increasing with multicore and multiprocessors. My computer doesn't have to be hooked up to the interweb to work, nor does it require a subscription to some website to keep rolling. If I want access to the web, I can get it, but that's only a few times a day when I need it.

So, what exactly does "cloud computing" bring to the table for me?

Not much as far as I can see, other than a new crop of buzzwords.

Re:Cloud Computing? Why?

[moon3]

Cloud = "Hosting for the noobs"

The provider is managing everything for you automatically, the Cloud service takes care of pretty much everything including security so it is manageable even for non-technical dudes.

Re:Cloud Computing? Why?

[Sockatume]

Essentially, it allows you to treat any net-connected computer as a dumb terminal with web services acting as your actual computer.

Re:Cloud Computing? Why?

[segedunum]

People who ask this have generally never hosted anything major before. The attraction is that it decouples your applications and server instances from real hardware and even from the specific virtualisation platform you would otherwise be sitting on. This means that a hardware failure will certainly not affect you in the same way and neither will a failure in a comparable virtualisation platform. It's on a completely different scale, and certainly with Amazon you can spread yourself across different geographic locations. I've seen many Xen VPS platforms have to be rebooted periodically for things like kernel updates and if you're dealing with real hardware then you start getting into failover and drdb, which is far too much of a pain for most development companies to worry about. You just want to host your applications somewhere. Trust me. You start worrying about this stuff very quickly otherwise.

Additionally, what makes it a 'cloud' and not just a vanilla virtualisation platform is that your storage itself is then decoupled from your machine instances themselves, as well as the hardware, in an easy way without having to faff about with clustered storage set ups yourself or through a hosting company. This makes your machine instances easily disposable and allows for pretty easy recreation of production environments as a failover or for testing and development.

Essentially, that's what's attractive about it in layman's terms. It makes it far cheaper and far less hassle to get hardware and storage redundancy when you start having to worry about it, but large companies are not going to be outsourcing their critical stuff off site with it. That's just insane. It's just a pity the whole thing has become filled full of shit by people who don't know what they're talking about like that Services Engineering nutcase in the article who is probably being paid way too much money. The article doesn't even tell you what limitations they found in any detail.

Re:Cloud Computing? Why?

[Lord Ender]

I'm developing a JRuby app for Google App Engine. I'm doing it because as a lone developer, I don't have to worry about anything but my code. I will never have to wake up to troubleshoot a network problem, OS issue, Apache oddity. I won't have to hire networking, DBA, or systems administration staff. And if my app hits off big, I won't have to re-engineer anything to make it scale. It will scale automatically.

I've played the role of network engineer, DBA, and sysadmin in the past. Now I can focus on my application.

That said, appengine is certainly not for all sorts of apps. It only supports a subset of SQL (no joins), I'm sure it won't meet the requirements for payment card processing or anything like that, and my APIs are limited. But for a good chunk of web apps, developing for the google cloud has huge advantages.

No Tools?

[Thomas Charron]

Google AppEngine has data reporting to a ridiculous level. This article doesn't even publish any REAL data.

I really HATE commercicles, small articles which make a claim, and then say, 'stay tuned!'.

Someone fire the author. The last paragraph reads:

"Liu will present the findings and offer developers advice on how to build robust applications to withstand the cloud's limitations at the Australian Architecture Forum in Sydney on Monday, August 24."

Wow, I at least they admit that this article has no REAL data in it, and THAT data will be released on Monday.

Re:I'm Shocked! SHOCKED!

[jabjoe]

I can't help thinking this is just thin-client + mainframe again, and just like every other time the model has come around, it's being pushed as the future.

Re:I'm Shocked! SHOCKED!

[TheRaven64]

Not really. A mainframe gives you:

• Control over your data.
• Very high availability with multiple redundancy at every level and hot-swappable parts. Most modern mainframes can have a CPU fail in the middle of a job and no one notice except the operator who is paged to plug in a new CPU if he wants the machine to return to full capacity.
• Insane I/O throughput rates, with dedicated I/O controllers so you can keep the CPU saturated with data at all times.
• A big fat support contract which lets you wake someone up in the middle of the night and make them fix your problems.

I don't really see how this is similar to the cloud at all.