Amazon, MS, Google Clouds Flop In Stress Tests
Eponymous writes "A seven month study by academics at the University of New South Wales has found that the response times of cloud compute services of Amazon, Google and Microsoft can vary by a factor of twenty depending on the time of day services are accessed. One of the lead researchers behind the stress tests reports that Amazon's EC2, Google's AppLogic and Microsoft's Azure cloud services have limitations in terms of data processing windows, response times and a lack of monitoring and reporting tools."
Cloud free and lightning fast!
Us yourapeeins try to act superior to you stupid Americans because unlike you we stink of ass all the time and our teeth our rotten.
Anna Liu, Associate Professor in services engineering at the UNSW School of Computer Science told iTnews she was excited by Cloud Computing as it could potentially enable organisations to "outsource a certain amount of their risks and costs and tap into new economies of scale."
Sounds more like she has a degree in buzzword engineering.
I assume that they are running Windows on their 'cloud' platform, yet the performance is obviously very poor and doesn't scale well - something that Linux users have been pointing out for years, much to the anger of the legions of Microsoft shills who post here (no doubt one will turn up and reply to this very thread!). So, its pretty clear from this report that Linux is winning in the 'cloud' space, I wonder if Windows 7 will do anything to change that?
you get what you pay for - news at 11.
I'll be sticking with own servers in a colo thanks.
I wonder what the implications will be for Wave? Real-time updates across multiple servers present very similar challenges to cloud-computing. If the relevant protocols have the same problems then it raises doubts over the scalability of the Wave protocol.
Meta will eat itself
So, what exactly does "cloud computing" bring to the table for me?
Not much as far as I can see, other than a new crop of buzzwords.
Shoes for Industry. Shoes for the Dead.
Yeah, I'm going to allow my computing and data storage to be dependent on large numbers of strangers, some of them hostile to me. No thank you. The Internet is handy for looking things up on and sending messages to people. Low-importance collective activity like SETI? Fine. But it is dangerously vulnerable for critical operations. I hope the people in charge of things like national electrical infrastructure are aware of that...
I piss off bigots.
Well, not that shocked....
I foresee a unplanned and totally random 'Software Audit' at the University of New South Wales in the near future!!!
Google AppEngine has data reporting to a ridiculous level. This article doesn't even publish any REAL data.
I really HATE commercicles, small articles which make a claim, and then say, 'stay tuned!'.
Someone fire the author. The last paragraph reads:
"Liu will present the findings and offer developers advice on how to build robust applications to withstand the cloud's limitations at the Australian Architecture Forum in Sydney on Monday, August 24."
Wow, I at least they admit that this article has no REAL data in it, and THAT data will be released on Monday.
-- I'm the root of all that's evil, but you can call me cookie..
I only have 5 Apple .mac/.me accounts and even Apple knows that the rollout was so flawed that they gave us extra time on our contracts for the deficiencies.
Apple is getting better, but ISPs are choking upload speeds (even my business account that I pay $200/Mo for 6 megabits up and down) shows far slower data rates up over down to/from Apple.
Buh? As far as I can tell, Google doesn't have a platform called "AppLogic". Perhaps they were referring to App Engine? And it's not even the editors' fault this time -- TFA has the terms wrong too. That really inspires confidence...
My Systems
it would be an offense punishable by ban if when referring to the cloud, members didnt roll their eyes and make fart noises.
cloud is becoming less and less of a "news for nerds" thing because its surrounded by nothing but business jargon instead of tech talk. outsource your risks?? I still manage the same servers, in the same datacenter, with the same network but for some reason its been abstracted to "cloud" computing. you aren't outsourcing any new. theres still a guy you call at 5 AM when the mysql servers arent replicating properly, or the amanda job is hung.
a PRIME example, this article has NO NUMBERS!! no quantifiers or methods by which they tested the aformentioned services. they only say things were bad when one group of university students half a world away tested them. the university doesnt even mention the study!
and at seven months of presumably unauthorized stress testing, i wouldnt be surprised if google and amazon network engineers met over a few pints of beer and decided your asinine experiment deserved a bit of traffic shaping.
Good people go to bed earlier.
Yes, there are issues, and those companies are being driven by free market demand for their cloud products to continue to improve them. They have the resources and the will to make the clouds better and better over time. Would you be able to keep up if you decided to establish your own data center for your own needs? I don't think so.
WOW. a study that shows that clouds are just as difficult to manage as enterprises. what a bloody surprise. its not like we havent been having the same problems since the dawn the distributed computing platform when the Mainframe model got completley whacked. and I've been hearing all sorts of things form executives recently about how we should move to cloud and how they been promised it'll be so much better and so much cheaper.
From the article:
The response times collated in Sydney were tested against measurement instruments loaded onto the cloud platform to isolate whether delays were attributable to the service itself or the latency involved with accessing US-based data centres from Australia.
We all know that all of Australia share limited pipe to outside world.
Of course it will clog during the business peak hours! It's like reviewing the sports car by driving in traffic jams around city and then writing an article that sports cars are slow!
My computer doesn't have to be hooked up to the interweb to work...
Since you are not a candidate for Internet-connected, virtualized, on-demand scalable computing resources (aka "cloud computing"), you are not attracted to cloud computing's value proposition.
For those of us who need these things, vendors such as Amazon, Microsoft, and Google are building services we definitely want to buy. Amazon's simple storage service, for example, had 40 billion objects in its repository as of February, 2009.
"We receive as friendly that which agrees with, we resist with dislike that which opposes us" - Faraday
This is Google. Didn't you get that part? IT'S GOOGLE!!!! (swoon)
... I have yet to see any application based on any large "cloud" based service have response times as bad as their site right now. A 20x slowdown would under load would be orders of magnitude better than they are achieving. Hmmm ... could one of the reasons some companies prefer to outsource applications be that there is extra capacity to handle peak load conditions?
I'm not surprised that these 'Johnny-come-latelys' are having issues. M (Mumps) has had an integrated schemaless database for forty years now and has the tool chain to go with it. The language and the data structure are seamlessly integrated, a concept that was all but wiped out by the relational database movement of the 70's. It's a shame to see this emphasis on schemaless databases is so totally ignorant of both its prior history and the lessons that Mumps has to offer. Ignorance is bliss...
"Can there be a Klein bottle that is an efficient and effective beer pitcher?"
The guy that did the story is an ex M$ employee that ventured out to start his own business, surely nothing that M$ could not
spend a little on for him to write up bad reviews for everyone except M$....!
http://www.itnews.com.au/Tools/Print.aspx?CIID=153451
There are a number of arguments both for and against cloud computing. Performance and cost aside, it just seems to be an introduction of more single points of failure in your infrastructure.
In a standard site infrastructure model if your mail server takes a dump, yeah, you're not getting mail. Same with routers, power, etc. We all get that.
Now introduce clouds for your services and add in firewalls, physical broadband pipes (T1, or whatever), broadband service provider and all their hardware/personel/etc, and any other broadband service providers that host traffic to your destination (and their hardware/service/personel/etc). There's a host of things that are added that, if broken, sever your business's ability to perform. And we havent even gotten to the company that has the hardware and services that actually host the cloud.
The bottom line is the argument between what is more efficient and cost effective. Unfortunately the accountants dont factor in downtime for every employee when things break. They only factor in the check they know with certainty that has to be written every month. Yeah, on paper you probably save a bunch of money to go with a cloud. In reality you're not making any money with all your employees sitting around with their thumbs in their asses a couple of times a week.
"But we have to pass the bill so that you can find out what is in it,..." - Nancy Pelosi
You're confusing two definitions of "cloud".
One is the idea of putting everything into a webservice. The other is the idea of utility computing. They often overlap, but plenty of web services run their own datacenters, and there are plenty of applications of utility computing beyond web services.
Specifically, your "scalability issues" are relevant to the "utility computing" part, but not so much to the "web services" part -- unless you were bringing up issues completely irrelevant to this article.
This is my main annoyance with the use of the word "cloud" -- even people with some technical knowledge still get fooled into thinking one kind of "cloud" has anything at all to do with another type of cloud.
Don't thank God, thank a doctor!
Yes indeed. Our breathern are wit-less and without clue to the cloud.
Serves them right.
May a 50 kilotonne nuclear blast at 600 m above them light their way.
I dunno, I've been able to rip thousands, maybe tens of thousands of songs off my CDs and store them on a single hard drive. I think that's fairly scalable :D.
Beware of bugs in the above code; I have only proved it correct, not tried it.
Some of the data was discussed at the Artchitecture Forum, and updated in the story below.
http://www.itnews.com.au/News/153819,more-data-released-on-cloud-stress-tests.aspx