Amazon, MS, Google Clouds Flop In Stress Tests
Eponymous writes "A seven month study by academics at the University of New South Wales has found that the response times of cloud compute services of Amazon, Google and Microsoft can vary by a factor of twenty depending on the time of day services are accessed. One of the lead researchers behind the stress tests reports that Amazon's EC2, Google's AppLogic and Microsoft's Azure cloud services have limitations in terms of data processing windows, response times and a lack of monitoring and reporting tools."
Cloud free and lightning fast!
Anna Liu, Associate Professor in services engineering at the UNSW School of Computer Science told iTnews she was excited by Cloud Computing as it could potentially enable organisations to "outsource a certain amount of their risks and costs and tap into new economies of scale."
Sounds more like she has a degree in buzzword engineering.
you get what you pay for - news at 11.
I'll be sticking with own servers in a colo thanks.
I wonder what the implications will be for Wave? Real-time updates across multiple servers present very similar challenges to cloud-computing. If the relevant protocols have the same problems then it raises doubts over the scalability of the Wave protocol.
Meta will eat itself
So, what exactly does "cloud computing" bring to the table for me?
Not much as far as I can see, other than a new crop of buzzwords.
Shoes for Industry. Shoes for the Dead.
Yeah, I'm going to allow my computing and data storage to be dependent on large numbers of strangers, some of them hostile to me. No thank you. The Internet is handy for looking things up on and sending messages to people. Low-importance collective activity like SETI? Fine. But it is dangerously vulnerable for critical operations. I hope the people in charge of things like national electrical infrastructure are aware of that...
I piss off bigots.
Well, not that shocked....
IMO the entire cloud thing is nothing more than a hype. Noone ever got asked if he wanted to have all apps running as webservices. Google, MS and others just race each other without really having a look whether the customers will buy. And i don't even want to think of the bad choice of standards they base their services on...
I foresee a unplanned and totally random 'Software Audit' at the University of New South Wales in the near future!!!
Google AppEngine has data reporting to a ridiculous level. This article doesn't even publish any REAL data.
I really HATE commercicles, small articles which make a claim, and then say, 'stay tuned!'.
Someone fire the author. The last paragraph reads:
"Liu will present the findings and offer developers advice on how to build robust applications to withstand the cloud's limitations at the Australian Architecture Forum in Sydney on Monday, August 24."
Wow, I at least they admit that this article has no REAL data in it, and THAT data will be released on Monday.
-- I'm the root of all that's evil, but you can call me cookie..
I only have 5 Apple .mac/.me accounts and even Apple knows that the rollout was so flawed that they gave us extra time on our contracts for the deficiencies.
Apple is getting better, but ISPs are choking upload speeds (even my business account that I pay $200/Mo for 6 megabits up and down) shows far slower data rates up over down to/from Apple.
Buh? As far as I can tell, Google doesn't have a platform called "AppLogic". Perhaps they were referring to App Engine? And it's not even the editors' fault this time -- TFA has the terms wrong too. That really inspires confidence...
My Systems
it would be an offense punishable by ban if when referring to the cloud, members didnt roll their eyes and make fart noises.
cloud is becoming less and less of a "news for nerds" thing because its surrounded by nothing but business jargon instead of tech talk. outsource your risks?? I still manage the same servers, in the same datacenter, with the same network but for some reason its been abstracted to "cloud" computing. you aren't outsourcing any new. theres still a guy you call at 5 AM when the mysql servers arent replicating properly, or the amanda job is hung.
a PRIME example, this article has NO NUMBERS!! no quantifiers or methods by which they tested the aformentioned services. they only say things were bad when one group of university students half a world away tested them. the university doesnt even mention the study!
and at seven months of presumably unauthorized stress testing, i wouldnt be surprised if google and amazon network engineers met over a few pints of beer and decided your asinine experiment deserved a bit of traffic shaping.
Good people go to bed earlier.
Yes, there are issues, and those companies are being driven by free market demand for their cloud products to continue to improve them. They have the resources and the will to make the clouds better and better over time. Would you be able to keep up if you decided to establish your own data center for your own needs? I don't think so.
WOW. a study that shows that clouds are just as difficult to manage as enterprises. what a bloody surprise. its not like we havent been having the same problems since the dawn the distributed computing platform when the Mainframe model got completley whacked. and I've been hearing all sorts of things form executives recently about how we should move to cloud and how they been promised it'll be so much better and so much cheaper.
From the article:
The response times collated in Sydney were tested against measurement instruments loaded onto the cloud platform to isolate whether delays were attributable to the service itself or the latency involved with accessing US-based data centres from Australia.
We all know that all of Australia share limited pipe to outside world.
Of course it will clog during the business peak hours! It's like reviewing the sports car by driving in traffic jams around city and then writing an article that sports cars are slow!
My computer doesn't have to be hooked up to the interweb to work...
Since you are not a candidate for Internet-connected, virtualized, on-demand scalable computing resources (aka "cloud computing"), you are not attracted to cloud computing's value proposition.
For those of us who need these things, vendors such as Amazon, Microsoft, and Google are building services we definitely want to buy. Amazon's simple storage service, for example, had 40 billion objects in its repository as of February, 2009.
"We receive as friendly that which agrees with, we resist with dislike that which opposes us" - Faraday
This is Google. Didn't you get that part? IT'S GOOGLE!!!! (swoon)
You forgot about Eric Raymond and Richard Stall (as in bathroom) man
... I have yet to see any application based on any large "cloud" based service have response times as bad as their site right now. A 20x slowdown would under load would be orders of magnitude better than they are achieving. Hmmm ... could one of the reasons some companies prefer to outsource applications be that there is extra capacity to handle peak load conditions?
I'm not surprised that these 'Johnny-come-latelys' are having issues. M (Mumps) has had an integrated schemaless database for forty years now and has the tool chain to go with it. The language and the data structure are seamlessly integrated, a concept that was all but wiped out by the relational database movement of the 70's. It's a shame to see this emphasis on schemaless databases is so totally ignorant of both its prior history and the lessons that Mumps has to offer. Ignorance is bliss...
"Can there be a Klein bottle that is an efficient and effective beer pitcher?"
It just depends on the application. Webmail is an obvious success; why have every company re-creating this capability when everybody needs and wants the same thing? There is the issue of trust, but then, we do put our money in banks, so that is solvable.
Who is "Noone" and why should he have been asked in the first place?
Rofl, good troll, 100% bullshit, 100% hilarious. 10/10
http://www.itnews.com.au/Tools/Print.aspx?CIID=153451
I dunno. If someone steals my money, it can be replaced by the bank whose security system failed. If someone steals my secrets, there is no remedy.
However, the difference between banks and Google/MS/Amazon, is heavy government regulation. And we've all see lately what relaxed regulation in the banking sector can do. Also, businesses don't have the capabilities to set up the infrastructure to bank with every other company they do business with. They do however, because of standards on the web, have the capabilities to set up a data centre, and host their own web sites.
Anthropic principle: We see the universe the way it is because if it were different we would not be here to see it.
There are a number of arguments both for and against cloud computing. Performance and cost aside, it just seems to be an introduction of more single points of failure in your infrastructure.
In a standard site infrastructure model if your mail server takes a dump, yeah, you're not getting mail. Same with routers, power, etc. We all get that.
Now introduce clouds for your services and add in firewalls, physical broadband pipes (T1, or whatever), broadband service provider and all their hardware/personel/etc, and any other broadband service providers that host traffic to your destination (and their hardware/service/personel/etc). There's a host of things that are added that, if broken, sever your business's ability to perform. And we havent even gotten to the company that has the hardware and services that actually host the cloud.
The bottom line is the argument between what is more efficient and cost effective. Unfortunately the accountants dont factor in downtime for every employee when things break. They only factor in the check they know with certainty that has to be written every month. Yeah, on paper you probably save a bunch of money to go with a cloud. In reality you're not making any money with all your employees sitting around with their thumbs in their asses a couple of times a week.
"But we have to pass the bill so that you can find out what is in it,..." - Nancy Pelosi
You're confusing two definitions of "cloud".
One is the idea of putting everything into a webservice. The other is the idea of utility computing. They often overlap, but plenty of web services run their own datacenters, and there are plenty of applications of utility computing beyond web services.
Specifically, your "scalability issues" are relevant to the "utility computing" part, but not so much to the "web services" part -- unless you were bringing up issues completely irrelevant to this article.
This is my main annoyance with the use of the word "cloud" -- even people with some technical knowledge still get fooled into thinking one kind of "cloud" has anything at all to do with another type of cloud.
Don't thank God, thank a doctor!
Yes indeed. Our breathern are wit-less and without clue to the cloud.
Serves them right.
May a 50 kilotonne nuclear blast at 600 m above them light their way.
Sure there is..
Vow to never touch that sheep again!
-- I'm the root of all that's evil, but you can call me cookie..
I dunno, I've been able to rip thousands, maybe tens of thousands of songs off my CDs and store them on a single hard drive. I think that's fairly scalable :D.
Beware of bugs in the above code; I have only proved it correct, not tried it.
Some of the data was discussed at the Artchitecture Forum, and updated in the story below.
http://www.itnews.com.au/News/153819,more-data-released-on-cloud-stress-tests.aspx