Insights Into Google Compute Engine
snydeq writes "The Compute Engine announcement at Google I/O made it clear that Google intends to take Amazon EC2 head on. Michael Crandell, who has been testing out Compute Engine for some time now, divulges deeper insights into the nascent IaaS, which, although enticing, will have a long road ahead of it in eclipsing Amazon EC2. 'Even in this early stage, three major factors about Google Cloud stood out for Crandell. First was the way Google leveraged the use of its own private network to make its cloud resources uniformly accessible across the globe. ... Another key difference was boot times, which are both fast and consistent in Google's cloud. ... Third is encryption. Google offers at-rest encryption for all storage, whether it's local or attached over a network. 'Everything's automatically encrypted,' says Crandell, 'and it's encrypted outside the processing of the VM so there's no degradation of performance to get that feature.'"
How long until Google cancels it?
It's interesting them doing at-rest-encryption - now I wonder where the keys are stored and who has access to them?
I found this to be an interesting piece of info
Even in this early stage, three major factors about Google Cloud stood out for Crandell. First was the way Google leveraged the use of its own private network to make its cloud resources uniformly accessible across the globe.
"When you create a Google Compute Engine account and use their resources," he said, "they provide a private network, a LAN of sorts that spans different regions. For example, if you set up an architecture to replicate a database from region A to region B, in the Google cloud, you don't need to traverse the public Internet to do it. You're using their private network."
How precisely that network is implemented (as its own private fiber or simply a very efficiently-routed VPN) is not disclosed by Google. But the key thing is that the whole structure is seen as a single network from a programming point of view. "This makes it easier if you're building cross-regional architectures," Crandall says. It's expected that Google will eventually expand Compute Engine to territories outside the United States.
- I really wonder if Google built (or bought) larges swaths of private infrastructure that is otherwise outside of the Internet, does anybody know?
Here is why I am wondering about it - Google as an ISP would then avoid outside costs to move its data, it's all internal costs, this turns Google into its own 'Internet' of sorts, Google only Internet.
That's why web neutrality is a nonsense concept from my perspective - if companies can build their own infrastructure, they can compete with each other and offer their own content at better speeds, but then Google could be an ISP that uses both, Google 'Internet' and external backend, but then on its own 'Internet', the content available from Google could be delivered at a higher priority and faster (and cheaper, because its internal costs, that can be managed easier).
By the way, there was a question in the story, asking why didn't Google provide this earlier. Well, maybe it tech wasn't ready or the business model wasn't there or maybe it's something to do with the government that wants to listen in on everything.
BTW., this is why such information should be made available, the speculation about the reasons for things like that could be worse than whatever the truth is.
You can't handle the truth.
Isn't that only usefull when somebody has physical access to the device, in other words somebody stealing physical storage?
I assume the buildings are secure, right? So what's the use?
Google, in a very forward-thinking move, outright purchased massive quantities of laid fiber at rock-bottom prices after the telecom crash that followed the dot-com crash. There was quite a glut of capacity that nobody needed at the time and had no use for. They picked up years and years worth of bandwidth expansion without having to go through all the trouble and expense of actually laying that fiber.
Doesn't Amazon run on its own cloud services? Wouldn't that make the first point (FTFS) irrelevant by way of comparison?
"You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
Speaking of "Google I/O", how is the I/O performance on Google's offering? Is it any better than the, err, "not great" performance of Amazon's EBS?
10 PRINT CHR$(205.5+RND(1)); : GOTO 10
Is Google de-duping?
http://en.wikipedia.org/wiki/Data_deduplication
if yes, then encryption is joke.
When you use an US-based company to trust your data too, you are a fool. That data will become property of the US and they don't even have to tell you they copied it for reasons of terrorism-fighting (or on a much larger scale, economic espionage!). No one in their right might should ever use any system in the USA or belonging to USA companies to put sensitive or mission critical data on. It's the equivalent of riding the damn trojan horse into your own city and thanking them for the great gift.
Looks like they took Amazon's prices and said "me too!"
I can't ever take this cloud stuff seriously. The cost of bandwidth and the cost of compute time is far far far more expensive than it needs to be. Prices should be going down instead, everyone just copies Amazon's prices. I'd say there was widespread collusion if it wasn't for the fact that no serious company would use it.
Whoa... did I say no serious company?
Let's look at the numbers:
The cost of 100Mbit Unmetered (33TB of data) is 200$/mo, the cost of 33TB at Amazon: 3346.14/mo
The cost of a 8 core system is 2000$,once. the cost of 8 CU's at Amazon is 0.64/hr, or 460.80$/mo
The cost of a 42U cabinet and 15A power, 600$/mo
So cost to have a 42U cabinet with one 8-core machine is at most 800$/mo, while EC2 will cost you a minimum of 460.80$ if there is ZERO data usage, or a maximum of 3806.94/mo
But you have an entire 42U cabinet with 15A, so let's put 4 8 core systems in there.
Initial investment is now 8000$
Maximum cost at a colo, still 800$.
Cost at Amazon with zero data: 1843.20
Cost at 33TB: 5189.34$/mo
Amazon's cost efficiency is only seen when no data is included, let's use the "heavy usage reserved instance" instead: 130$/mo (on 1 year) per 8 core system.
4 of those = 520$/mo , just squeeks under the cost of colocating 4 machines. But still the data cost is absurd. Plus we haven't looked at EBS IOPS and ELB cost.
Using AWS's own calculator, it would cost you 4291.94$/mo to get 800$ worth of services.
So yeah, if you use CPU-only, EC2 is cheaper than buying hardware that may sit idle. But running a web service or any data-transfer heavy process pretty much a losing proposition. Netflix had to be losing money by the boatloads.
One comment that immediately jumped out at me was the use of External Encryption to lighten the load on the VM's. If that's the case, what method are the using and who holds the keys? If it isn't the customer who's paying for that cloud, then it's useless for building any kind of service on as the data can easily be snooped on by Google. In other words, kill the project now because it will never be profitable.
Mod me up/Mod me down: I wont frown as I've no crown
Google has a clear track record of yanking the rug out from under people who adopt their non-core products.
Unfortunately it's a valid concern.
---- Booth was a patriot ----
Notice its encrypted by default. Not a real concern, other than downtime.
---- Booth was a patriot ----
As long as google doesn't completely fall apart for one week every year, they're pretty much got amazon cornered.
"With sufficient thrust, pigs fly just fine. However, this is not necessarily a good idea...."
RFC 1925
And these people are truly unethical claiming anything different. Encrypting something before you put it into the cloud is another story. But the only use for encryption at rest in the Google cloud would be is somebody were to steal disks from their data-centers. Somehow I do not see that happening.
What they really intend is IMO to run a smoke-screen with regard to the fact that the cloud-provider is the real, major security risk and that no technological measures can help here, unless you do your own encryption before putting anything in the cloud and then only for cloud storage. Nothing at all can be done to secure cloud computing against the cloud provider. And Google is known to cooperate with the various authorities in the countries they do business in.
Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
My sites got hit so much from spambots originating from Amazon's cloud that I've had to block anything coming from it.
I hope Google does a better job at dealing with spambots originating from their servers.
Steve Magruder, Metro Foodist
I trust Google not to design in features that make it hard for me to leave, lie to me about how many CPU cycles or I/O I "spent" and just basically rip me off as much as they possibly can
http://blog.carlmercier.com/2012/01/05/ec2-is-basically-one-big-ripoff/
This is where founders matter. My idea of Google is geeks for the greater good of geekdom to the benefit of the long term good of society as a whole
Amazon fonder, CEO and billionaire many times over Jeff Bezeos "feared pirate Bezeos"
http://www.pcmag.com/article2/0,2817,2395122,00.asp
fought tooth and nail against Washington State establishing a state income tax so as to maximize his chest o' gold..
Go Google, the closest thing we have to a company who gives a shit about something other than more nose candy and ho's for the board and CEO.
"ephemeral disk which stays on the physical machine and never leaves the machine" - by joebeda3 (2674569) on Sunday July 01, @06:43PM (#40512751)
You SURE about that? I know that you're the "Team Lead" (assuming TL = team lead) & possibly you helped to design this...
HOWEVER - the word 'ephemeral' means "short lived", & what you're describing ISN'T...
I.E.-> I drew that much from the end of that quote of your words (in "never leaves the machine")...
So I must ask for clarification now:
Did you mean
---
A.) "Nothing from it leaves the end-user's system"
OR
B.) That it NEVER leaves (& ceases existence)?
---
If the latter?? Then it defies the term you used to describe it!
* The reason I note this is because of "ephemeral ports" (short-lived) ones -> http://en.wikipedia.org/wiki/Ephemeral
---
PERTINENT QUOTE/EXCERPT:
"In computer networking technology, an ephemeral port is a TCP, UDP or SCTP port which is dynamically assigned to a client application for a short period of time (the duration of time the application is running). This is in contrast to the "well known" ports which are typically statically assigned to a specific application or service."
---
Ordinarily, I'm not a "grammar/spelling" nazi or otherwise a pedant, but that has me a WEE bit confused as to your meaning is all!
APK
P.S.=> Additionally, because of the meaning of the word "ephemeral" itself as well -> http://en.wikipedia.org/wiki/Ephemeral:
---
PERTINENT QUOTE/EXCERPT:
"Ephemeral things (from Greek ÎÏήμÎÏÎÏ â" ephemeros, literally "lasting only one day"[1]) are transitory, existing only briefly"
---
In ANY event? Thanks for clarification here, & good luck on your project... apk
It maybe cost effective considering the CPU/memory to cost ratio, but the smaller option they're offering with 3.75 "google compute units" is 104$/months if you have an usage of 100% (like the typical web server). An Amazon small instance for example, which is more than enough for the load of the majority of web servers is 58$/month, or 27.77$/month if you get a reserved instance (I have one for a webserver with about 2000 visits/day). A lot of people is even running webservers on microinstances.