Sun Grid Utility Goes Live for Employees
museumpeace writes "CNET is reporting that Sun Microsystems turned on its Grid computing utility, hosting large ERP applications for its employees to test out the server infrastructure and user acceptance of the Computing-as-metered-utility model. General availability is scheduled for October. The rates? "Sun is offering processing and storage in a pay-as-you-go arrangement of $1 per CPU per hour, delivered via an Internet connection". Sun is still retooling its Thin Client interfaces and support SW. Experts quoted in the article wonder if Sun can make any money this way." Slashdot also covered the original announcement back in February.
I wonder how they plan to compete with the distributed/remote computing power provided by all of the unpatched and unprotected Windows based systems in the world that are freely available to anyone with a couple scripts and an internet connection?
Isn't that many times what it's worth? 365*24=over $7K for a year's worth of computing. Hmmmmm...
This is just the reincarnation of the mainframe era. Everyone (Sun, MicroSoft, et al), want to put us back in the days where the storage/cpu and most importantly the applications themselves are in their "capable" hands.
I'm not even going to enertain the idea of having MY data stored on another (microsoft/sun/etc)server, and paying for the rights to access/modify it.
There is a reason it's called the PC,and not a dumb terminal.
Maybe it can be used to improve OpenOffice load times.
Yah! Now I can get my stats back up. /me cracks knucles
Ouch that hurt... Sun's spirit will always be amongst us.
The hip way to get your IP. No ads, ever.
Now, I can finally run gigantic neural networks trained by genetic algorithms to predict the outcome of sports betting. :) I actually gave up the project (I was coding it in C using the HDF5 library for data storage, etc.) because I have no hardware capable of running it reasonably.
This brings some nice computing resources well within reach of individual hackers. I don't need a 10,000 CPU block for an hour slice, just a hundred CPUs for an hour.
But CloudNet, AirNet and UpperAtmosphereNet are currently leading contenders. Analysts feel however it may be something in a similar vein which is finally chosen.
Do not try to read the dupe, thats impossible. Instead, only try to realize the truth
What truth?
There is no dupe
With a Microsoft partnership, we now understand how we plan to have the oomph to run Windows Vista when it comes out.
$1 per CPU per hour...the true money-making scheme here is that if you run Linux, they'll charge you the $699 for each processor on behalf of SCO.
So for $50 bucks an hour, you can run a SWING application almost without a performance drop.
With the licensing model, you can run apps with it, but you can't alter any data that passes through without our permission. Want to see the results of your calculations? You'll have to sign an NDA.
Sun Microsystems? Hey weren't they that big dot-com company that wanted programmable toasters? What are they doing these days?
Seriously, I like the sound of this. One can argue about costs, etc., but at least they have something other than inertia that might encourage a scientific user to choose Sun.
Considering that a "CPU" can be had for $400 (2.8GHz Celeron D without even trying, just a search on google).
So 24 hours a day, $400 -> 16 days work. Let's add in 25% for "stuff" (electricity costs, etc., being generous...) and you're still saying that a problem that takes 20 days or more, you're better off buying a throw-away PC and running Linux on it.
So, it must be aimed at the smaller problems. Like what ?
Simon
Physicists get Hadrons!
OK... that comes out to $1600/yr per computer for a business... how much is the storage?
What about security?
And also why not "follow the power analogy entirely" and charge based on computer power/hr?
It's too expensive... rather than pay $1000-$2000 every 2 years, will businesses pay $3200... why?
The high-energy physics folks, who generally get government and university subsidies for their high-performance computing needs, and so certainly get computation much cheaper than $1/cpu-hour.
Commercial folks, maybe in the financial services sector who are (rightfully) paranoid about security, and just aren't going to send their sensitive data from Wall Street to California, so matter how much SSL-this and triple-DES that happens on the way there.
What if you lease time from Sun, and the computers that your data are being crunched on your compiditors computer? What about someone wanting to see what you are doing, and what is going on? This is not breaking encryption or finding aliens, this could be used by insurance, health, or governmental agencies for crunching large numbers, or searching databases. What have they done to address this?
Welcome to the Entropy Bar, may I take your order?
A good compute cluster can be had for $2500 a dual-CPU node. Assuming another $500/node/year for operating costs/upkeep, thats still
$1250 for a CPU-year. Compared with $8000/cpu/year for Sun's solution. So you better need BURSTS of CPU but not sustained CPU. And you better not be able to smooth out the burst demands with a batch-job system.
Test your net with Netalyzr
(For real-time processes, you can even fix the clock cycles in advance.)
The advantages of doing things on this scale are that most heavy tasks will take in the order of seconds - at worst, minutes - and it is unreasonable to charge people for absolute time when an unknown fraction is spent in process swapping, paging and I/O blocking.
A flat per-cpu rate won't work well, as people will simply write programs to hog the CPUs as much as possible, thus taking the least absolute time, thus resulting in the least cost. It will also reduce the timeslaces available to competitors, driving UP their costs.
In other words, it is a recipe for creating a gang-land in electronic form, where the roughest and most brutal coders will "win".
There is also no incentive for Sun to improve such an OS, either, as they profit from latency. An increase in latency increases the fees, so reducing efficiency is a source of income.
It is, however, entirely in line with their Networked Computer idea, which I can only guess they are trying to resurrect. (If you can rent CPU space, you don't need to buy a local CPU.)
It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
Guano Jim is about to become Guantanamo Jim because we all know only terrorists break NDA's
Do not try to read the dupe, thats impossible. Instead, only try to realize the truth
What truth?
There is no dupe
Sun's main problem is they are not able to stick to one strategy for rescuing themselves from the mess. Last year Java Desktop System was all over the press. 100$ per developer..I don't hear of it anymore - now it is 1$ per cpu. They are going to have a hard time getting the trust of enterprises to use a CPU in their servers. Good luck Sun, more importantly Good luck Java
Explore your creative side
-- It seems that most people here are missing the point
"Just buy a cheep computer to do some of the work for less $$$"
I would think that this would be aimed for people who have a specific problem that would overwelm your current setup and is more of a one off, or infrequent large problem.
Think of the times when you would need a supercomputer for just a few hours...
like an old mainframe setup without most of the headaches.
Why did my database stop working? D'oh! I forgot to pay my computer utility bill!! (smacks forhead).
try { do() || do_not(); } catch (JediException err) { yoda(err); }
you mean mug people with the power of SUN! Where is my +8 Sword of w00tness?
Sorry about the writing. Robot fingers, you know? Cliff Steele in DOOM PATROL #23
Should I rebuild the bunch of pentiums and 386sx I store in my garage?
--
Dreamhost superb hosting.
Kunowalls!!! Random sexy wallpapers.
Hosting 20G hd, 1Tb bw! ssh $7.95
Most batch nodes are space-shared, not time-shared. That means only one job is running on a particular node at a particular time. This does not create any perverse incentives; developers are still incented to make their code as efficient as possible. If the job is blocking on I/O, that's the user's fault, not Sun's.
OK, so for one year of CPU time, maybe it is initially cheaper to buy a whitebox and install linux than it is to use this Sun solution.
However, if you got a linux whitebox to run this, not only would you have to worry about power costs, but also every other detail that comes with making sure your machine is running. What about patches, upgrades, network, bad hardware, runaway processes, general administration, backups, storage, etc? Most of the people here would be able to do the standard stuff that's needed, but I'm sure a business that needs "xyz" computed would gladly pay the 2x price. Not only would it do away with all the minor details, but they'd also have their results back in a significantly shorter amount of time! I'm too lazy to do math right now, but I'd say a year of cpu time could easily be done in less than month. That alone could be _the_ deciding factor and the justification for the expense.
--- "To ignore race and sex is racist and sexist!" -- Jesse Jackson
1. gridhost% setenv DISPLAY crappy_host.mydomain
/usr/openwin/bin/xinit /usr/dt/bin/Xsession &
2. gridhost % while 1
?
? ???
? echo PROFIT!!!
? end
An Indian-American Hindu committed to non-violent thought/speech/action alarmed by the global explosion of radical Islam
Some pretty interesting things might come of just letting it be used by employees for now. I'm sure a few of them have had ideas that would need oodles of power to flesh out, that nobody would pay for the big iron to run. I, of course, would recompile Quake 3 and get myself some geek cred with a stupidly high FPS.
"A language that doesn't affect the way you think about programming, is not worth knowing" - Alan Perlis
emerge update -distcc -sungrid
Mind you the cost of chip design software is the limiting factor here, not the cost of hardware to run it on
Sun has some fairly substantial profit margins built in at the $1/CPU/hour price.
Consider that if you have a moderately large data set that you need to crunch it's not at all uncommon for it to take 3 hours on a 300 node cluster. That's $1800 if each machine is a dual proc machine.
So suppose Sun has a 300 node cluster, for example, where each machine cost $1800. Ever 3 hours one of the machines is paid for. In other words, a 300 node cluster is paid for in 38 days. Well, the hardware is, anyway.
I really don't know who the main clients would be of this kind of service, however. I'm guessing that if your company can't afford a 10-20 node cluster (fairly cheap) and still needs to do large scale computing, renting CPU cycles from Sun would make sense, though it would very quickly cost more than the 10-20 node cluster would have. So it's really going to benefit customers who need large scale number crunching results more quickly than they can obtain them simply by building a smaller cluster and waiting for the results, or customers whose problems involve data sets that are large enough that they need to be distributed over 100+ machines in order to be solved.
Who has large data sets like that and no cluster access? Not university researchers, not government agencies, and probably not most firms doing significant number crunching.
So I see the niche as firms with large data sets and someone who can write the MPI code, but who lack the willingness or finances to invest in a cluster of their own.
In a year or two when the same service is selling for $0.25 per cpu hour it will be a much more compelling proposition.
Amazing magic tricks
Why bother trying to win over customers, when a $150,000 marketing budget can be so much more effective leasing 1000 CPUs to DDoS the competition for a week... ;)
1. cost for a CPU
2. cost for the box for the CPU
3. cost for data storage
4. cost for monitors
5. cost for cooling for above 1-4
6. cost for power for above 1-5
Now, ask yourself, will the price of power go down if oil will cost $100 (current median bet in the Oil Futures stock simulation using real dollars as per WSJ)?
yes, there are ways to reduce those costs. but not everyone can.
-- Tigger warning: This post may contain tiggers! --
What about releasing a grid client so every one could earn some bucks by letting their cpus work for others?
You know, like the spam bots in windows, but getting money!
--
Dreamhost superb hosting.
Kunowalls!!! Random sexy wallpapers.
Hosting 20G hd, 1Tb bw! ssh $7.95
Sun wants us to run an app on their powerful grid, but what do software vendors think about us running their single lincense across, say, 100 CPUs?
So now, on top of the $1/CPU/hr, we have to buy a license for each of those CPUs.
Or else this will be very good for open source.
Sun can use paypal for worlwide collection or money.
Explore your creative side
The concept here is very similar to virtual servers. Instead of charging per disk and RAM, they're formalising the charging process for CPU.
You could apportion a similar costing structure to a normal e.g. unixshell/linode virtual server to charge by CPU hours.
http://blog.grcm.net/
reprinted in August 2005 in the 32 & 16 Years Ago column.
Yeah, they metered us this way back at college. It was supposed to simulate a "real" computing environment. We got a quota each semester. An hour logged in to a Sun was the same "price" as 1000 pages off the laser printer. I printed a lot of manuals. A LOT of manuals.
Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
Sounds exactly like the timesharing model I used on a Burroughs B5500 system circa 1970.
"It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
"I've tried A! I've tried B! I've tried C! All the while the aircraft is hurtling flaming ball plummeting out of the sky like a - I've tried D! I've tried E!"
Give a man a fish and you have fed him for today. Teach a man to fish, and he'll say "WHERE'S MY FISH, YOU IDIOT?"
http://www.betanews.com/article/Microsoft_Heats_Gr id_Iron_with_Bigtop/1104374194 4 6291,00.asp
http://www.microsoft-watch.com/article2/0,2180,17
It may be on the back burner at MS for now, but as we've seen many times if they perceive a market they're missing out on they can throw enormous resources at a project to get it to market.
Imagine if you hooked up enough of these into a pay-as-you-go Beowulf cluster!
"Nokia is not a country, it's the capital of Finland!" -Moderated "Informative". Yeesh.
What CPU will it be? A 4Mhz 8080? Or a Pentium II? Or a 1.0Ghz UltraSparc V? Or is it only one kind of CPU? If so, which kind, what speed? And will the $1/hour/CPU increase as they upgrade to new processors, or will it stay constant?
Wouldn't it be better to offer, say, $1 for each million MIPS? Would be a lot more straightforward.
to sell my spare CPU Cycles? At a $1/Hour, I'll let them have the 8 Hours that I'm at work using my office computer! That will give me some extra munch money... :)
--- Relax, that mass muderer is just trying to reduce our carbon footprint, one fetus at a time...
To really take advantage of a platform like this, you need to write code tailored for it. Who is going to risk spending large sums of money and lots of time developing for such a platform when it is controlled by a single-vendor and could disappear at any time?
But think about business models where the grid provider sells not only CPU cycles, but also trust.
Scalable web hosting: Your PHP code is replicated on-demand to as many grid server as needed to handle your peak loads. The grid provider guarantees that server-side code and data remains confidential. End of the slashdot effect as we know it.
MMORPG: Small startups can deploy worldwide networks of game servers in no time and compete with the big boys.
The next Google: Anyone with a smarter search algorithm can go online without investing in huge datacenter first.
Rendering farm: Your CG movie is due to premiere next month, and your 10,000-node rendering farm can complete the job in time. Wouldn't you pay extra $$ to anyone who can save the day and guarantee that screenshots won't be leaked to the Net ?
Combine this with a micropayment infrastructure where the grid provider sends bills to end-users on behalf of the service provider. Huge potential.
AC
As other replies have aluded to, there's a difference between CPU time and wall time.
/Applications/Net/Firefox.app/Contents/MacOS/firef ox-bin
$ man 3 clock
clock - determine processor time used
LIBRARY
Standard C Library (libc, -lc)
SYNOPSIS
#include
clock_t
clock(void);
DESCRIPTION
The clock() function determines the amount of processor time used since the invocation of the calling process, measured in CLOCKS_PER_SECs of a second.
So as you can see, even if they used this standard POSIX function to measure time it'd still be counting clock cycles, just measured in hours.
top(1) and ps(1) can also tell you the amount of CPU time (measured by cycles spent on the process but reported in units of TIME) a certain process has taken up since starting.
For instance, I've been running Firefox for about 3 hours now, but it's only used about 11 minutes (10:59.39 minutes exactly) of CPU time (in the 2nd-last column of the ps list):
USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND
csirac 7377 2.3 19.3 296996 151956 ?? S 5:51AM 10:59.39
Not all CPU hours are the same. An hour on a moderately fast SPARC processor is not as valuable as a moderately fast Intel Xeon or AMD Opteron or a PowerPC.
Since Sun is attepting to utilise economies of scale, as this gets more popular, presumably prices would become more and more accessible.
-Tez
Haskell, the static-typed, lazy, polymorphic, programming language.
And how the fuck are you going to transfer *hundreds of gigabytes* of data required to render a frame over the internet? How are you going to receive the data back? (2MB - 12MB per layer per frame).
Does that thing even have Renderman installed? (at $5k/CPU I highly doubt it). Does it have Shake? Does it have Houdini? Does it have Maya?
Besides that, how the fuck are you going to get approval to send _anything_ out of the studio? You obviously have never worked in the industry.
I'm also skeptical as to whether there is any use for this. What sort of environment do they run it on? Solaris/SPARC? Solaris/x86? Linux? Windows? What sort of software does it have installed? Would it ever be possible to replicate the in-house environment on this "grid"? (you know, with all the custom software, directory structure, environment variables, aliases, etc.) I know for a fact that there is no way we could outsource our rendering to Sun even if we tried.
The whole "CPU-hour" thing is a very nebulous concept. Environments differ wildly from one company to another, so you can never have a universal "CPU grid" in the same sense as you can have an electric grid.
___
If you think big enough, you'll never have to do it.
There's a wonderful technical paper analyzing the value of procrastination. Don't recall the details, but the upshot was that for certain computing problems long enough (on the order of years compuatation time), at some point it's just better to do nothing at all until the price of the hardware drops and the CPU speeds rise enough so that you can actually get the job done sooner than if you started running the job on what you had ASAP.
If you have computing job that will take 4 years on today's processors, and processors will be 4 times faster 2 years from now, better to do nothing for 2 years and then run the job on computers that will complete the job in 1 year, getting you done a year early including a 2 year vacation.
Wish I still had that paper...
Can we get a "-1 Wrong" moderation option?
Imagine a Beowulf cluster of these!
Oh wait...
The hip way to get your IP. No ads, ever.
I'm thinking of my own employer, who's got hardware up the wazoo that mostly just sits around heating the building. Take payroll, for instance. They probably run some payroll batch job a couple times a month, then the rest of the time the computer that does payroll is just sitting around. Sure, you could run other stuff on it, but then when it came time to do the payroll everything would run slow and people would be upset.
The way I see it, this is perfect for all kinds of periodic batch-type business applications where you really want to have a dedicated machine but it won't be utilized all the time.
Also, machines that mostly sit around have about the same maintennence requirements as heavily-used hardware. They still need OS patches, security patches, backups, etc. And they need to get modified when the new head of IT decides logs should go in /var/tmp/messages instead of /var/adm/messages or whatever. I know my employer could probably get rid of 2/3 of its data center and a corresponding fraction of the high-priced administrators currently making everything run smoothly.
You could argue companies can do the same thing by balancing existing hardware, i.e. have one box host multiple "bursty" applications so the CPU doesn't have much idle time. But that takes lots of effort to manage, and it doesn't leave you any spare capacity when you need it. This way you don't need any spare capacity, and when your business grows you never have to worry about running out of rack space or lead times for new hardware.
The downside, of course, is you're trusting Sun to have the capacity available when you need it. In a way, it really is like a utility - Sun will be hoping its customers "bursts" will all average out to some managable load. I wonder if it's true.
At 6:18 pm on August 24th, skynet became self-aware.
What if this is just a pilot to generate some noise?
Surely as a value proposition, Sun could make money on the grid technology (software, architecture etc) by licensing it to owners of large amounts of computer power.
How about if Lawrence Livermore labs and Los Alamos National Labs got together to share their computing power using this grid technology?
Sun get revenues from licensing the grid-management software, and potentially hardware sales....
and the government (or universities, or whoever) gets a larger pool of computing power than any of their single supercomputers, that they can devote to different research groups.
The selling computer-time is a red herring I'd say, based on my experience of Sun.
I understand the economics of renting CPUs for big infrequent calculations, but how do you transfer the GB's of data required? For most business and research apps, aren't massive amounts of data typically attached to massive processing jobs?
Won't the average internet connection take more time uploading the datafiles than it takes to process the data? Is it really practical to ship hard drives full of data to Sun just to run a few calculations?
SunOS: the reason firewalls were invented.
FreeBSD for the impatient.
Hey Andrea Arcangeli (a Linux kernel developer) has been running a similar project for a while at http://www.cpushare.com/ where you can actually make money off your spare cpu cycles. Lorenzo
The kind of people wanting to run CPU intensive tasks enough to be willing to pay someone for it are likely to be universities and companies that could get their own systems.
Chip companies need to run extensive simulations of the functionality of their chips before committing to actual silicon (which is a very expensive step). Although they tend to have large server farms to do this, these might already be busy.
When a (possibly even very small) change is made to the design of a chip you need to run a lot of CPU-time-hungry regression tests. If this is being done towards the end of the project, being able to do the tests in a shorter amount of time (by renting the extra CPU time) could be very beneficial.
... to get the answer 42.
Carpe Diem: Seize The Day!
Anybody interested in the fate of Sun Microsystems should watch the great Danny DeVito movie "Other People's Money". Sun is dead, not broke, but they are headed there. Let's not be fooled as to why Sun gives their software away (java, solaris). They cannot sell it. They have consistently offered up the wrong product at the wrong time and at the wrong price. Bill Gates won becuase he is smarter than McNeely, makes better products, and is a vastly superior businessman. Get over it, all software has bugs and flaws, Microsoft is winning becuase it is better, and is getting better all the time. For the final nail in the coffin look at insider trading on yahoo about Sun. McNeely is dumping his stock bought at $.007/share at the market price, $3.70 last time I checked. Draining his stockholders equity in order to line his pockets kind of Enronish. Bill Gates net worth fluctuates more per day than McNeely is worth and for good reason. McNeely has the arrogance to keep his failing compnay in both the hardware and software business during the last twenty years when this has been demonstrated to be the path to failure (Prime,DataGeneral,Integraph,DEC, and SIlicon Graphics come to mind). What does he care he's partying on your (stockholders) money. Express elevator to hell, going down.
The majority of this discussion seems focused on the potential costs involved using Sun's service vs purchasing and managing your very own n-node cluster. Out of curiosity, who exactly purchases their own equipment these days? Organizations with any cash prefer leasing everything ranging from cellphones to PDAs to desktops to servers to SAN devices. With production equipment often hosted at an offsite facility, managed at least in part by a 3rd party.
The four primary reasons for this are:
1. Comprehensive support.
2. Homogeneity (1000 identical systems can easily be ordered and loaded with the same software image), with additional systems easily ordered on an ongoing basis.
3. Economy of scale -- leasing 1000 identical machines costs less than purchasing, supporting and regularly upgrading 1000 individually customised machines.
4. Automatic periodic equipment refresh, ensuring an org is able to leverage improvements in technology (CPU, memory, storage, bus speed, etc) on an ongoing basis.
Sun's offering is merely the next logical step in an already ubiquitous model.
....But after you receive your 56th "I pushed the PF26 thingie and it didn't go" call while chained to the luser helpdesk, you begin to reminisce quite fondly of those halcyon days when you needed a CS degree just to be allowed *near* a computer.
Regards;
http://www.sun.com/2005-0816/feature/index.html
SLASHDOT: news for people who can't concentrate on work or have no life at all and got tired of yelling back at the TV.