Slashdot Mirror
Grid Computing Meets Web Services?
jgeelan writes "According to an article in the current issue of Web Services Journal, by ex-IBM, ex-Vitria Technology, ex-IONA middleware maven Dirk Hamstra, the open source initiative known as OGSA, the Open Grid Services Architecture, is poised to bring utility-based computing a step closer. "The combination of Web services and grid computing," Hamstra writes, "virtualizes networked resources using common computing standards, making them accessible to a larger audience." Amazing what a little R&D money from IBM, a prime grid-computing mover, can achieve."
"Open Grid Services Architecture, is poised to bring utility-based computing a step closer"
.. unlike "other" utilities.
And a lot cheaper
http://www.ibm.com/grid/
This is some very cool stuff. I saw some of the tools in development this summer and I can't wait to see grid computing (from whomever) actually get off the ground.
Dude.... at least we're not reading posts about new weapons of mass destruction. And theoretically these third-world citizens, etc. can benefit from these advances (although i doubt they ever will). Quit flaming and do something real.
Grid Computing = a Beowulf Cluster.
I am sorry... who died? I have forgotten.
This is slashdot, we discuss news for nerds. S11 is significant, but not the end of the world, life goes on. This is the world in which we live.
Get a LIFE! The ONLY way you get past is to keep on living and GO FORWARD! That I am sure is waht the dead would want you to do.
Do you have the slightest idea how much software is associated with your daily life? With the war on terror? With the rebuilding effort?
Databases, email, computer-aided drafting, Internet, purchasing, inventory management, and so on ad nauseum. These things would not exist without "wasting" time on fundamental research.
What if you could see into the future and find out that Grid Computing was used by the US government to predict dates and locations of terrorist attacks and stop them before they occurred? Would you still think is was a waste of time?
So Microsoft's .NET will run on Sony's PS3? Truly the best of both worlds...
[o]_O
Now Saddam Hussein can run his nuclear bomb simulations without having to violate US export laws.
Oh no, how dare we think or talk about something other than the misfortunes in the world. How do we dance when our Earth keeps turning... Boo fucking hoo!
Here's some news for you pal: there's strife no matter what time or place you live in. Nothing makes this particular time or place special. So your claims that our talk is frivolous are unfounded.
If talk of the misfortunes in the world always overrided discussion about other interesting things in life, then we would never get any joy out of living.
Tomorrow, instead of emotionally flogging myself like every other good patriotic American, I'm going to be doing my best to ENJOY my day. I'd best enjoy it while I get the chance. And I'll talk about anything BUT the bombing of a major landmark and the major loss of life that occured a year ago not more than thirty miles from where I sit.
well made point, thank you for restoring the balance here--it's an emotive day to discuss anything, clearly, but as you say: technology cannot and should not be treated as a category separate from life, it is a part of modern life just as terrorism is (regrettably) a part of modern life
In the Seattle area, Alton Brown will be at the Kirkland, WA store on Friday, October 18 at 6:30PM, and will be signing books at the Pine Street store on Sunday, October 20 from 1PM-2PM. Only books purchased at SLT will be signed. The Friday seminar is $70.
Sara Moulton will be in Kirkland on December 6 at 6:30PM. Cost is $85.
To register, you need to call their toll-free number and give the class number, so you will need to visit their web site at www.surlatable.com to download the class schedule for the pertinent information.
Interested persons in other areas should check the schedules for their areas to see if and when Sara or Alton will be in their areas.
Trollaxor.com, you are sorely missed. Come back soon, before I give in to despair and impale myself on a forklift at Sam's Club.
It's good to see practical web services leveraged through Open Source initiatives. Certainly, this is not unexpected, but it's good to see meacurable results, given the unbelievable type we've been subjected to over the past several years.
Positive results of OSS efforts are always gradifying to see.
--CTH
--Got Lists? | Top 95 Star Wars Line
They are apparently expanding this toolkit to a 'grid service platform' called 'Gaia' detailed here.
From the website:
GAIA is a service-oriented grid-computing platform that connects producers and consumers of services and data while shielding them from issues like fail over, load balancing and clustering. GAIA can connect and control web services hosted on any combination of platforms, and uses a P2P architecture for reliability and scalability.
GAIA is based on simple yet powerful concepts, can run on machines ranging from enterprise servers to wireless PDAs, and has native implementations for Java and Microsoft .NET.
Why does the grid computing need to meet Web services? Where do we need web services again? I don't see a whole lot of people using them at all. All the hype seems to have died down, there's no migration to web services visible anywhere.
Somebody call the waaaaambulance!
(Here's a good article that briefly describes some more of the benefits that the OGSA initiative provides and how it will eventually enable the cooperation and interaction between all types of distributed computing systems. It's unlikely that the marketplace will remain dominated by only a single distributed computing vendor's (commercial or non-commercial), but at least OGSA will provide a means for equal interoperability and features such as load-balancing between different vendors.)
p hp?si d=2236
---
Check out the entire article in whole at:
http://www.supercomputingonline.com/article.
SCO: How do Web services play a role in the future of the Grid?
MANDYAM: The promise of grid computing is to integrate a variety of systems into a virtual supercomputer capable of aggregating resources such as, processor cycles and storage within a large network consisting of one or more organizations. This far-reaching vision experienced a setback, however, by a lack of interoperability standards among grid computing technologies that were being used in the individual organizations. The advent of Web services has revived the vision by allowing grids to be specified as services that can interoperate with each other.
The interoperability benefits in grid computing come in two areas: one is in the area of tying together heterogeneous resources managed by different grid technologies. The development of Web services-based standards will specify XML-based languages for these technologies to talk to each other. Secondly, the interoperability will extend to existing infrastructures enterprises have in place today. Web services-based interfaces will permit companies to integrate grid computing frameworks more easily into their environments because Web services-based development is designed to be easier and faster than traditional methods. Interfaces described in WSDL will provide the flexibility for companies to build higher-level, Web services-based applications that can also be discovered and shared.
A grid service is built on concepts and technologies from the Grid and Web services communities, such as the W3C and GGF/OGSA, and will be the basis of Web services influence on grid computing. Its architecture defines standard mechanisms for creating, naming, and discovering grid service instances: providing location transparency, network and platform heterogeneity.
The Open Grid Services Architecture (OGSA) is in the process of defining a set of Web Services Description Language (WSDL) interfaces and for creating, managing and securely accessing large computational grids.
SCO: So would you say that it's critical for companies with Grid solutions to plan for Web services in their architecture?
MANDYAM: Yes, there is unanimous support for a fusion of Web services with Grid services in the grid computing space, and both major and small vendors are embracing the OGSA standards. Fortunately for companies, Web services will make grid solutions easier to implement and more powerful. Vendors will be to make their product architectures compliant.
Large and progressive enterprises that are planning to deploy enterprise-wide grid solutions should definitely review and follow the standards being specified by the OGSA. In some cases, it may be necessary for enterprises to actively participate in GGF/OGSA to incorporate business critical features into OGSA standards.
SCO: Does the advent of Web services lead to the potential for a worldwide, Internet grid?
MANDYAM: As enterprises begin advertising their grid service capabilities using OGSA-based WSDL interfaces, there will be a strong desire among government organizations and private enterprises to build a worldwide Internet grid. However, such a grid would require a lot of cooperation among the various IT departments to develop and implement usage and access control policies. Web services will be secondary to enhancing this potential, as the important milestone will be a general agreement on standards for interoperability. Web services seem to be fueling that through support for the OGSA.
SCO: On Monday UD announced the availability of the MetaProcessor platform 3.0. Please tell the readers about it.
MANDYAM: The MetaProcessor platform v3.0 is United Devices' latest version of its computing platform for building grids that harness underutilized compute resources on Windows and Linux. The platform allows companies to effectively incorporate their desktops into enterprise grids capable of delivering a high performance computing engine.
The platform builds on its recognized ease of manageability and scalability to add important features that make the product easier to integrate and use. It offers a SOAP-based interface and WSDL specification which companies can use to more easily integrate the grid into their infrastructure and to package research applications with Web services. The platform adds the ability to submit and run simple batch jobs that are not as computationally demanding via command line, as opposed to data-intensive high throughput jobs that the platform was originally designed for. Lastly, getting applications onto the platform has also become easier with a simplification of the migration process for application developers. No API's are necessary to access the platform's robust security and network optimization features such as data encryption and compression, and applications can be run without source code modification whatsoever.
Don't waste those cycles! Put them to use! http://www.distributed.net/
The dead would want to be avenged!!! So go fucking avenge them already! Just this afternoon I smeared dog shit on the door handle of a mosque, so I can wear my American Flag t-shirt with pride!
I just want to say, no matter in how off-topic a way, that I'm proud to see that the first story posted on Slashdot on September 11, 2002, had absolutely nothing to do with last year's terrorist attacks. Folks, we're not terrified, and because of that, we've already won the war, regardless of the battles yet to be fought.
I will now announce the following uses for web services in alphabetical order:
* Making your broadband connection perform like a dial-up (thanks to XML).
That is all, thank you.
</german accent>
modded up. He posts at Score:2.
Here is a little collection of grid computing related companies, organisations and projects. If there is something crucial missing, let me know :)
He'll be in Kirkland on Dec 3, and he looks just so darned cute with those little bowties.
The bodies of the thousands of innocent civilians who died (and will die) in these unprecedented events could give a good god damn about grid computing
...
It's highly unlikely the *bodies* of these people care about anything.
And "unprecendented"? Really? 2800 deaths is tragic, but hardly unprecendented. Get some perspective, and turn your television off, please.
The souls of the victims are watching in horror as you people squander your finite, precious time on this earth playing video games!
Their souls aren't doing anything either, as there is clearly no such thing. As for wasting time - isn't the lesson that we should enjoy our time while we have it? How many of those people died because they went back to work instead of evacuating?
I think, if anything, they would want people *not* to waste their lives endlessly flagellating themselves at the behest of the media
"unprecendented"
I mean "unprecedented"! I was pissed off, and typing fast, and I did it *twice*. Fuck.
Enterprise Web Services
-brian
You might consider adding the ConCert project:
http://www.cs.cmu.edu/~concert/
We aim to provide a framework for grid computing with certified code (run native code without needing to trust anyone) and strong language support.
Grid computing and clustering technologies are on opposite ends of the parallel computing scale.
Actually the clustering technologies are in the middle of the scale. Symmetric multiprocessing with shared memory is the most tightly coupled end of the scale, then come the clusters, then the Grid technologies at the other end.
Each calls for a different style of application development too. In systems where IPC is really expensive, you want to minimise it as much as possible. Not all apps that are written to run on a Beowulf cluster will necessarily port straight over to a grid framework. However, for apps that can be made to run well on a grid, the potential computing power available is far, far greater.
Yes, the development strategies are certainly different. However, often the Grid technologies can be used to provide a way to access the clusters instead of distributing the whole software on several machines. In that case you usually need only relatively small changes to existing software.
The benefit in this kind of approach can be that the authentication, authorization and encryption services for the connection and data transfer are provided by the Grid framework. For instance you can use the Globus Java CoG kit to authenticate in "Globus style" if you prefer that to the options Java natively offers. (Mobile Analyzer developed in our group at Helsinki Institute of Physics does that.)
Currently it is often still a bit unconvenient (mappings between Grid credentials and local user accounts etc.) but as these services develop users probably will have access to many more machines than they have now, because they don't need an account in each box. Then they can run their job (which is not necessarily parallel at all) where they like or run the job on their desktop but access data in an external database using their Grid account.
The computer or cluster for the job can also be selected automatically. The NorduGRID group has implemented this kind of system which connects several clusters in Nordic countries, they have a status monitor on on their website.
AJT
- run it on your own PC while you work at other things, hopping that it won't crash for the next 3 to 5 days or
- buy a cluster or parallel machine (currently expensive SGIs) and let the OS handle the Fortran code and make the best use of CPUs it can.
The third way is the Seti@home way: write a distributed client and spread it on plenty of machine. Ever since I heard of seti@home I've been wondering why no-one had come with the following way: a distributed client, but distributed only on your own organisation's PCs. Come on, we buy computers to use the CPU ourself, not to run other people's programs. But our PCs are just glorified typewriters while our mainframes are totally saturated. Why not run our stuff on the secretaries 2GHz PCs while they type away ?Maybe this should have been an ask.slashdot question a long time ago, but is there a very simple toolkit that will allow one to write a distributed app and put it on whatever PCs you have available ? Requirements are: load balancing, automated distribution and result gathering, ability to have several jobs per machine, access to common resources like a central RAID disk, crash recovery. No need for interprocess communication. Possibility to run any kind of exe would be awesome (yes, we still use fortran, sigh), or at least only link a special library to your prog and that's it.
I've heard of Jini here on /., but it looked very very basic to say the least and at the time there weren't any examples of code.
Non-Linux Penguins ?
JarJar Binks - WTF?
The Ninja teddy bears, the Ewoks
The giant, mean teddy bear, Chewbaka
Uber-lame ball of quivering flesh, Jabba the Hut
plus all sorts of lame-assed cartoon characters. That ain't SciFi, that's just sad.
Then there's the lame-assed "plots" in Star Wars. Amazing how someone can make billion$ by dragging out a 15-minute story into 5 (so far) full length movies. After the Ninja Teddy Bear episode, only a real luser would keep spending money on the tripe.
As a consultant, I added SOAP, WSDL, and UDDI support to a commercial Java app server product.
However, for most purposes, there are some very easy to use tools for publishing (if that is the correct word) web services:
- for Java: Tomcat, Jakarta Axis (for SOAP and WSDL), and the jUDDI open source project (for UDDI)
- for Python: SOAP.py for client and server SOAP support
With the cost of dedicated managed servers going down, I think that there are lots of good opportunities for developers to sell web services for applications that require up-to-date data, etc. For, example, a word processor, obviously, using a remote server based application is stupid, but for applications like web search (e.g., Google SOAP support), stock quotes, specialized data processing, etc., it does make good sense to implement as web services.-Mark
Already does a lot of this.
Well, it does.
Imagine a Beowulf cluster of these!