Slashdot Mirror


Linux Distro turns PCs into Night-time Clusters

renai42 writes "An Australian security firm is about to launch a clustered Linux distribution based on openMosix that aims to utilise the unused nightly processing power of corporate desktops. Dubbed CHAOS, the distro is able to remotely boot a computer and run it on Linux without affecting the local hard disk. CHAOS is designed to provide dumb node power to a cluster run by existing full-featured clustering distributions such as Quantian and ClusterKnoppix."

37 of 200 comments (clear)

  1. Useful? by Daxx_61 · · Score: 4, Insightful

    I don't know whether it's just me and my uninformed nature, but it occurs to me that switching off these computers would be saving a hell of a lot of money. Rather than using them for something else - which I notice TFA is not clear on, something about a demonstration - why not just power down?

    From the Pure Hacking website - Internal on-site penetration testing gives the business the assurance it needs to conduct safely on the internet and with business partners.
    It would make a lot more sense if this was only intended for use in demonstrations and testing though, as I can imagine very few companies would feel a need to use this sort of distro on a nightly basis, but for one off activities it may be useful.

    Imagine a beo... oh, wait.

    --
    Quoth the server, "404."
    1. Re:Useful? by gl4ss · · Score: 5, Insightful

      there are already corporations out there that turn part of their desktops into a cluster by night.

      they have a need for computation power that they can't satisfy and this gives them that at no extra investment besides electricity.

      if you power them down then they're doing nothing, your investment just sitting on there. by using them to calculate stuff for the engineering department they're doing something usefull and the return on investment on them gets better.

      --
      world was created 5 seconds before this post as it is.
    2. Re:Useful? by Anonymous Coward · · Score: 4, Funny

      I work at Taco Bell too, and I let the computer running at night so our anti-virus can prevent robbers from stealing it.

    3. Re:Useful? by dario_moreno · · Score: 3, Informative

      search for "Warewulf" clusters (turning into a Beowulf at night)...it's quite old news ahref=http://warewulf.lbl.gov/http://warewulf.lbl. gov/>

      --
      Google passes Turing test : see my journal
    4. Re:Useful? by Jesus_666 · · Score: 3, Interesting

      It would make a lot more sense if this was only intended for use in demonstrations and testing though, as I can imagine very few companies would feel a need to use this sort of distro on a nightly basis, but for one off activities it may be useful.

      It's not a company, but at my university (the University of Bremen, FYI) we have a computer lab full of Dual P4 Fedora boxen, some WinNT boxen and a few antique Sun Blade 100s. At least the Linux boxen are clustered at night and used to bruteforce the student's passwords. If they manage to discover your password your account is locked and you have to go to the admin and have a little talk with him concerning secure passwords.

      I can imagine that a lot of companies might be using similar means of making sure that the suits don't use immensely creative passwords like "love", "sex" or "god".

      --
      USE HOT GRITS WITH STATUE OF NATALIE PORTMAN (NAKED AND PETRIFIED)
    5. Re:Useful? by TamMan2000 · · Score: 4, Informative

      Pratt & Whitney, one of the big 3 jet engine makers, has been doing that for over a decade. It is there primary means of supercomputing.

      They have been at it so long that they had to write their own message passing system (PROWESS) because MPI was not there yet.

      I used to work for them as a computational fluid dynamicist, we were the main consumers of this "cluster".

      --
      "I'll have a Guinness, no wait, make that a Coors Light" -Grad student I work with, who shall remain anonymous...
  2. Do I lose the use of my CD drive? by Dancin_Santa · · Score: 2, Insightful

    If it needs to have a Knoppix image installed every night, does that mean I need to leave the Knoppix CD in the drive before I head home? Sounds like the plan would work except for all the lazy people in the office leaving their Mark Knopfler CDs in the drive instead of Linux.

    1. Re:Do I lose the use of my CD drive? by Soko · · Score: 5, Informative

      No.

      Most entreprise level desktops have Wake On LAN and PXE boot capability. You send a magic packet to each desktop to wakr it up, and then tell the PXE BIOS to boot ClusterKNoppix via TFTP.

      It's not that hard to do, even for lazy sysadmins.

      Soko

      --
      "Depression is merely anger without enthusiasm." - Anonymous
    2. Re:Do I lose the use of my CD drive? by evilviper · · Score: 2, Informative
      Most entreprise level desktops have Wake On LAN and PXE boot capability. You send a magic packet to each desktop to wakr it up, and then tell the PXE BIOS to boot ClusterKNoppix via TFTP.

      It doesn't sound like you've tried this. W.O.L. doesn't power-up the system when it's been shut-off, so it's really not of any use in this situation.

      PXE should be almost all you need... Set the machines to boot from the NIC first, and HDD second, but leave the Bootp and TFTP server off during the day... At night, turn on the netboot servers, and just reboot all the machines. You could either reboot them remotely, set them to automatically reset at a certain time, or just have employees hit the reset button at the end of the day.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    3. Re:Do I lose the use of my CD drive? by boron+boy · · Score: 5, Funny
      It's not that hard to do, even for lazy sysadmins
      I think you underestimate my degree of laziness.
    4. Re:Do I lose the use of my CD drive? by Anonymous Coward · · Score: 2, Informative

      WOL can definitely remote-start ATX machines that have been shut down. Requires support from LAN card/chip and motherboard, but most corporate desktops support the feature.

    5. Re:Do I lose the use of my CD drive? by pe1chl · · Score: 3, Informative

      W.O.L. doesn't power-up the system when it's been shut-off, so it's really not of any use in this situation.

      It doesn't sound like you've tried this.
      When configured correctly, it works. We do weekly maintenance and nightly installations of software that way. In some scheduled job, all systems get a wake-on-lan packet and they start, and run some install. The users are never bothered with it, unless their systems are offline at that time (e.g. laptops).

    6. Re:Do I lose the use of my CD drive? by Hast · · Score: 3, Informative

      It isn't a software thing. It's done in hardware.

      You need a network card which supports it as well as a mainboard which supports it (or with built in networking, that usually supports it).

      To start it up you send a "magic" package to the NIC which tells it to boot. AFAIK it's just MAC level package with all FF in the data field or something like that. The NIC will then boot the computer just as if you had pressed the power key.

  3. Think Lusers. by Soko · · Score: 5, Funny

    CHAOS is designed to provide dumb node power to a cluster

    Hell, my nodes are occupied by the dumb during the day, too. Have we found an actual productive use for lusers?

    Soko

    --
    "Depression is merely anger without enthusiasm." - Anonymous
  4. Wow... by CleverNickedName · · Score: 5, Funny

    Imagine a hackneyed cliché of these!

    --


    Unfortunately, I am not Wil Wheaton
  5. Good thing! by sachins · · Score: 2, Interesting

    Now I hope that SETI and those other protein folding projects can really get a boost. Who knows? A company which is carrying out its own research may actually be helping its competitor giving it the processing power in the nighttime! And what about i/p stuff, if someone makes a new finding will it be credited to the computer or to the whole cluster ? I think these have to be sorted out first. These issues have not come up partly because SETI and others have not found out anything significant yet. But who knows. that day might just be tomorrow!

    1. Re:Good thing! by De+Lemming · · Score: 2, Interesting

      Projects like Folding@Home already have generated usable results. Their FAQ answers the question "Who "owns" the results? What will happen to them?":

      Unlike other distributed computing projects, Folding@home is run by an academic institution (specifically the Pande Group, at Stanford University's Chemistry Department), which is a nonprofit institution dedicated to science research and education. We will not sell the data or make any money off of it.

      Moreover, we will make the data available for others to use. In particular, the results from Folding@home will be made available on several levels. Most importantly, analysis of the simulations will be submitted to scientific journals for publication, and these journal articles will be posted on the web page after publication. Next, after publication of these scientific articles which analyze the data, the raw data of the folding runs will be available for everyone, including other researchers, here on this web site.

  6. Precursor to the Grid? by kyle90 · · Score: 5, Interesting

    I remember hearing about how in the future, we would be able to plug in to the internet and not only access information but also spare processing power. It would be really handy; most of the time you are only using a fraction of the power of your computer (for example, my usage is hovering at around 8%, and I have a movie playing as well as several other applications running), but when you need more processing power, you could get it on demand. Of course, the lag would make it too slow for video games and such, but for some computationally-intensive stuff (video editing, ray-tracing, etc.) it would be perfect.

    --
    Real_men_don't_need_spacebars.
    1. Re:Precursor to the Grid? by davedx · · Score: 2, Informative

      Not sure what kind of distributed computing you can really do over latency measured in milliseconds. One of the big bottlenecks for today's supercomputers is bus/shared memory access time. I can't really see this being useful for much more than we already do - SETI@Home and so on, where you send packets to be processed and after a few hours the node sends them back.

      So yeah not sure if we could ever have a true supercomputer distributed over the net (as it is now, with the light speed as it is!) that's parallel in real time.

      --
      "This is your life, and it's ending one minute at a time."
  7. This is bound to help the cause... by Anonymous Coward · · Score: 4, Funny

    Corporate Linux Fundamentalist 1: There's this new product that uses all our PC's overnight to harness their power for the greater good. It runs on Linux. It would be a good way for us to become more Linux friendly in the workplace.
    IT Director: Um, sure, OK, what's it called?
    Corporate Linux Fundamentalist: Um, Chaos?

    Could they not of thought of a better name, how about .Grid or something else Microsoftie, well at least it wasn't called KAy05

    1. Re:This is bound to help the cause... by ggvaidya · · Score: 2, Funny

      It's not Chaos, it's CHAOS!

      Nothing puts executives on edge like the word CHAOS in big, bold letters :p

  8. Re:Seriously?? by sstrick · · Score: 5, Insightful

    No, but I can see companies that need to crunch large datasets installing this to do their own processing at night.

    --

    "Do you think we could wipe out world hunger forever if scientists figured out how to make AOL's Free CD's edible?"-
  9. Re:Seriously?? by Ersatz+Chickenweed · · Score: 5, Insightful

    Seems to me that what TFA is suggesting is that organizations can use this to gain part-time Beowulf capabilities on machines that could be running Windoze or whatever during normal office hours -- they wouldn't just be giving the processing time away to some random project over the Internet (although that could easily be done too), but using it for in-house projects where an outside connection probably wouldn't even be needed in most cases.

  10. CHAOS: Groovy Name by AhaIndia · · Score: 4, Funny

    "We were just looking for a groovy name that would stick out in a world of groovy names,"


    Actually their first choice was "Mandriva" but somebody had recently taken that "groovy" name... Aahhh, just missed!



    --
    ~Aha~
  11. Re:Might be some problems... by Jessta · · Score: 2, Informative

    We call the solution PXE booting. Never trust users to do anything.

    --
    ...and that is all I have to say about that.
    http://jessta.id.au
  12. for information by cotyx · · Score: 4, Informative

    Hello For information this kind of stuff already exists, from long time. I invite you to visit this webpage : http://www.lri.fr/~fedak/XtremWeb/introduction.php 3 Regards

  13. Quality by Indy+Media+Watch · · Score: 5, Funny
    From the press-release

    What is CHAOS - the supercomupter for your wallet?

    The most significant change to the project, as far as the open source community will be conerned, is the quality of the distribution

    As they are concerned about quality, any chance they could put all that unused computing power towards a Goddamned spell-checker?

    --

    Indy Media Watch-Proctologist of the Internet

  14. Re:Seriously?? by benjamindees · · Score: 2, Informative
    allow their PCs to be booted remotely

    The actual booting could be controlled locally.

    used for a task outside their control

    Yeah, I'd want to see some security measures in place, like running it in User Mode Linux or something. A dedicated client program like SETI@Home is one thing. A full OS with the capability to fsck with your hardware is another.

    which doesn't make them any money.

    But it could help save them money. Lots of OSS users have no viable way to contribute back to their favorite projects. Lots of projects could be helped by a vast pool of computing power "on tap". Surely somebody could come up with some interesting applications for a ridiculous amount of free CPU time?

    --
    "I assumed blithely that there were no elves out there in the darkness"
  15. WakeOnLan and NetBoot by Gollum · · Score: 3, Informative

    Here is a suggestion that would allow computers that are not in use to be "co-opted" for use in the cluster.

    Identify the PC's that COULD theoretically be used, and collect their MAC addresses. Also, configure them to try netboot first, then fall back to booting from the hard drive.

    When you want to perform computations, send a WakeOnLAN packet targeted to each of these computers. Wait for netboot solicitations, then, if you have recently sent a WOL packet to that computer, respond with an appropriate netboot directive, booting the PC into a cluster node configuration, with all details loaded from the cluster director.

    Otherwise, allow the netboot solicitation to time out, and the computer will boot into its normal configuration.

    Not sure how OpenMosix handles nodes that simply vanish, but users could simply reboot the PC when they arrive in the morning, if the computation is still ongoing. Otherwise, the cluster director could remote shutdown/reboot each node prior to the user arriving at work.

    Unused PC's would not consume power, cluster node PC's could be instructed to immediately drop the monitor into Power-save mode, etc.

    The cluster director could decide how many nodes to start, or the location of the nodes, to optimise the comms between it and the servers.

    An idea with potential, I think!

  16. How Old is This? by soniCron88 · · Score: 2, Insightful

    "An Australian security firm is about to launch a clustered Linux distribution based on openMosix..."

    You're kidding me, right? CHAOS has been out for some 2 years (at least). Unless I'm misunderstanding, or another Australian organization is doing this...:

    CHAOS Distro

    But what do I know.

  17. woof! by spurious+cowherd · · Score: 2, Funny
    Linux Distro turns PCs into Night-time Clusters

    Gives a whole new meaning to the phrase "zombie process"

    --

    Time flies like an arrow, fruit flies like a banana.

  18. I had this sort of idea by ajs318 · · Score: 2, Interesting

    I was thinking about "cheaper than free" software -- a Linux distro that turned your broadband-equipped computer into a cluster node while idle -- a couple of years ago. All that computing power going to waste ..... But I couldn't find a way to build a business model around it -- it was just too hit-and-miss for any task I could think of. What data is there that can be batch-processed in a completely non-time-critical fashion, and is so non-security-critical that it can potentially be shown to thousands of strangers?

    You could encrypt everything {and that would go some way to prevent tampering with the returned results}; but then, if you're going to process encrypted input and return encrypted results, that will eat a lot of your processing power. It's a bit like putting a V8 engine through a three-speed automatic transmission ..... in the end, it won't really do anything an old transverse four and man-tran can't, apart from drink fuel and leave you wondering why you bothered.

    There is a possibility of "inter-cycling" in certain, limited settings {using corporate desktop machines which typically have only a few gigs of apps and data for RAID-like backups of servers springs immediately to mind}. But outside of these circumstances, switching off when not in use and recycling when done with are the best ways of avoiding waste. There is often plenty of life in a used machine if it doesn't have to run a bloated graphical desktop environment and numerous accessories {wanted and otherwise}. And at least used PCs are something you can store up till you have enough of them to do the task you want to do ..... remote CPU time and bandwidth are only available for fleeting moments.

    --
    Je fume. Tu fumes. Nous fûmes!
  19. No thanks! by pandrijeczko · · Score: 3, Funny

    My company already runs Windows on desktops and there's more than enough "chaos" during the day without more needed during the night...

    --
    Gentoo Linux - another day, another USE flag.
  20. I need all the acronyms that haven't been used! by yecrom2 · · Score: 2, Informative

    Unfortunately, CHAOS isn't one of them. There was an article on CHAOS in Linux Magazine in 1996-97 somewhere. It stood for CHeap Array of Obsolete Systems. The author put together a set of 386, 486, and Pentium boxes that he bought bundled on a pallet. I think he used slackware and beowulf, but in the end, it actually had some pretty significant computing power. The computational power/Kwatt hour ratio wasn't very good though. I wonder if he ever had to run his furnace in the winter?

    I've got the Cheap and Obsolete part of his setup already, but not setup in an array.

    yecrom2

  21. Hello? McFly? by Spackler · · Score: 4, Interesting

    Nice. A hacking company wants me to load a tiny 6 megabyte linux client into my secure network that then becomes a dumb node in my cluster, "without disturbing (or even touching) the contents of the local hard disk". A company that says they use the power to crack passwords.

    Yeah, sign me up with the full knowledge of how many company network policies I would be violating, and the fact that I would not trust them as far as I could throw a datagram.

    Hmmm, it quacks like a duck. I would swear they taught us this in both "Social Engineering" and Advertising. Give the "mark" a little benifit, and then take over his world.

  22. Re:WTF??? by Professeur+Shadoko · · Score: 3, Informative

    This is at night. Elecricity is cheap at night.
    Well, at least in my country, where nuclear power plants like to have a steady load.

    Computing on workstations at night is probably waaaaaaaaaaay cheaper than on a supercomputer during the day, then ;-)

  23. The well kept secret of office PC's worldwide by wootest · · Score: 2, Funny

    Slave to Microsoft Office by day, supercomputer with immense powers by night!