Slashdot Mirror


RPiCluster: Another Raspberry Pi Cluster, With Neat Tricks

New submitter TheJish writes "The RPiCluster is a 33-node Beowulf cluster built using Raspberry Pis (RPis). The RPiCluster is a little side project I worked on over the last couple months as part of my dissertation work at Boise State University. I had need of a cluster to run a distributed simulator I've been developing. The RPiCluster is the result. I've written an informal document on why I built the RPiCluster, how it was built, and how it performs as compared to other platforms. I also put together a YouTube video of it running an MPI parallel program I created to demo the RGB LEDs installed on each node as part of the build. While there have certainly been larger RPi clusters put together recently, I figured the Slashdot community might be interested in this build as I believe it is a novel approach to the rack mounting and power management of RPis."

17 of 79 comments (clear)

  1. 5 - Profit! by wibblewibble · · Score: 5, Funny

    Dude, you should totally mine bitcoins with that bad boy!

    1. Re:5 - Profit! by Razgorov+Prikazka · · Score: 2

      ...Then you can buy more of these 'bad boy`s' to make even more BTC, buy even more 'bad boy`s' yet... Before you know it: WORLD DOMINATION!!!
      You could be driving around in one of these next week! (http://www.youtube.com/watch?v=cDoRmT0iRic)

      --
      rm -rf --no-preserve-root / ...and let /dev/null sort them out...
  2. Hm... by Anonymous Coward · · Score: 5, Funny

    A new Raspberry Pi cluster Fram Boise University, eh?

    1. Re:Hm... by hughbar · · Score: 2, Insightful

      Yes that's funny, but no-one much on here knows French...

      --
      On y va, qui mal y pense!
  3. Different concept: HA Clustering by DF5JT · · Score: 4, Interesting
  4. Obligatory Blake 7 Reference by Grumpinuts · · Score: 2

    It looks like Orac.

  5. Slow Pi by Anonymous Coward · · Score: 2, Insightful

    Running the numbers from the paper says the $1000 x86 compute node took 3.85 seconds on a benchmark, where the RPI cluster took (456/32)=14.25 seconds and also cost about $1000. Thus, after porting the software, a 3.7 times slow down was achieved over traditional methods.

    While there may be some gains (GPIO and such may be useful in this context) they didn't appear to be used here.

    This looks like a fun project, that got research money, but was not very useful for the goal the money was supposed to be spent on. I haven't looked into the details, and I expect the parts may get reused for other projects later, but still, it seems kinda silly. The RPI was not build for that, its inefficient to use it that way.

    1. Re: Slow Pi by Cenan · · Score: 2

      So you can make it faster by adding more hardware or.... adding more hardware. Parallel and distributed are two very different things, and you cannot run a distributed anything on a single cluster, if you do, it would be properly named parallel. Anyways, the comparison is still valid - the RPI cluster failed to deliver; it was slower, was just as expensive as their benchmark x86 machine and probably 1000x as complex.

      You're right in what you say about algorithms, but it only holds if you already have unused cores to run the new algorithm on - the actual reason we try to derive parallelizable algorithms is because at the moment, processors with multiple cores are cheaper than mutliple processors with one core. I'm sure the researchers had fun doing this, but there is little to be gained from this paper except to conclude that if you want to build a parallel cluster, don't use RPIs.

      On a side note (not aimed at above poseter), if you build something like this and measure the power consumption, don't fucking add all those lights. This research looks like it would barely be worthy of a high school paper, and if that is the standard at Biose - oh.my.god. I mean, half the paper deals with installing packages on Linux. shut the fuck up, we know this already, do some actual research.

      --
      ... whatever ...
    2. Re: Slow Pi by K.+S.+Kyosuke · · Score: 2

      anyhow, I would wager that the point here is just to test the parallel algorithms on real hw - not to run them fast, but to prove that the basic ideas work.

      I guess the issue is that building this cluster for accurate testing of the behavior of distributed algorithms was probably cheaper than trying to build an accurate simulator for it running on a desktop workstation would have been.

      --
      Ezekiel 23:20
    3. Re: Slow Pi by TheJish · · Score: 4, Informative

      You seem to be missing the point of this completely. ;) I needed a cluster to test some distributed programs (yes, you can test distributed programs inside a cluster). The cluster itself has nothing to do with my PhD work other than that it is a tool I created to ensure I could test the software I've been developing. As for providing a tutorial on how to do what I did, I was writing this to enable freshman engineers understand what was involved with building the cluster. Not everyone knows Linux, or how simple it is to build a Beowulf cluster.

  6. Rack mounting? by thegarbz · · Score: 4, Insightful

    Not to diminish your achievements which are otherwise quite cool, but this novel approach to rack mounting is anything but. Quite possibly the single most important feature of a rack is ease of component access. By tying all components together with PCB standoffs you basically can't remove a single RPi if there's ever a pressing need.

    If anything you've shown a novel way of cramming things together without the use of a rack.

  7. should this perhaps be at RPI instead? jk! by girlinatrainingbra · · Score: 3, Insightful
    With a name like that (RPiCluster), perhaps it ought to be situated at the R.P.I. in Troy, New York? Though for that nomenclature geographicalocalization, the Republican Party of Iowa has as much claim to RPI as these others do. I like the justification pointed out by the builder of this RPi.Cluster: The RPi platform has to be one of the cheapest ways to create a cluster of 32 nodes. The cost for an RPi with an 8GB SD card is ~$45. For comparison, each node in the Onyx cluster was somewhere between $1,000 and $1,500. So, for near the price of one PC-based node, we can create a 32 node Raspberry Pi cluster! [from the pdf file at http://coen.boisestate.edu/ece/files/2013/05/Rasp.-Pi.pdf ]

    So the summary of the informal document is that it's cheaper to build a 32-node Rasp.-Pi cluster than to purchase even a single node of the 32-node Beowulf cluster that may or may not be available to you. And if you want to get your Ph.D. work done, I must agree that it sounds better to not be dependent upon the whims and follies of others' benevolence in having external hardware clusters available for your use. Bravo, Joshua Kiepert, I like your "informal writeup". Best wishes on your work!

  8. Made for specific availability + project priority! by girlinatrainingbra · · Score: 4, Informative

    it looks like the purpose behind this project is to have an "always available" (to this Ph.D. student) 32-node cluster that is dedicated to doing the work which this dissertation student needs to perform in order to complete his Ph.D., and it makes sense to be able to do this for the cost of a single Xeon node in a larger beowulf cluster.
    .
    This lets him escape the externalities which might impinge on his getting his own work done, like the big bad Beowulf cluster not being up or available when he needs it, or it being prioritized for someone else's project (say a professor who has tenure and more funding available). Those sorts of shenanigans would delay his work. So a 1/3rd speed cluster that's always available for your own project is a helluva good deal at 1/32 the cost of the big bad beowuilf cluster, eh? At least I think so!

  9. Comms and network testing needs hardware!!! by girlinatrainingbra · · Score: 4, Informative

    Right, but a "vastly superior computing solution" for CFD or linear equations is one thing. Trying to simulate network communications activity for 32 or 33 nodes on a single compute node is probably slower than actually trying out the algorithms on dedicated hardware that instantiates an actual hardware network. Thus, for a project that tries out different networking and communications algorithms, a 3 times more expensive by your calculations might actually end up being 10 times less expensive, especially considering the locking and interprocess communications required in a multi-threaded simulation on a single compute node vs. actually running it on real hardware with 32 nodes and an ethernet network linking the 32 nodes.
    .
    Especially considering that this system is going to be used for wireless communications protocols, the real hardware solution is IMHO the better way to go.

  10. acronym for F.R.A.M. + Boise = red + sour by girlinatrainingbra · · Score: 4, Interesting
    Haha. It would have been funny (or funnier) if this guy had come up with the acronym FRAM for this project and then called the page (or overall project) FRAM-Boise , perhaps: Facilitated
    Raspberry.Pi
    Architectural
    Messaging

    since he says in his pdf document that " My research is currently focused on developing a novel da ta sharing system for wireless sensor networks to facilitate in-network collaborative processing of sensor data. In the process of developing this system it became clear that perhaps the most expedient way to test many of the ideas was to create a distributed simulation rather than developing directly on the final target embedded hardware."

  11. welcome to the home of jealous haters by decora · · Score: 4, Interesting

    i wish i had done this, therefore you suck.

  12. Re:Very impressive by Ignacio · · Score: 2

    Yes, as he threw a real power supply at it instead of using the crappiest USB adapter he could find.