University Team Builds Lego and Raspberry Pi Cluster
hypnosec writes about a neat little hack using Lego, Raspberry Pis, and Scratch to construct a "supercomputer." From the article: "A team of computational engineers over at the University of Southampton led by Professor Simon Cox have built a supercomputer using Raspberry Pi and Lego. The supercomputer is comprised of 64 processors, 1TB of storage (16GB SD cards in each of the Raspberry Pis) and can be powered on using just a single 13-amp mains socket. MPI is used for communications between the nodes through the ethernet port. The team managed to build the core of the supercomputer for under £2500. Named 'Iridis-Pi' after University of Southampton's supercomputer Iridis, the supercomputer runs software that was built using Python and Scratch. Professor Cox used the free plug-in 'Python Tools for Visual Studio' to develop code for the Raspberry Pi."
Lots of pictures of the thing, and a howto on making your own.
The supercomputer comprises of 64 processors, 1TB of memory (16GB SD Cards in each of the Raspberry Pi)
Is it too much to expect from a tech site to not call SD cards "memory"?
Gussy it up however you want, Trebek. What matters is does it work? Will the Rasperry PI supercomputer calculate large prime numbers? Because I've ordered devices like that before - wasted a pretty penny, I don't mind telling you. And if the Rasperry PI supercomputer works, I'll order a dozen!
sudo make me a sandwich
One university managed to get a hold of 64 Raspberry PI units.
I was wondering when this would make it here. Seemed slower than I thought, anything Raspberry Pi is usually up in a heartbeat.
But really, this is neat.
They should have built a Beowulf cluster. The regular one is such a cliché.
"Hello, IT... Have you tried turning it off and on again? Yeah... No problem."
So a cluster of 64 pi boards don't exceed ~3 kilowatts... Why would you expect them to given that they are supposed to run from a 5V supply at 1A (5W * 64 = 320W)
Sorry but doesn't even crack the top 10,000's in machine performance, not exactly a super computer. A cluster yes. Super computer, HPC machine, etc. no.
I still don't have a Raspberry Pi - this University took them all!
Can we now retire "Bewolf cluster" jokes?
Aaaargh...imagine a.....in the Soviet Union....***carrier lost***
Calling this thing a cluster.. fine.
Calling it interesting for students to learn about how clusters work... fine.
Calling it a supercomputer? Maybe if the University of Southampton got sucked into a time vortex to the early 1990's, and even then while the raw theoretical number crunching capability of the RPis would be impressive, the lackluster I/O and interconnects would mean that even supercomputers of that time would still win on many common workloads.
AntiFA: An abbreviation for Anti First Amendment.
Cluster of Raspberry Pis = Bramble. Slashdot has been so drooly over every nitpicky update about these, I thought everyone here would know that by now.
Whenever I see "professional" projects like this use legos- I have mixed feelings. Here is another example, a lab using legos for automation
I love to see legos doing advanced things, but for a chassis? I feel like people can be very smart, but sometimes afraid to learn how to build something with their hands. The lab example I posted above is at Cambridge University. Cambridge has a very competent engineering department, why not reach out to them?- It could have made for an excellent project for some engineering students.
I'm reminded of the very cited researcher who reinvented some calculus instead of simply reaching out to someone in another department for help
...without a "short person table".
I get 64 cores a hell of a lot more memory and storage in a single quad proc server. Does this make every new VM or DB server I buy a supercomputer? It's not even drawing as much power as this stack. Maybe there planning on using there undocumented GPU's I can throw a couple of those as well and still trounce this setup. Am I missing something? Besides the putting them together with legos with his I assume son.
No sir I dont like it.
I'm a big fan of the RP project. But I'm a bit bored of seeing news items in which someone does something with this Linux box, which obviously a Linux box can do. Raspberry Pi compiles C! Raspberry Pi controls a robot! Raspberry Pi runs MAME! Well of course it does, it's a little PC, and that's what PCs can do.
I would like to recommend the red and white suited astronaut lego people to maintain the server, or to work as sysadmins. They seem very dependable. If not them, then maybe the Lego people from the 70s that didn't have the smiley face painted on them. They seem more analytical and inclined to this type of work. Anybody remember them?
Wouldn't a dual Xeon server be able to easily out-muscle that "supercomputer"?
"Here Lies Philip J. Fry, named for his uncle, to carry on his spirit"
64 SoC 700mhz cores connected via universal serial bus ethernet controllers, using flash memory that can at best pull about 10-30MB/sec read, and maybe 10MB/sec write if you're lucky.
If this is an example of applying high-performance computing and data handling techniques to tackle complex engineering and scientific challenges", this is a massive fail.
$4,000 buys you at retail (not with any sort of educational discount) a 1U machine (ie, a formfactor of about one quarter or less) with 12 Xeon 2Ghz cores connected by a bus that is orders of magnitude faster. 20-40MB of L3 cache between the processors. 16GB of ram (32GB if you're willing to spend another $600 or so), and TWO terabytes (wow, two!) of storage that will run at well over 100MB/sec sequential read. And guess what? It'll run on "one mains socket" too. In fact, because you don't have 64 separate DC linear regulators, it might even be *more* efficient.
Spend $7k and you can get 64 xeon cores on four chips...still in 1U...
Please help metamoderate.
Supercomputer as in ' Super Structure' not as in ' Super Man'
Avoid your fears , or wonder at the past
I really love this project, it warms the cockles of my heart, but I must admit to something here...
You can do much better for much cheaper. For 2,500 GBP, you would be much better served if you used multi-core AMD CPUs (e.g. 12/16-core, soon to be 24-core), used multi-processor motherboards, put together a few workstations and networked them together. Much faster CPUs, substantially more memory, much cheaper and higher capacity storage. In a $/performance and performance/Watt comparison, it would be hard to beat the configuration I'm proposing.
I've managed 75%+ parallel processing efficiency with a setup similar to the one described above - very much worth the money/effort.
I just did the math. The Pi community supposedly recommends a minimum of 1A@5V if you intend on using any peripherals, including ethernet. 700mAh is the minimum draw with *nothing* connected. 5W x 64 = 320W. That's quite close to the max capacity of the power supply for the dual-socket machine I mentioned. The E5-2620 processors have a max TDP of 95W each. Now, that doesn't count the auxiliaries - but there's still a 120W difference between typical power usage for the Pi, and MAXIMUM power usage for the Xeons, and I haven't even counted the power loss from the AC-DC power supply against the Pi (the rackmount machine's supply is ~95% efficient.)
Please help metamoderate.
Can I get nominated for that award? I'm creeped out by his Mini-Me son.
All parents that dress their children as tiny doll versions of themselves actually.
Sig. Sig. Sputnik
Why the hell do you think the rest of us can't find any?
You clearly need to turn in your Slashdot commenter license... to REALLY entice editors to post a story, work BitCoins into the mix. Oohh... better yet, work in references to the MPAA, And Ubuntu, and whatever else can be stirred into the pot. References to MAME are old school... (although that can be forgiven, Mr. 4-digit UID.)
How does this sound? "Raspberry Pi used to mine BitCoins to help pay an MPAA Lawsuit Fine. However, due to a security hole in Ubuntu caused by the new Unity interface, the new coins were stolen from the user by someone claiming to be affiliated with Anonymous. Wil Wheaton offers to sponsor a live D&D game played with Arduino-programmed robotic miniatures to make up for the lost funds."
Did I miss anything?
Calculate the billionth digit of pi?
....I can't even get one! I've been in the Queue since before initial release and still have yet to receieve mine, and even got an email two weeks ago about further delays!
Still a really great accomplishement though.
Power Corrupts,Absolute Power Corrupts Absolutely, leaving one person(group)in charge is absolutely corrupt.
But unfortuntately they would not sell more than one per customer - Unless you purchased one from both RS and Farnell. :(
I'd even bought a rack mount case to house the cluster
N...
Electronic Music Made Using Linux http://soundcloud.com/polyp
This story has built out of Legos, and Raspberry Pis, so it's definitely worthy for the slashdot front page. But it could be better, like they called the order in from their Nokia phone and paid for it using Bitcoins.
Does it really have more computing power than a $2500 PC / worth of PC hardware (they did say core didn't they? So feel free to get 3-4 regular pieces of PC hardware in that case which it surely won't beat.)
Nothing super about it. Just multiple pieces.
Finding switches to do this would just suck. Most home switches are 8 port. So if you buy 9, 8 port switches and one 16 port 10 gig switch plug 7 in each of the first 9 switches that would get you to 63 that would leave one to plug into the hub. Plus each 8 port would need to be gig unless you can buy switches with single gig. or 4, 16 port gig switches with a ten gig uplink to a 10 gig switch any way you need enough to plug in all 64 +1 for the head node. any which way this is a switching nightmare. The head node needs a 10 gig so that it can handle all 64 nodes at 100 mbps. Each set of 8 gets close to a gig network traffic for the head node. so 64 nodes is 6400 mbps that is why I say 10 gig. Maybe I'm missing something but it seems complicated.
Even on modern PCs things like transcoding, compiling, etc. are still cpu-limited.
For 2500 POUNDS (Not euros or dollars! Only thing worse would be yen atm.) I could spec out a 64 core Interlagos rig with the same or more ram, way more storage space. possibly a few videocards for OpenCL capability, and keep it under a 13 amp breaker too.
More importantly it'd have a shitload less overhead than a 64 Raspberry pie setup using MPI.
I mean hell you could probably spank it with however many PS3's you could buy for the equivalent price.
I mean the whole cluster thing is cool and all, but why in god's name would anyone waste money on doing it with an inferior and cost in-effective setup like this?
While technically RAM is not part of the CPU itself, I think you'll find most people don't consider memory access when calling something "I/O limited". That's more along the lines of network ports, hard drive, USB, firewire, thunderbolt, etc.
I've been waiting since 26 June for my Pi. And this guy has 64, just for kicks! WTF?
Quite seriously, I wondered about making a cluster of Pis to replace a desktop PC I have running in the loft. It really just runs some web servers, PHP, Mysql and a few other fiddly things. I wondered if I could potentially even dynamically boot up Pis to cover load (ie. spin up some extra web servers when load increases). My big problem is the DB though - I mainly use Drupal, so don't have separate read and write DB handles, so I can't scale MySQL horizontally. Also, the ethernet isn't very fast, so the interconnects probably wouldn't work very well either. I thought about maybe using Beaglebones or Pandaboards. Whilst that have faster CPUs, they still only have 100MB networking, so probably a little less than ideal. After working through all that, I don't suppose I'd save that much power (or space?) from the desktop.
How do you build a supercomputer out of processor modules that cannot reliably communicate with each other. The ethernet connectivity of the pi is based on a small module that attaches to the USB. I don't get it...
Is your comparison fair? I don't work with hardware, so I claim no expertise here, but a quick shopping list shows:
- $549 at NewEgg for one AMD Opteron 6262 HE Interlagos 1.6GHz 16-Core Server Processor
- 4 x $549 = $2196 for just the CPUs?
- £2500 (GBP) ~ $4047 (USD)
- $4047 - $2196 = $1851
Is it really that much cheaper or better for their purpose? They're not looking for power/$ ratios. Clearly you would have a few Dollars left over to buy the other required parts for your server.
Please keep Purchasing Power Parity (PPP) in mind. Prices in the UK are not the same as in the US, simply using currency exchange rates does not give a meaningful comparison.
Fart through a brick of legos and itll be up on slashdot..! *Yawn*