Slashdot Mirror


Homebrew Cray-1

egil writes "Chris Fenton built his own fully functional 1/10 scale Cray-1 supercomputer. True to the original, it includes the couch-seat, but is also binary compatible with the original. Instead of the power-hungry ECL technology, however, the scale model is built around a Xilinx Spartan-3E 1600 development board. All software is available if you want to build one for your own living room. The largest obstacle in the project is to find original software."

35 of 140 comments (clear)

  1. The originals really are something else by Skyshadow · · Score: 5, Interesting

    Back when I was an intern with SGI, we took a day off* to visit the Chippewa Falls Museum**, which has a good-size collection of Control Data and Cray Supercomputer relics along with other items relevant to my interests***.

    I got to poke around inside of an original Cray-1. To me, the most interesting thing about it was just how insanely packed the internal wiring was; I'd been expecting the intricate plumbing, but the sheer volume of wires running from Point A to Point B was really impressive. I mentioned this to the guy giving the tour, who turned out to be a retired manufacturing supervisor -- he told me that the hardest part of his job was finding women with both enough skill and small enough hands to handle the internal wiring jobs. The thing had been assembled *by hand*, every connection in this crazy bulk of wired clipped or soldered into place one after another.

    Anyhow, after that I sat on the couch. It was not comfy.

    * My boss was *pissed* about this -- she went around telling anyone that would listen that "interns are here to work, not go sightseeing". This marks the one and only time in my career that anyone in HR has ever done anything worthwhile, calling her up and telling her this was part of the program and she didn't get a vote.
    ** Seymour Cray moved to Chippewa Falls, his hometown, when he was still with Control Data because he felt most middle managers wouldn't want to drive that far just to bother him. Visionary man, that Seymour Cray.
    *** Stuff from Leinenkugals.

    --
    Every year during my review, I just pray the words "slashdot.org" aren't mentioned.
    1. Re:The originals really are something else by blair1q · · Score: 4, Interesting

      IIRC, they also deliberately hired both tall and short women, and assigned the appropriate subset of connections to each.

    2. Re:The originals really are something else by drfuchs · · Score: 5, Informative

      "Why," you may ask, "was the internal wiring so insanely packed?" The length of each point-to-point wire was individually calibrated, such that all the signals to each gate arrived at the same moment, so you didn't need flip-flops to latch values in the flow of the circuits. Kind of a "just-in-time delivery" of electrons; and each layer of buffering avoided saved you delay along the pipeline. I don't think this sort of scheme was used on any other mainframe.

    3. Re:The originals really are something else by Tom+Arneberg · · Score: 5, Interesting
      The originals are definitely worth seeing! I am surprised how few people take an hour to see the Cray museum (now called "Chippewa Falls Museum of Industry and Technology", http://cfmit.org/). The museum used to be housed in the Engineering building (where I'm typing from right now). I had to get a special camera pass to take our family Christmas Card picture with a Cray 1 in 1991: http://arneberg.com/family/xmas/xmas_card.cgi?1991 (Sorry about the photo quality...those scans were made in the mid-90s; I really should re-scan with modern technology!)

      BTW, the Leinie's Lodge is also well worth visiting! It's less than a half mile from the museum, and is actually the number one tourist attraction in at least a 50-mile radius.

    4. Re:The originals really are something else by conspirator57 · · Score: 4, Interesting

      a shorter way of saying this is "phase matched cables".

      http://www.mwjournal.com/journal/article.asp?HH_ID=AR_7184&tite=Phase%20Matching%20and%20Tracking%20of%20Coaxial%20Cable%20Sets
      pay no mind to the fact that it's discussing microwave applications. it's just as relevant to high speed digital (or lower speed, further distance) digital electronics. keep in mind how far this interconnect had to travel due to part density and cooling needs.

      of course for modern electronics one might use tunable LC networks on either end to accommodate variations in commodity sourced cables.

      also, i take issue with ECL being described as inefficient. CMOS is inefficient when transitioning a lot. ECL merely has a constant power drain, which also happens to make it less noisy. It was also differential before LVDS was cool (or even around).

      --
      "If still these truths be held to be
      Self evident."
      -Edna St. Vincent Millay
    5. Re:The originals really are something else by dcraid · · Score: 4, Interesting

      For those of you in/visiting the DC area you can check out a couple of old Crays @ the National Cryptologic Museum on the outskirts of Ft Meade. http://www.nsa.gov/about/cryptologic_heritage/museum/virtual_tour/index.shtml

      On exhibit in the museum are two Cray supercomputers. The XMP-24 on display is the upgrade to the original XMP-22 that was the first supercomputer Cray ever delivered to a customer site. It was in operation from 1983 to 1993 and was arguably the most powerful computer in the world when it was delivered. It used serial processing to conduct 420 million operations per second.

      The second generation Cray, the YMP, replaced the older version in 1993. It had a 32 gigabyte (32 billion bytes) memory capacity. In 1993 most personal computers held only 16 million bytes. The YMP used vector processing, a very powerful form of overlapping, parallel processing to conduct 2.67 billion operations per second. The YMP was decommissioned and went on display at the museum in 2000.

      The museum is lots of fun and definitely worth a visit.

  2. Xilinx... by TrisexualPuppy · · Score: 4, Informative

    I built a PVP11 "supercluster" and started with Xilinx. The hardware is great, but their software toolset is horrendous.

    After months of free time development, I switched over to surplus Altera Stratix II video decoder hardware, got a copy of Quartus II, and was moving within weeks. Altera would be my suggestion for any geek who wants to try something similar!

    1. Re:Xilinx... by TrisexualPuppy · · Score: 3, Interesting

      (Sorry, make that PDP11! It's been over a year since I replicated this ancient architecture.)

    2. Re:Xilinx... by blair1q · · Score: 4, Funny

      And you've been playing WoW on it ever since.

  3. Apparently... by Anonymous Coward · · Score: 5, Funny

    Not even a cray supercomputer can survive the slashdot effect.

    1. Re:Apparently... by MarkRose · · Score: 5, Funny

      Hey! The computer predates Slashdot by two decades, for craying out loud!

      --
      Be relentless!
    2. Re:Apparently... by idontgno · · Score: 5, Funny

      I Seymour what you did there.

      --
      Welcome to the Panopticon. Used to be a prison, now it's your home.
    3. Re:Apparently... by Anonymous Coward · · Score: 4, Funny

      I hope you realise that jokes of this quality will get you downmodded. And when that happens, don't come craying to me.

  4. Wow! by line-bundle · · Score: 5, Interesting

    Now that's closer to true News for Nerds, Stuff that Matters. Not the Mac fish tanks.

    However, I am a little disappointed that he didn't do something with the tower part of his cray. Cooling perhaps? Blinkenlights?

    How does it compare in performance with the original?

    1. Re:Wow! by Neon+Spiral+Injector · · Score: 4, Informative

      It's instructions execute accurately clock-for-clock, but running at 33 MHz instead of 80.

    2. Re:Wow! by firewood · · Score: 3, Insightful

      Half the fun of explaining the Cray 1 during museum tours was comparing its cycle time to the time it took light from the nearby ceiling spotlight to hit the Cray. At 33 MHz that would require a really tall room.

    3. Re:Wow! by Space+cowboy · · Score: 5, Informative

      S3E's have DCMs (Digital Clock Managers) making them very flexible in terms of what the internal clock frequencies are, even with a fixed input frequency.

      Chances are (I can't get to the site) it just runs at 33MHz as its best-supported clock frequency. An S3E is a pretty cheap and slow FPGA - I remember writing a 32-bit CPU for one, and until I started optimising the logic-placement in the FPGA, it was only running at ~30MHz. I got it up to ~50MHz after tweaking and pipelining, but his design may do more than my simple CPU.

      Simon

      --
      Physicists get Hadrons!
    4. Re:Wow! by nacturation · · Score: 3, Interesting

      Why, cray tell, does it run so slowly?

      You do realize the Cray-1 is from the late 1970s, right? 80MHz with this architecture was smoking fast.

      --
      Want to improve your Karma? Instead of "Post Anonymously", try the "Post Humously" option.
  5. he isn't running his webserver on it, is he? by blair1q · · Score: 4, Insightful

    because it just got slashdotted...

  6. No software by dk90406 · · Score: 5, Interesting

    He has the needed software for the FPGA, but he has (so far) been unable to find some software to run on the machine. At least that is what I got from the TFA. It seems like no-one (including various 3 letter agencies) have copies of stuff so "old".
    Never the less, I have to admire the effort put into this.

    1. Re:No software by permit594 · · Score: 5, Interesting

      The original Crays were delivered with no software -- not even an OS. We had to roll our own OS. I started at Sandia Labs in 82 as a fresh PhD. I still had some work to do on my software-based dissertation, so I got to play on the "new" Cray. I had been used to waiting a *long* time for my (FORTRAN) program to compile on UCLA's IBM 360... The first time I compiled on the Cray, it finished so quickly I thought I had a syntax error in my job submission command. For the times, that machine was FAST!

    2. Re:No software by WrongSizeGlass · · Score: 3, Funny

      He has the needed software for the FPGA, but he has (so far) been unable to find some software to run on the machine. At least that is what I got from the TFA. It seems like no-one (including various 3 letter agencies) have copies of stuff so "old".

      Maybe he'd have better luck finding old software if ageism wasn't rampant in the IT industry ;-)

  7. Pretty cool! by oldhack · · Score: 5, Insightful

    This is the sorta hack that should feature on the front page, instead of machining tin can case and similar tripes.

    Hope he gets some software for that thing.

    --
    Fuck systemd. Fuck Redhat. Fuck Soylent, too. Wait, scratch the last one.
  8. Re:But by rubycodez · · Score: 3, Informative

    well, this is a mid 70s computer, so it must have run CP/M 8D

    if he really does want to run real Cray software, he'll have to implement the interrupts and context switching for Cray Operating System (COS) or the Unix Unicos

  9. Re:But by WrongSizeGlass · · Score: 4, Insightful

    Doesn't everything run Windows?

    Everything runs Linux, but Windows seems to run everything.

  10. NCAR by Fishbulb · · Score: 5, Informative

    Send an email to the folks at the CISL division of NCAR.

    They know a thing or two about Crays.

    1. Re:NCAR by cruff · · Score: 3, Informative

      See my reply earlier on in this discussion. We didn't keep any of the Cray software, unfortunately.

  11. Really cool by cygnwolf · · Score: 5, Insightful

    Again one of those instances where it'd be nice to be able to mod articles. This is the kind of stuff that needs to be on slashdot.

    --
    Free Pie! The Pie is Also Evil!
    1. Re:Really cool by AvitarX · · Score: 4, Interesting

      I clicked the "+" next to the title, then selected "interesting"

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
  12. Chris - see the Supercomputer Centers, CMU, UCSD by garyebickford · · Score: 5, Informative

    I think there were (are?) four of Supercomputer Centers that had Cray 1 and later Cray X-MP machines. The Pittsburgh center did a lot of work with Carnegie Mellon, esp. the Robotics Institute.

    I personally did one bit of work - porting a photometrically correct ray-tracer by Dr. Robert Thibadeau in the Image Understanding Laboratory from an Apollo workstation to the Cray at PSC - this would have been in 1989, I think. The one complication we had was that the Cray floating point format was different, so our first runs were all zeros. Other than that the code compiled and ran fine on the Cray. Of course, a run that took two weeks on the Apollo ran in about 40 seconds on the Cray.

    A lot, maybe all of the work done on these machines was non-spooky research so perhaps you can track some of the professors at the associated universities, such as CMU, Northern Illininois, UCSD, Berkeley, etc. Also check out the weather folks - they have been among the biggest CPU cycle-burners for a long time. I worked briefly with one weather guy at a weather research facility in Wyoming but I don't recall any details - was it U Wy?
    The SCs I recall are:

    • SDSC (San Diego Supercomputer Center),
    • PSC (Pittsburgh Supercomputer Center).
    • NCSA (National Center for Supercomputing Applications)

    I'm sure that if you dig around in the universities you'll find folks who have stuff piled on a back shelf somewhere (probably in a tape format you can't read). Also look up in the old annals of the ACM SIG on supercomputing - that will give a line on researchers who were working on the Cray.

    --
    It's easier to be a result of the past, but more fun to be a cause of the future! http://www.spacefinancegroup.com/
  13. ARTICLE TEXT by Brietech · · Score: 4, Informative

    As part two (see previous attempt) of my ongoing series in ‘computational necromancy,’ I’ve spent the last year and a half or so constructing my own 1/10-scale, binary-compatible, cycle-accurate Cray-1. This project falls purely into the “because I can!” category - I was poking around the internet one day looking for a Cray emulator and came up dry, so I decided to do something about it. Luckily, the Cray-1 hardware reference manual turned out to be useful enough that implementing most of this was pretty straightforward. The Cray-1 is one of those iconic machines that just makes you say “Now that’s a super computer!” Sure, your iPhone is 10X faster, and it’s completely useless to own one, but admit it . . you really want one, don’t you?

    The Cray-1A Architecture

    Now, let’s get down to specs - What is this bad boy running? The original machine ran at a blistering 80 MHz, and could use from 256-4096 kilowords (32 megabytes!) of memory. It has 12 independent, fully-pipelined execution units, and with the help of clever programming, can peak at 3 floating-point operations per cycle. Here’s a diagram of the overall architecture:

    cray_architecture

    It’s a fairly RISC-y design, with 8 64-bit scalar (S) registers , 8 64-bit/64-word vector (V) registers, and 8 24-bit address (A) registers. Rather than a traditional cache, it uses a ’software-managed’ cache with an additional 64 64-bit words (T registers) and 64 24-bit words (B registers). There are instructions to transfer data between memory and registers, and then register-to-register ‘compute’ instructions.

    One of the coolest aspects of this machine is that everything is fully pipelined. This machine was designed to be fast, so if you’re careful, you can actually get one (or more) instruction every cycle. This has some interesting implications - there’s no ‘divide’ instruction, for instance, because it can take a variable amount of time to finish. To perform a divide, you need to first compute the ‘reciprocal approximation’ (something we *can* do in exactly 13 cycles, it turns out) of the denominator value, and then perform a separate multiply of that result with the numerator.

    The vector instructions are particularly cool. A vector Add operation might take only 5 cycles to start producing results (remember, each vector can hold 64 values, so it takes 5 + 64 cycles to finish adding). Why wait for it to finish though? We can take the result output from the adder, and “chain” it straight into another vector unit (say a multiplier). And *that* only takes another 10 cycles or so, so we can chain that result into yet another unit (say, reciprocal approximation). Now, rather than waiting for the first operation to finish, we’re computing up to 3 floating point calculations per cycle. Clever programmers could sustain about 2 floating point operations per cycle, or 160 million instructions per second.

    vector_chainingVector Chaining in Action!
    The Hardware

    The actual design was implemented in a Xilinx Spartan-3E 1600 development board. This is basically the biggest FPGA you can buy that doesn’t cost thousands of dollars for a devkit. The Cray occupies about 75% of the logic resources, and all of the block RAM.

    spartan3_1600

    This gives us a spiffy Cray-1A running at about 33 MHz, with about 4 kilowords of RAM. The only features currently missing are:

    -Interrupts

    -Exchange Packages (this is how the Cray does ‘context-switching’ - it was intended as a batch-processing machine)

    -I/O Channels (I just memory-mapped the UART I added to it).

    If I ever find some software for this thing (or just get bored), I’ll probably go ahead and add the missing features. For now, though, everything else works sufficiently well to execute small test programs and such.
    The Software

    When I started building this, I thought “Oh, I

    --
    I'm perfect in every way, except for my humility.
  14. Re:Can't find the software? by Jeremy+Erwin · · Score: 5, Interesting

    It's obvious from your comment that you haven't downloaded and inspected his source code. It includes some verilog files for making the FPGA behave like a Cray-1, and some python files for debugging it and loading opcodes into the simulated cray. However, if you want to run vintage 1970s computer applications----weather simulations, cryptanalysis, computational fluid dynamics, etc., you would be hard pressed to find any.

  15. NCAR Cray 1-A by cruff · · Score: 4, Interesting

    The new computing center is still under construction, so no supercomputers are located there yet. :-) Cray 1-A serial number 3 is in the hallway as an exhibit on floor 1B, and if you are near the NCAR Mesa Lab, it is open for self guided tours most days of the year.

    Serial number 3 was in active use until its decommissioning in 1989 and ran COS (Cray Operating System). It was connected to the NCAR designed Hyperchannel network known initially as the NCAR Local Network (NLN) and later as the Mainframe and Server Network (MASnet). There were rows of 100 MB and 200 MB "washing machine" disk drives connected to it, and it had access to the NCAR Mass Storage System (MSS) for archival storage. Graphical output could be sent to plotters, large Xerox printers, B&W microfiche or B&W or color 35mm film. For a speed comparison, I once ran a Madelbrot generator to produce a 640x480 image on both the Cray 1-A and a Sun 60 workstation. The vectorized C code on the Cray took just under 8 seconds, the Sun several minutes to produce the image. Alas, we don't have much in the way of documentation anymore nor is there any of the original software.

  16. Seymour Cray and Steve Jobs by braindrainbahrain · · Score: 3, Informative

    Ages ago, I heard this story. Can anyone confirm if this is true or not?

    Seems Steve Jobs, upon the success of the first Macs, was getting ready for the next step and he went to Cray Computer to buy one (probably to help design the PowerPC?).
    Anyway, Cray Computers were not just sitting on the shelf waiting to be sold, so it seems Jobs created an altercation and demanded to see the manager about getting one, so they called Seymour down to the lobby. Steve introduced himself and said words to the effect of “I’d like to use a Cray to design the next Apple Computer”. Seymour replied “Thats great. I used an Apple Computer to design my Cray”.

    1. Re:Seymour Cray and Steve Jobs by tlhIngan · · Score: 3, Informative

      Seems Steve Jobs, upon the success of the first Macs, was getting ready for the next step and he went to Cray Computer to buy one (probably to help design the PowerPC?).
      Anyway, Cray Computers were not just sitting on the shelf waiting to be sold, so it seems Jobs created an altercation and demanded to see the manager about getting one, so they called Seymour down to the lobby. Steve introduced himself and said words to the effect of "I'd like to use a Cray to design the next Apple Computer". Seymour replied "Thats great. I used an Apple Computer to design my Cray".

      Not sure about your quote, but Apple did have a Cray. That's why they're address is "1 Infinite Loop" - the joke was the Cray was so fast, it ran an infinite loop in seconds.

      Then again, a quick Google came up with these links
      http://www.clock.org/~fair/computers/sgi-cray.html (it was used for a supercomputing project, and it was Sculley)
      http://www.thocp.net/biographies/cray_seymour.htm claims the quote is "When told that Steve Jobs bought a CRAY to help design the next Apple, Seymour Cray said, "Funny, I am using an Apple to simulate the CRAY-3." http://www.spikynorman.dsl.pipex.com/CrayWWWStuff/Cfaqp3.html#TOC23 seems to have a more detailed version of the Apple-Cray connection.

      I guess the next question is - why didn't Microsoft have one?