Slashdot Mirror


Big-Iron to Open Up for AMD

vincecate writes "Traditionally the key chips that have allowed companies to scale multiprocessors to large numbers have been proprietary. Some examples are the Cray SeaStar, SGI NUMAlink, HP sx1000, and the IBM X3/Hurricane. This proprietary paradigm is about to change to a more open one. Two companies have developed key chips for building large Opteron multiprocessors, and they will be commercial off-the-shelf parts. PathScale has released InfiniPath which can be used with an Infiniband switch to make a high-bandwidth low-latency interconnect for a supercomputer cluster. The other company is Newisys, which will soon release the Horus chip. This chip will make it possible to build 32 socket (64-core) shared memory Opteron systems."

40 of 179 comments (clear)

  1. it's about time by qwertphobia · · Score: 4, Funny

    It's about time! That z990 under my desk just isn't fast enough :-)

    --
    Never ask for directions from a two-headed tourist! -Big Bird
    1. Re:it's about time by csirac · · Score: 3, Funny

      You must have a tall desk :-)

  2. Expect to see.... by 8127972 · · Score: 4, Funny

    .... an Alienware game system with this chipset by the end of the week.

    --
    This is my opinion. To make sure you don't steal it, it's covered by the DMCA.
    1. Re:Expect to see.... by Hal_Porter · · Score: 2, Informative

      Actually, I don't think it would help much. Most games now don't benefit from 2 way SMP, so the benefit from 64 way is debateable to say the least. Still for servers, this thing might help. I suspect that most server applications/os's will have servere scaleability problems once you go this far SMP though.

      BTW, Has anyone heard of the MLX1. Makes you wonder what would happen if you put a bunch of these on a chip with some clever caching and the mother of all memory controllers. x86 Niagra anyone.

      --
      echo -e 'global _start\n _start:\n mov eax, 2\n int 80h\n jmp _start' > a.asm; nasm a.asm -f elf; ld a.o -o a;
    2. Re:Expect to see.... by Peter+La+Casse · · Score: 3, Funny
      Actually, I don't think it would help much. Most games now don't benefit from 2 way SMP, so the benefit from 64 way is debateable to say the least.

      64 processors will let you run a lot more spyware before your frame rate is affected.

    3. Re:Expect to see.... by Cromac · · Score: 2, Funny
      Actually, I don't think it would help much. Most games now don't benefit from 2 way SMP, so the benefit from 64 way is debateable to say the least. Still for servers, this thing might help. I suspect that most server applications/os's will have servere scaleability problems once you go this far SMP though.

      Fortunately all computing isn't about games. With this setup you'll be able to encode those DVD rips to DIVX in seconds instead of hours!

    4. Re:Expect to see.... by Hal_Porter · · Score: 2, Interesting

      I know it's a non-traditional here, but I looked up the benchmarks when the dual core chips came out.

      E.g.

      http://www.anandtech.com/printarticle.aspx?i=2410

      "Gaming performance is, currently, highly based on single-threaded performance and thus, we see no benefit from dual core. The thing to keep in mind here is that AMD's dual core solutions are closer to their fastest single core offerings in clock speed, so they end up performing more like their Athlon 64 counterparts in games - which has always been quite strong."

      Look at Doom III, the fastest dual core chip runs slower than the fastest single core. In fact you can pretty much predict performance from clock speed, regardless of the number of cores. So you'd be better off getting the fastest single core chip if that's what you care about.

      --
      echo -e 'global _start\n _start:\n mov eax, 2\n int 80h\n jmp _start' > a.asm; nasm a.asm -f elf; ld a.o -o a;
  3. Do not count out Sun by Anonymous Coward · · Score: 2, Insightful

    Give it another few months and I'm sure Sun will have some server with an obscene number of opterons in it, if thier current direction is any indication ....

    -GenTimJS

    1. Re:Do not count out Sun by rubycodez · · Score: 2, Interesting

      but that's a high-speed networked cluster, not a shared memory one? A 32 or 64 way shared memory opteron cluster is a threat to Sun's big-iron Ultrasparc boxes, would likely outperform them

    2. Re:Do not count out Sun by twiddlingbits · · Score: 2, Insightful

      UltraSPARC processors are due for an upgrade in early 2006. It's called and UltraSPARC IV+ and should be performance competitive with the Opterons. The problem is if folks already have a lot of SPARC based software X86 architectures are not a real option for them as the software is not portable. Some vendors of SPARC solutions may prefer to NOT support the X86 for various reasons. Sun will still have a market.

    3. Re:Do not count out Sun by Somegeek · · Score: 2, Informative
      Quoth twiddlingbits:
      The Sun Opterons will run Linux, thats not proprietary.
      TFA is about hardware, not software. What OS Sun runs on their servers is irrelevant to this discussion.

      Quoth twiddlingbits yet again:

      The hardwre implementations of such multi-processor are proprietary unless they are use PCI-X as the backplane to interconnect the processors, memory and peripherals.
      I don't think that you understood the word 'proprietary' in this context. Sun's technology, as well as (IBM's, SGI's, Cray's, etc.) is something that they each independently developed solely for their own company's use. They do not share or sell this technology to third parties to enable those third parties to build their own large multi-way servers using that technology. That is why their existing solutions are called 'proprietary'. It has nothing to do with if the bus that they use to connect the components is based upon some published open standard, whether that be PCIe, HyperTransport, or one that you think defines 'non-proprietary'.

      The two companies listed in TFA have developed solutions specifically to allow third party companies, whether they be Dell or ASUS or someone else, to build and sell multi-CPU solutions without developing the CPU interconnect technology themselves. That is why these new solutions are not 'proprietary'. They are not kept only for the private use of the company that developed them.

      I hope that makes this point clear.

      --
      And as you tread the halls of sanity, You feel so glad to be, Unable to go beyond. I have a message, From another time..
  4. Imagine a... nah, too easy. by meringuoid · · Score: 4, Interesting
    Cheap shots about Gentoo and Doom 3 aside, this is cool to see. I imagine it warms the heart of a lot of us old AMD fanboys. Plus, with a bit of luck the extra volume will bring down the prices of the Athlon 64s we stick in our gaming boxen. Right?... Right?

    ... k, maybe not. Can't afford one anyway :-(

    --
    Real Daleks don't climb stairs - they level the building.
    1. Re:Imagine a... nah, too easy. by Mercano · · Score: 4, Funny

      I imagine it warms the heart of a lot of us old AMD fanboys.

      Plus anything else in the room it sits in. Great solution to the heating oil crunch! These things ain't P4s, but 32 CPUs is 32CPUs.
      --
      #include <signature.h>
  5. Clusters vs. single servers by Wesley+Felter · · Score: 4, Insightful

    SeaStar and InfiniPath (and don't forget the XD1) are great for building non-cache-coherent clusters, but those are mostly useful for running specially-written scientific applications.

    Horus is used for building Opteron ccNUMA machines with one OS instance that can run any Linux or Windows apps. It's a very different solution for a different market.

  6. Re:Big Iron? Uhhh... by kevin_conaway · · Score: 5, Informative

    Ehh, maybe. Normally "Big Iron" is associated with IBM but according to Wikipedia, the submitter is correct in using the term.

  7. Links by Red+Flayer · · Score: 3, Informative

    Just wanted to point out that the link to Newisys is just a blurb stating that AMD is releasing the Horus chip, and doesn't really have anything to do with Newisys, other than the fact that a couple of the people behind the AMD Horus release used to work there.

    Oh, and the Horus link is a PDF whitepaper... please warn when a link points to a PDF.

    --
    "Trolls they were, but filled with the evil will of their master: a fell race..." -- J.R.R. Tolkien on Olog-hai
    1. Re:Links by Wesley+Felter · · Score: 4, Informative

      No, Horus is developed by Newisys, but the people who initiated it have moved on from Newisys to AMD.

  8. Re:Big Iron? Uhhh... by BJZQ8 · · Score: 5, Insightful

    I think this represents a fundamental shift in what "big iron" of the future will be. Instead of a few ultra-reliable, ultra-expensive processors, we will use masses of somewhat-reliable, cheap processors. The 64-processor clusters are just the beginning. Sony/IBM's Cell is a step in that direction; lots of little processors, rather than one big one. Big Iron is just what you make of it, after all, and ultra-reliability in practice doesn't have to mean an archaic architecture in design.

  9. god damnit by Douglas+Simmons · · Score: 5, Funny

    You kids, with your ultrasparc risc processing synchronous hypermultithreading vax/vms redbox pbx mumbo jumbo and your Ska music. For Christ's sake, cut the cotton-pickin' bullshit and tell me which stocks to buy and which to short. Oh and that AMD "capturing" the retail market tip the other day? Thanks for costing me six thousand dollars, my wallet was too thick and giving me a bad back. Christ.

    1. Re:god damnit by mikael · · Score: 2, Funny

      In my day, we used to toggle the OS and each program in bit by bit, remembering each opcode from memory. A keyboard was a musical instrument, a mouse was a type of vermin, and a terminal was where you attached the grounding wire of a lightning rod.

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
    2. Re:god damnit by sconeu · · Score: 2, Funny

      You had lightning rods? We just told the tallest person... "Go stand in that there field!" when a storm came! And we LIKED it that way!

      --
      General Relativity: Space-time tells matter where to go; Matter tells space-time what shape to be.
  10. Re:SMP memory model? by Wesley+Felter · · Score: 2, Informative

    It's the same as the regular Opteron (otherwise stuff would break).

  11. Re:Big Iron? Uhhh... by bloosqr · · Score: 4, Informative
    Whats your definition of Big Iron?

    There is a Cray XT3 that runs at 15 Teraflops at Sandia and made out of 2ghz opterons and is currently the 10th fastest computer in the world. There is a similar machine over at Oak Ridge National Labs that runs at 14 Teraflops and is the 11th fastest computer in the world.

    In fact, those lowly AMD kids seem to also have their chips on the fastest machine at the Pittsburgh supercomputing center (ranked 33rd fastest computer in the world) and the US Army Research Laboratory (ranked 39th fastest) . The latter was actually being built by IBM for ARL, you know those guys who coined the term "big iron".

  12. Re:Compiler technology by Slashcrap · · Score: 2, Interesting

    My experience suggests that Suns compilers beat out GCC on single processor machines and more so on 8 and 16 processor systems.

    I didn't realise that the compiler was involved in optimising code for multiple processors. I thought it was the programmer that had to do that. I must have been misinformed.

    The benifit of Sun's mature sparc compilers might let you squeeze more performance out of a sparc box.

    So are you comparing the Sun compiler and GCC on Sparc or Opteron because you don't make that clear? One would expect the Sun compiler to do best on Sparc since nobody else has ever been that interested in it.

    If on the other hand, you are claiming that Sun have suddenly produced the best compiler for AMD's Opteron then I would like to see some more evidence.

  13. Re:Is 32 by nganju · · Score: 5, Funny


    For this context, 32 is plenty large. Large is relative. If you ask me how many grains of rice I ate last night, 100 would be a small number. If you ask the average slashdotter how many women he's dated, 1 is a huge number.

    --
    There are 2 kinds of people in this world. Those that can keep their train of thought,
  14. threat to big iron by rubycodez · · Score: 2, Interesting

    A 32-way SMP dual-core opteron box is a serious threat to Sun Enterprise boxes with 64 to 128 UltraSparc, even the hardware partitioning doesn't mean as much when you can just use two or more x86-64 boxes at probably less than half the price. For that matter, it also attacks HP's "superdome" Itanium2 servers and some of IBM's Power5 and Power6. The closed architectures and the proprietary Unix(tm) they run are in deep doo-doo

    1. Re:threat to big iron by rubycodez · · Score: 2, Interesting

      Eh, I have a huge library on the opteron timing, opcodes and instruction set, and machine language coding practices that AMD sent me free of charge. But there's plenty about the Sparc III that Sun is holding close to its chest, just ask any openbsd developer.

    2. Re:threat to big iron by hackstraw · · Score: 2, Insightful

      A 32-way SMP dual-core opteron box is a serious threat to Sun Enterprise boxes with 64 to 128 UltraSparc, even the hardware partitioning doesn't mean as much when you can just use two or more x86-64 boxes at probably less than half the price.

      Would you buy that from Mom or Pop?

      A Sun Enterprise system is a system that is supported by the vendor for its OS (Solaris) and the hardware as well as other players, as the other systems you mention.

      A 32-way SMP dual-core opteron box is just a figment of your imagination without a corresponding operating system to match. (You would have gotten another +1 if you had mentioned Linux).

      My point is that there is more to a system than just the hardware. Sure, a 32-way SMP dual-core opteron box might be a great (overpriced and expensive) web server and a nice high end box for number crunching, but most of the larger systems are part of critical systems that cannot fail or garble your data. A 32-way SMP dual-core opteron box sounds great, but offers nothing to those whose reputations and careers depend on the system fulfilling its job.

  15. Re:Is 32 by ArsonSmith · · Score: 2, Funny

    If you ask the average slashdotter how many women he's dated, 1 is a huge number.

    And the date was probably huge too.

    --
    Paying taxes to buy civilization is like paying a hooker to buy love.
  16. Re:Is 32 by IckySplat · · Score: 2, Funny

    Are those women real?
    Or integer /me ducks

    --
    Help! help!, the termites are eating my DRAM!!!
  17. Re:So what? by joib · · Score: 2, Informative

    The special thing about InfiniPath is that the adapter is not a PCI-(e|X) card but rather connects directly to the HyperTransport interface on the cpu (requiring a special MB with a "HTX" connector), giving slighlty lower latency than a normal IB adapter.

  18. Strange use of "open" by xoboots · · Score: 2, Insightful

    Proprietary is proprietary. AMD chips are no more "open" than any other vendor's chips.

  19. Open Processors by Feneric · · Score: 2, Informative

    Umm, I know there's this odd phenomenon where many people tend to label any processor that's made by either Intel or AMD "non-proprietary" and any processor made by another company "proprietary", but even still this article is a little silly. SPARC processors have been in use since the late '80s, most people consider SPARC-based machines "Big Iron", and the SPARC processor architecture is fully open -- anyone who wants to can make SPARC processors. SPARCproductDIRectory lists a bunch of companies who currently do. In fact, there are probably just as many (if not more) SPARC manufacturers as there are X86 manufacturers.

  20. Re:Is 32 by brunson · · Score: 2, Funny

    I have personally dated 14+32i women, and trust me... it can get pretty complex.

    heheheheheheheheheh... math humor... heheheh heheheh heheheh

    --
    09F911029D74E35BD84156C5635688C0
    Jesus loves you, I think you suck
  21. Word from the Mac community... by jnadke · · Score: 2, Funny

    This just in: Mac users say 64 core Opteron server will be almost as fast as the new Mac G5.

  22. Re:Big Iron? Uhhh... by IckySplat · · Score: 2, Interesting

    Hate to break it to you ...

    I've worked for Banks, Airlines too
    The all had BIG iron in the server rooms

    These people are not doing lots of hard calculations
    They are moving large amounts of data...
    Clock speed doesn't matter that much in these cases.
    I/O bandwidth is king for these applications

    The fact that these machines are ULTRA reliable
    Is a really big deal for these companies.
    You can't just reboot you're entire banking platform
    to add disk or fix broken hardware.

    Processing power just isn't the point in these cases

    --
    Help! help!, the termites are eating my DRAM!!!
  23. Re:How about 2560 Opterons? by Vancorps · · Score: 3, Interesting
    Since the 286 days I've had both AMD and Intel and I gotta say, in those days there was very little difference between processors. Fast forward to today and I wonder if you've even look at AMDs offerings in the last 3 years. Video processing? I stream live dvd quality feeds using Opteron processors for a simple reason. Dual Xeon 2.8ghz server could make 2 high quality dvd streams with minimal frame drops. Powerful yes, now compare it to the dual Opteron 1.8ghz the lowest of the low end. I can do 4 streams with the same level of compression. In both scenarios I'm using the same Osprey 230 PCI-X cards.

    So I'm a big curious what is so vastly superior? Are you using Intel compiled codecs on AMD machines when you did your testing? Did you even do any testing? I'll admit I had some trouble getting things running smoothly with the Opteron box but the end results speak for themselves; especially when you move over to the 64bit world with 64bit capture drivers the Opteron blows away anything Intel has put out to date. Of course Intel 64bit support is slow as all hell right now so I'm sure that will change in the near future.

    While you may have been burnt by AMD I will stick with them for the time being until Intel shows some signs of turning around their product offerings. I'm still curious how a processor has gone bad though. In my experience once you get back the first 90 days its smooth sailing regardless of manufacturer. Only reason I can think a chip would die later in life would be from a PSU failure or some sort of disruption. I've seen that happen, never just seen a cpu die though. Always some other component causing it.

    Of course this is getting off track from the article. The Opteron is very well suited for these large machines so I'll be curious how they perform in real environments like Oracle and DB2 setups. Opterons bandwidth improve the more processors you throw at it so it'll be intriguing to see the results.

  24. Re:about time and huh? by Cruithne · · Score: 2, Informative

    But, it's not really designed for this.

    And what makes you qualified to state this? Opterons were designed with EXACTLY this in mind, right off the drawing board - i'd dig up some old articles about it but I'm at work. Research Non-Uniform Memory Access (NUMA), supercomputing, and the Opteron's architecture as it related to those two. AMD knew what they were doing when they designed the Opteron - Intel has been completely out-engineered.

  25. Great AMD is quit is doing fine. by JollyFinn · · Score: 4, Insightful

    So where I can buy the AMD server with near full redundancy?
    Or the server which can run highly debugged application written in mainframe assembler in 60's or 70's ?
    Or atleast AMD computer with SINGLE memoryspace atleast 1TB in size?
    And also how many decades of uptime is for the operating system which is used with the new AMD computer?
    The horus is more or less getting close to midrange server in number of processor while it won't bring it to the reliability requirements of midrange server, to get that it would have to run its own memory controllers instead of cheap ass opteron controllers which lack for example hotswappable memory.
    Sure you get speed, but after taking the speed there is eventually a crash.
    The big iron is all about gettin continuing to function no matter what comes.
    Only problems outside of box, like earthquake or something similar could bring it down.

    Yeah. AMD is doing just fine...
    Its eating the cheap ass market, not the big iron.
    The price is cheap and its bought where the crash proof means better than windows which is like saying saying its unsinkable since it does better in open seas than normal rowboat used in lakes.

    Lets put it this way. x86 is just used in low end boxes and in clusters of lowend boxes. And those things are not for everything. They can do much but not everything. They are cost effective when you compare only the purchase price. But not so cost effective when downtime costs a lot.

    There is probably order of magnitude or TWO orders of magnitude of what joe slashdotter thinks big iron and what businesses have in big iron as in price range.

    --
    Emacs is good operating system, but it has one flaw: Its text editor could be better.
  26. Re:How about 2560 Opterons? by Vancorps · · Score: 2, Interesting
    Both machines the Osprey was used in a PCI-X slot. The memory ironically enough on the Dual Xeon was PC3200 ECC and PC2700 ECC on the Opteron box because the 1.8 is the only one that uses such slow memory. The difference being that the Opteron has much more bandwidth to utilize for ram but thats not what video processing tends to use. Block sizes greatly effect performance. I set the Opterons to write in 8meg chunks and it seems to save IO. The Xeons don't handle chunks that large for some reason. Perhaps because of how the processors share the bus so they inherently choke the machine under a full load.

    I was curious too, perhaps the AMD optimized apps were better optimized that the Intel ones? Beyond that its also the fact that these Xeons could only do 32bit while the Opterons were running happily in 64bit. The biggest pain there was finding capture card drivers that worked and were natively 64bit. Viewcast makes that difficult, thankfully the Linux drivers worked.

    I also might add that the test was a Dell PowerEdge 1750 vs an IBM eServer 325 and later the 326 with dual core which was even nicer. So Dell might just make slow servers while IBM makes em fast. I know I'm fairly impressed with the IBMs over the Dells. Many situations the Dells were choking and I replaced them with the IBMs and all was then smooth. Our webserver was a prime example. 72 million hits in a month the Xeon servers were maxing out. Replaced them with Opteron based IBMs and 186 million hits later they are barely breaking a sweat. 35% cpu with 32bit Windows Server 2003. I'm curious how the 64bit version will effect it since we're expecting 250-300 million hits in January. Going to be a good test.

    In any case, the Opterons have proved themselves around here. I had to fight for the first one and now all the owner of the company wants to hear is that there is an Opteron in the server he is buying. The systems are rock solid stable and even faster than I expected.

    Another thought I had about the reason the servers performance might be different. The Dells had 3 10k rpm ultra 320 scsi drives in a raid 5 configuration while the IBM just has two SATA 150 drives in raid 1. So perhaps the raid configuration was slowing down the write times.

    Granted, not an ideal benchmark but its still pretty impressive the amount of power I can shove into a 1U server using the Opteron.