Slashdot Mirror


Looking at UltraSPARC III

argonaut writes, "I saw a cool article about the UltraSPARC 3 at Ace's Hardware. They have some of the usual intro stuff about Sun in the beginning, but then get more in depth about the technical specs. The best part is the second page where they talk about ILP, pipelining, and scalability (up to 1000 cpus!). There are some excellent examples of ILP and load latency. "

59 of 212 comments (clear)

  1. Re:The SunOS Kernel! by The+Man · · Score: 2

    Actually both SGI and sun pick kernels for a particular architecture (for example, IP27 or UltraSPARC II). They aren't actually identical. Sure, it comes from the same codebase and in most cases it's possible to run identical kernels on different machines, but usually it isn't done that way. The best example I've seen of actually doing it that way is UltraLinux which can do all sun4c, 4d, and 4m including SMP with a single kernel (Solaris _has to_ use separate kernels for 4c - not that anyone cares since 4c is essentially useless now). Even they can't do 4m and 4u from the same kernel though, nor can SunOS. :)

  2. Re:OT: 2 Terabyte Linux Support and /. content by The+Man · · Score: 2
    but 2 Terabyte memory support under Linux is IMHO much more interesting than the latest rumormongering from Sun.

    There's nothing special about 2TB support. First, you can already do that on UltraSPARC, and second, Alpha is a fairly obscure platform (right or wrong, it is). What would be real news is if

    working for a company which has nearly completed the process of dumping Sun in favor of FreeBSD and Linux solutions[...]run an operating system which has no compiler included

    Linux runs great on Sun systems. You imply that Sun and Linux are mutually exclusive; they are not. JMHO of course, but I find that Linux on UltraSPARC is far superior to Linux on peecees. If you like Linux on peecees, you'll like it on Sun hardware too, and in that realm the hardware isn't nearly as dodgy as peecees. If your budget makes Sun hardware impossible, fine. But don't imply that Linux on peecees can touch Linux on Suns. It can't even come close, and the hardware is clearly the limiting factor. It may meet your needs, and that's fine, but there's no reason to imply that a good, complete, low-cost OS and nice hardware are mutually exclusive. It sounds to me like you should have used your existing hardware and simply switched operating systems if the OS was giving you trouble. Oh well, more used Sun equipment for me to buy cheap.

  3. Re:Blue Mountain is a Cluster! by The+Man · · Score: 2

    Yes indeed. However, that's not the whole story. SGI's high-end systems (and the E10k for that matter) blur the line between cluster and single machine. As a low-end example from the SGI world, you can attach two Origin 200s using the Craylink and to the OS it appears as one machine. Is that a cluster, or one system? Well... Similarly, the Craylink technology is used with the O2k series to interlink systems as well as build composite systems. There even exist routers, hubs, and so forth. So it's really just an exceedingly fast networking technology, but with some clever hardware and OS support can also be used to make multiple systems tied together look like one. Very clever, very nice, and very fast. Expect to see more like this.

  4. Re:Servers, nice. Workstations, ugh. by The+Man · · Score: 2
    But I've been stuck working on our Sun Ultra5 worstations far too often, and they are TERRIBLE. Sooooo sloooooow. They're configured with 128M of RAM and, if I remember right, a 300 mHz sparc. My PII-350 with Linux and the same amount of RAM is much more responsive. Not to mention that they go down with alarming frequency, and they cost four times what I paid for my intel box around the same time period.

    Yep. We have those too, and they are complete shit. As people say, "the only thing Sun about an Ultra 5 is the price." I'm sure the Sun technical people are sick of being hated over the U5/10. If you look at it, the decision to develop that kind of system could only have come from marketing. There's no way anyone at Sun really believes an U5 is worth having. If you want to judge Sun's workstations, get an Ultra 2 or an Ultra 80. These machines typify Sun's capabilities. Expensive but worth it.

    Will SparcStations be able to survive the onslaught?

    Well, the most recent machine to carry that name is obsolete, and only the fastest versions of it are still useful. So I'd say no. :) If you mean "will SPARC survive" then the question is more difficult. There will always be a market for something that isn't Intel (ie doesn't carry the baggage of the 4004 along with it). Whether that will be SPARC I don't know. Your question about McKinley destroying its competition is likewise unanswerable. Intel is betting a lot on what is really unproven technology while the traditional RISC makers are improving their technology one step at a time. By the time Intel finally ships their sooper-dooper new processors they may be well behind the "older" technology of other vendors like Decompaq and TI/Sun. If so, SGI would be foolish to ditch MIPS. It'll be interesting to see how this plays out.

  5. Re:Who's buying Suns? by Brian+Knotts · · Score: 2
    You're thinking too small. Most PeeCee type systems rarely run more than, say, 60 or so processes at once.

    You haven't seen my workstations... :-)

    New XFMail home page

  6. Servers, Questionable... by Christopher+B.+Brown · · Score: 2
    I've seen a couple outages this year on the SPARC cluster that I help support, mostly relating to I/O problems. (Disks and controllers "going bad.")

    My suspicion is that IA-64 is going to have less impact on server configuration than one might expect, certainly less than the "Gartner cheerleading" used to indicate. After all, on servers, the important thing is not the CPU, but rather the combination of I/O subsystems, whether:

    • RAM, or
    • Disk

    I could readily see "workstations" getting "killed off," what with PC's getting more and more powerful.

    But the big deal for anything higher-end is the buses, and not merely the CPUs, which makes the bluster about CPUs pretty moot...

    --
    If you're not part of the solution, you're part of the precipitate.
  7. Re:Servers, nice. Workstations, ugh. by sql*kitten · · Score: 2
    I'm still undecided if Linux/*BSD is more stable

    Gee, I'd better tell my financial services and telecommunications clients to put all their mission critical application development on hold while you make up your mind.

    I mean, any OS that uses CDE and comes with csh and ksh as the shells

    Right, because these are integral parts of the operating system. I see.

  8. Re:Written using emacs by ChrisRijk · · Score: 2
    "Wish they weren't so secretive sometimes though."

    That "sometimes" was carefully put in ^-^ On Sun's site I once came across a policy document explaining that they don't think pre-announcing things too much is a good idea. (of course, they don't always do this, particularly with completely new products, though this is more understandable - particularly when you want 3rd party developers to get on board).

    I value this, but on the other hand, it still does get annoying sometimes ^-^

    At their 4th quarter 1999 results annoucement, they were asked when US-3 systems were going to become available. They said that the final US-3 design had been finished - ie it was completely tested and ready for production. They also quite clearly said that they won't give release dates (even vague ones) partly so that competitors won't get a chance to start laying on the FUD beforehand...

  9. Re:1000 CPUs by ChrisRijk · · Score: 2
    Things might be reasonably easy for up to 128 CPUs - the most you'll see (for a bit) in a single box. This wouldn't require a huge effort to get working under Linux, I think because it would mostly be evolutionary from the software point of view. However, I don't know if Linux will work on Suns' 64 CPU Starfire at the moment. (I heard of NetBSD running on a Starfire at NASA about 2 years ago, but I don't remember hearing about Linux...)

    To get to 1024 CPUs as one system, you'd use clustering, using special interconnects, which would also require a fair amount of custom software. Some of this would be a bit like Beowulf, but not quite.

    Still, as general members of the public, you'll be able to get the source code to Solaris 8 in about 2-3 months, and this will include their clustering software. So, you'll be able to see how Sun do it at least.

    Besides, given that Linux (currently) doesn't scale that well (certainly well behind Solaris), there isn't a great deal of point, from a technical perspective, about doing a "port".

    I've no idea about the legal side of doing clean room versions either. The license for the Solaris source code isn't available yet.

  10. Re:Ha! by ChrisRijk · · Score: 2
    Try reading the whole article. Near the end is:
    • Later in the year, Sun's replacement for the Starfire, code named Serengetti will be launched. This will have
    • up to 128 CPUs in one box, and you can cluster them (so that they appear to be 1 machine) using a special fiber interconnect, for up to 1024 CPUs, probably using a COMA memory structure (similar to ccNUMA), something Sun have been working on for many years.
  11. Re:A good, non-fluffy tech piece. by ChrisRijk · · Score: 2
    Maybe I should have said "custom edge triggered flip-flop". I know it's a basic component, but there's lots of ways of physically making them. Doing this sort of thing is fairly common though... I think I was being too brief in the article.

    If you're interested, here's the relevant paragraph from the IEEE Micro paper:

    • With clock rates continuing to increase, the part of the cycle time allocated to flip-flops comes under great pressue. To improve this, we designed a new edge-triggered flip-flop. This partially static output, dynamic input flip-flop does not require setup time and is one of the lowest D-to-Q delays for the power and area in use today. The flip-flop design's dynamic input stage effectively allows up to tuck in a full logic stage without increasing the D-to-Q delay. The noise immunity increases by an input shutoff mechanism that reduces the effective sample time, allowing the design to be used as though it were fully static.
  12. Re:no pic? by ChrisRijk · · Score: 2
    What, coloured tables not good enough for you? (just kidding)

    When the first US-3 samples came out, there was a pic with Scott McNealy holding a US-3 in his hand, but it was never posted on Sun's site and the original copy of it has long since gone. Since the part isn't actually shipping to customers yet, there are no "official" pictures yet.

    I did think about doing some graphics for the article, but couldn't think of something that would really help...

  13. Linux on a Starfire by Tet · · Score: 2
    I don't know if Linux will work on Suns' 64 CPU Starfire at the moment.

    See /usr/src/linux/arch/sparc64/kernel/starfire.c:

    /* $Id: starfire.c,v 1.2 1998/12/09 18:53:11 davem Exp $
    * starfire.c: Starfire/E10000 support.
    *
    * Copyright (C) 1998 David S. Miller (davem@dm.cobaltmicro.com)
    */

    I've personally had it running on an E4000. Apparently, Sun gave davem access to a starfire to allow him to add the support.

    --
    "The invisible and the non-existent look very much alike." -- Delos B. McKown
  14. Re:Maybe time to upgrade by QZS4 · · Score: 2

    I don't have an IPX, but I do have a nice little LX at home. And the other day I got hold of an SS5 too :-) Our sysadm is trying to get rid of a lot of older Suns, and you just can't let them go to waste... A few Ultra 1's are next to go, but I don't think I can get one of those. They are still too useful - they will go to other departments instead :(

  15. Memory, memory! by QZS4 · · Score: 2

    What's greatly needed for larger systems is often a lot of main memory. The standard PC limit of 1 GB main memory is a major pain in the @$$ when you need some serious computation done.

    At my department we need machines with lots and lots of memory. Currently we have a 4-CPU Sun with 4 GB memory, but that's really too small. Around 24 GB would be more along our needs. (Coding and crypto research, eats lots of MB's).

    You can get a lot of memory by using clustered machines (or an Origin 2000, SP/2 or whatever), but it's kind-of silly to use a parallel computer just to get the memory, but not the parallelism...

    Anyway, the sooner we can get more than 1-4 GB into a standard PC the better. The need is already here.

  16. At least Sun will be around in 15 years by joneshenry · · Score: 2

    What's interesting to me about Sun is how well they've done by keeping control of their key technology instead of relying on either Microsoft or Intel to supply pieces. Sun has control over their own operating system(s), they're successfully pushing their own language, Java, and they don't have to depend on Intel for their processors.

    I think that in the long run Sun is going to do a lot better than say HP who has spread themselves really thin trying to be all things to all people. HP originally entered into the alliance with Intel because of fears it could not afford the next generations of chips, only to be caught in the nightmare situation of having to extend the product lifecycle while waiting for Intel to deliver a product that every other competitor will be able to use anyway. And Intel leveraged the alliance into getting HP to give away compiler and other technology for free. Nice for Intel, not so nice for HP.

    DEC had the Alpha but got caught trying to rely on Microsoft for NT. Too bad NT on the Alpha was always an unwanted stepchild, but that's what happens when a company is dependent on another company. You're screwed if you're not a priority to them.

    SGI same thing, total failure trying to sell their own NT workstations on Intel hardware.

    I don't get it, it just seems common sense to me for companies to keep control of technology. That's why Sun is beating Microsoft like a drum in court today over Java, because they own it.

  17. Re:Who's buying Suns? by alhaz · · Score: 2

    That's a license for non-production use.

    A commercial license of Solaris 7 for Sparc costs more than a month's rent for me . . .

    --
    This is just like television, only you can see much further.
  18. Re:Who's buying Suns? by alhaz · · Score: 2

    your 95% cache hit rates are on workstation-class systems, running workstation-class process loads, from where i sit.

    You're thinking too small. Most PeeCee type systems rarely run more than, say, 60 or so processes at once.

    I've seen Sun E450's spawn thousands of processes at once, and, instead of bogging down, saturate the hell out of a fiberchannel raid array and still have enough cpu time left over to fight for more.

    8 megs of on-die cache means that a lot more programs can have that 95% cache hit ratio than could hope to on a lesser processor.

    --
    This is just like television, only you can see much further.
  19. Re:The SunOS Kernel! by alhaz · · Score: 2

    AMEN! Geeze, yeah, if anyone wants to play with Sun4c hardware i'll give you my old Sparcstation IPC for free. Just come over to my house and ask, it's yours . . .

    --
    This is just like television, only you can see much further.
  20. 70 watts? by Graymalkin · · Score: 2

    I hope that's a typo because I wouldn't want to be the guy paying the utility bills for a U-SPARC datacenter. I think the SPARC is being out performed by other cheaper processors but I also think alot of people are forgetting something. SPARC boxes running Solaris will crawl at times with a single processor but as you add processors the system's speed increases dramatically. Try building a 16 processor Xeon box running Linux, without a major kernel overhaul it won't run very well. Solaris runs right out of the box on as many processors as you want. Anyways, back to the processor. That thing is a monster using a .25 micron die. Using such a huge die (compared to MPPC and x86 processors) has the disadvantage of producing alot of heat. Sun needs to invest in shrinking down their die sizes to get more computational power for the same price instead of just making things more complex. Maybe even a .22 or .18 micron SPARC? If it were my datacenter I think I might go with the U-SPARC 3. Oh and for you people calling Sun/SPARC/Solaris slow because you used an Ultra 5, grab some more RAM, a graphics adapter add-on, and use something other than CDE and I think you'll see a performance boost.

    --
    I'm a loner Dottie, a Rebel.
  21. Servers, nice. Workstations, ugh. by JohnZed · · Score: 2

    My school uses exclusively Sun servers and all the admins I've talked to sing high praises of them. But I've been stuck working on our Sun Ultra5 worstations far too often, and they are TERRIBLE. Sooooo sloooooow. They're configured with 128M of RAM and, if I remember right, a 300 mHz sparc. My PII-350 with Linux and the same amount of RAM is much more responsive. Not to mention that they go down with alarming frequency, and they cost four times what I paid for my intel box around the same time period.
    I can understand why Intel-based machines (both Win32 and Linux) are making so much market headway. It'll be interesting to see what RISC workstations really survive after McKinley comes out and people like SGI start producing the kind of first rate hardware (graphics, bus, etc) that has been differentiating Sparc/Mips/PA-RISC workstations up until now. Will SparcStations be able to survive the onslaught? Should Sun really care if they do (especially since workstations are a low-growth market while the server-side growth potential is enormous)?
    --JRZ

    1. Re:Servers, nice. Workstations, ugh. by randombit · · Score: 2

      Gee, I'd better tell my financial services and telecommunications clients to put all their mission critical application development on hold while you make up your mind.

      Your clients can do whatever the hell they like. If they want to run them on Solaris, fine. If instead Linux/*BSD, fine. NT, IRIX, or SCO, fine with me. Since they are not my clients, I really don't give a flying fuck.

      Right, because these are integral parts of the operating system. I see.

      No, ksh and csh are not integral parts of the OS (much less CDE, as I've gotten on quite fine without it for most of my Unix life, thank you). A SHELL is an integral part, and ksh and csh are, IMO, not very good choices for these particular itegral parts (when tcsh, bash, and zsh are far better). A C compiler is often considered an integral part of the OS - what would you think of a Linux distro that shipped gcc 1.0 as the system compiler? As far as I'm concerned, that's about equivalent.

    2. Re:Servers, nice. Workstations, ugh. by randombit · · Score: 2

      Solaris 8 ships with GCC. A Shell is an important part of your interaction with an OS. If you can't manage that yourself (writing your own aliases, as well as choosing your own shell), you shouldn't be wasting your time with Solaris.

      Well, that's wonderful! When I have time, I'll go and upgrade all of the ~400 machines in the department to Solaris 8 and we can all celebrate. Anyway, the new commercial Sun compilers work pretty well and I'll stick with them on Solaris.

      As far as the shells are concerned, I do choose my own damn shell, which is bash. That's it. No arguments. I just don't see why Sun feels it's really necessary to ship obviously outdated and obsolete tools with their system. And I'm annoyed that I had to suffer with csh up until I got bash all nice and cozily installed this afternoon.

      In any case, I'm hardly "wasting my time with Solaris" - I get paid pretty decent money to admin these machines. I can think of at least a half-a-dozen OSes I would choose over Solaris for home use (easily: Linux, FreeBSD, OpenBSD, BeOS, NT, 2000).

    3. Re:Servers, nice. Workstations, ugh. by randombit · · Score: 3

      My school uses exclusively Sun servers and all the admins I've talked to sing high praises of them. But I've been stuck working on our Sun Ultra5 worstations far too often, and they are TERRIBLE. Sooooo sloooooow. They're configured with 128M of RAM and, if I remember right, a 300 mHz sparc. My PII-350 with Linux and the same amount of RAM is much more responsive. Not to mention that they go down with alarming frequency, and they cost four times what I paid for my intel box around the same time period.

      Yeah, the deptartment where I study (CS) and the one where I work (Physics) both run Suns, and I've had pretty much the same experience, except the Sun Enterprise 1 [formerly the NFS server] on my desk only has 96 megs of RAM. :( However, there are a pair of Ultra10s across the hall that I can pop over and use if I like, which run pretty well. And for big servers, at this point, Sun is still the way to go, despite the usual zealots (yes people, I run Linux at home too) who claim that anything can be done on i486 Beowulf clusters.

      Now only if Solaris didn't suck so much... OK, it scales well and is pretty stable (I'm still undecided if Linux/*BSD is more stable), but it's a real pain at times. I mean, any OS that uses CDE and comes with csh and ksh as the shells just sucks (I just installed bash this afternoon).

      Damn, it's a pain in the ass to get used to using a PC keyboard after using a Sun one all afternoon... oh, on the subject of hardware - Sun stuff may cost a lot but it is quality stuff. Before they were replaced last month, the CS department had a bunch of old SPARCStations (mostly SPARC5s, I think), which actually ran pretty well despite being who-knows-how-old (about as fast as a Pentium II-200 with 96 megs of RAM, if I was guessing for a PCish equivalence). And Ultra2s are fucking awesome... spec on at Sun's website sometime, you'll be amazed at how cool (and how insanely expensive) they are.

  22. Re:Single Harware vs Clustering reliability by Abigail-II · · Score: 2
    But then, what is the reliability gain over slightly bigger clusters of el-cheapo hardware?

    Reliability is more than just having redundant hardware. For disks, it works to a certain extent, RAIDs are popular, but you pay a price. Bigger clusters of hardware might be cheaper when it comes to buying hardware, but building a realible system out of that is more complicated, and requires more maintenance. Besides, those systems aren't readily available.

    -- Abigail

  23. Re:Written using emacs by Abigail-II · · Score: 2
    Wish they weren't so secretive sometimes though. If you actually look at Sun's site, there's almost nothing about the US-3 technically.

    In a way. On the other hand, I think it's kind of cool Sun doesn't make all kinds of promises and delivery dates, only to ship something with errors or getting scored at for not keeping their promises, but instead, they just work on it with an "it's ready when it's ready" attitude. And just as you wrote in your article that for Sun reliability is more important than performance, reliability is also more important then fanfare.

    Makes you think there's still some hacker culture not taken over by marketing droids left.

    -- Abigail

  24. Re:Power consumption questions. by barzok · · Score: 2

    Hell, just water-cool the suckers. Last time I saw a "bare" Sparc chip, it was topped with a metal plate and 2 cylinders (like pins, kinda fat though). Onto those pins you attached a pair of round heatsinks (stacked discs). Replace the heatsinks with some kind of water "jacket" and away you go. Fewer problems than with refidgeration. Might want to use a non-conductive liquid rather than water, now that I think about it, unless it's pure H2O.

  25. Re:Who's buying Suns? by Silverpike · · Score: 2

    Don't make opinions without the data to back it up.

    Oohhh, you opened yourself up on this one... :)

    Fallacy #1:

    The CPU's are *MORE EXPENSIVE* yes, overpriced, no. Look at a comparison in the CPU's on just a very simple level. The CPU has 8 Megs of L2 Cache. Not 256k, not 512k, not 1 meg, 8 Megs. That Cache is running at CPU Speed. If there's anything at all that's slowing their speed down, its the large amounts of L2 Cache they run with their servers.

    Remind me again why 8Mb of L2 is needed when programs have 95+% cache hit rates with 1Mb (often less; hmmm...)?

    They really are overpriced. I am certain an Alpha 21264 can be had for a fraction of the price of these things, and its specmarks are int-27, fp-58, which is too close to make a big deal out of.

    Fallacy #2:

    Now getting back to PCI cards being overpriced, in Sun's specifications, it dictates that all hardware MUST have a PROM with the drivers on it to be certified as Sun Compatable. At boot time, all of the PROM's are polled and all of the drivers are loaded at the hardware level. Plug and play that really works, imagine that...

    Gee that's funny, I don't remember anything in the PCI spec about having to have PROMs... ;P

    This is bad for two reasons. First, I hate it when vendors screw with the PCI specs. It was adopted as a spec for a reason, not so vendors can then change it so it only works with their HW. Just ask linux-kernel how much they love broken PCI workarounds...

    Reason 2 is that "plug and play" (a Micro$soft term BTW) can be had for PCI without having those PROMs on board. The reason Sun uses those PROMs is to get licensing fees from hardware vendors to get that "Sun Compatible" moniker. Creative revenue generation no doubt, but it prevents PCI interoperability, which is a Bad Thing.

    Fallacy #3:
    > The OS is waaay overpriced.

    Free, yeah way too expensive.


    Wow! You got Sun to give you free copies of Solaris for Sparc? Last I checked you still had to pay a hefty $90k (!) for an OS with nearly equivalent functionality as Linux. I call that a bad deal.

    Fallacy #4:

    First, all of the workstations and servers have TRUE plug and play. There processors scale from Laptops (anyone remember Tadpoles) all the way up to Mainframe-sized computers (E10k). Also - hot-swappable I/O and CPU/Memory in the Enterprise systems. The E10K can scale up to 64 450 Meg processors with 8 megs of L2 Cache, 64 Gigs of Ram, and can run 4 Virtual Machines that can be dynmically allocated on the fly.

    Don't be fooled into thinking only Sun has hot swappable drives and IO. Geez, Dell Proliants have had hot swap SCSI since 1997. Hot swap IO? That has IBM written all over it as well. However, the best argument is scalability. Forget laptops to E10ks, how about Linux on a Palm to Linux on an IBM/390 Mainframe? What two extremes could you possibly supply that's wider than that? (E10ks are toys compared to S/390s).

    My money's on Linux. If you want scalability and interoperability, Linux is the answer. As for reliability, Linux has a little ways to go to catch up to Solaris/VM/MVS/BSD, but it's getting there.

    With all that said, the UltraSparc-III looks like a very good design from Sun. You rarely see appropriate amount of thought applied to the reality of processor shortcomings these days, and they hit the right aspects.

    --
    The opinions I post here have nothing to do with my employer.
  26. Re:Who's buying Suns? by ajs · · Score: 2
    You made some good points, but some really bad ones. Here's a few corrections:

    6) What does Sun do that Lintel cannot?

    A lot of things.
    Nothing.

    First, all of the workstations and servers have TRUE plug and play.
    If you're buying pre-installed you don't care. You can actually say that everything in a pre-installed Linux box is plug-and-play, you just don't have to plug. We're talking about Suns vs. PC clones, so Plug 'N Play(tm) as a strict definition does not enter into it. Suns do not adhere to that standard, so the only measure of plug-and-playness is the convinience of your devices being recognized and supported.

    There[sic] processors scale from Laptops (anyone remember Tadpoles) all the way up to Mainframe-sized computers (E10k).
    Laptops. Like Dell, Toshiba, etc. Mainframe-sized computers like the Cluster City from VA/Linux and other large lintel cluster arrangements.
    Intel does not scale gracefully, but we were discussing capabilities not grace, and once you buy it in a package, you really don't care how hard it was to get there.

    Also - hot-swappable I/O and CPU/Memory in the Enterprise systems.
    If you're using a cluster like the Cluster City, then entire systems are hot-swappable

    The E10K can scale up to 64 450 Meg processors with 8 megs of L2 Cache, 64 Gigs of Ram, and can run 4 Virtual Machines that can be dynmically allocated on the fly.
    Let's see, a Cluster City with 20 2x2's (ignoring the admin server) means 40 600MHz (700 available?) processors with 20MB of L2 cache, 40GB of RAM and IS 20 machines that can be dynamically re-allocated on the fly.

    So, the question is still: What can Suns do that Lintel cannot? The answer of course is nothing. The only stumbling block to total Linux acceptance is the application porting. I still can't get most of the high-end application servers for Linux, even though most of them are based on Java. This sort of thing will change, and has been for years.

  27. Re:Who's buying Suns? by noeld · · Score: 2
    2) Motherboards are overpriced. I honestly can't say I've ever priced a Sun Motherboard. There is no such animal.

    Then what is the SPARCengine Ultra AXe-300. :) It is A Low Cost, High-Performance Motherboard for Thin Servers, Server Appliances and Configured Servers.

    You can find a tech manual in pdf here .

    Noel

    RootPrompt.org -- Nothing but Unix

  28. Re:Insightful article, but AFAIK x86 L1 latency= 1 by redelm · · Score: 2

    Thanks for your reply. ctcm measures `movsd` which is a load and a store for each word. If I should have 4112 MB/s @ 539 MHz, that's 7.6 bytes read and 7.6 bytes written each clock. Not very likely unless I've got a 128bit path or dual ported SRAM. But you are right, ctcm is more a measure of bandwidth than latency.

    I dug out my pseudrorandom access asm timer. I measure 10.7 Mreads/s from DRAM (9.1 busclocks), 20.0 Mreads/s from L2 (27 Celeron CPU clks) and 525 Mreads/s from L1 (1.03 CPU clks). So L1 seems single cycle, but L2 looks oddly slow, perhaps due to unintended thrashing.

    As for the power/die budget, I'm afraid I don't know enough about chip feature design. But from all the micrographs I've seen, L1 is a fairly small portion of the die, so doubling it wouldn't be too painful. It also appears disproportionately large compared to L2, so something like this has probably been done.

  29. Insightful article, but AFAIK x86 L1 latency= 1 by redelm · · Score: 2

    First, high compliments on an outstanding and insightful article on one high-end of the computing business. It is easy to forget there are other aspects than the max-CPU performance sought by hobbyists.

    The discussion of architectural performance benefits was very clear and insightful. There are obvious limits to multi-issue architectures.

    A few corrections, if indeed I am correct: Main memory fetch is _not_ the oft-quoted "hundreds of CPU cycles". Typical SDRAM timing is 6-1-1-1, or 9 bus cycles per 32byte cache line. For a 600 MHz CPU with a 6x multiplier, this is 54 cycles, plus perhaps a few for page misses, etc.

    Also, AFAIK at least Intel's P6 x86 core has a 1 CPU cycle latency L1 cache. Such a fast cache is necessary to make up for the risible shortage of x86 registers and helps considerably with stack-based operations such as often generated by `c` code. I do know that I can realize three RISC-type uops per clock cycle when 33-50% of the uops are loads from L1.

    1. Re:Insightful article, but AFAIK x86 L1 latency= 1 by redelm · · Score: 2

      I think the latencies you gave are for L2 cache. As for power budgets, I hardly think the P6 core is that great. But it _is_ alot better than an Alpha 21264 633 MHz with 107W (47Amps @ 2.35V).

      As for SDRAM latency, I've measured ~9 Mreads/sec for pseudorandom P6 addresses. Now that _is_ 11 busclocks, but remember the P6 always accesses DRAM by full cache lines, so latency is (11-3)=7 busclocks (more for later bytes). So 42-66 CPU clocks if the multiplier is 6x.

      As for L1 latency, I don't recall my read rates. But they'd have to be _very_ fast to allow ctcm to report 2700 MB/s @ 539 MHz in `movsd` to L1. This sounds like 1 clock/transfer to me, and the L1 might even be double (read & write ) ported.

      -- Robert

  30. Let me guess: by cfish · · Score: 2

    What do you see in the crystal ball?

    1000 CPUs. 500 of them each serving thier dumb little SunRays. 20 of them serving web contents. I see network congestion and a bankrupcy.

    moral of the story: Yes, you got 1000 CPUs. Can your I/O handle it?

  31. Hell, I've done worse than that. by Convergence · · Score: 2

    You can do far worse than that.. Just take a P166, say, like my computer.. Then run a copy of xlock on it (-delay 0) you can find modes that'll use >10,000 context switches per second.. Then run a few hundred copies of 'cat /dev/zero >/dev/null', nice them to 10 or 15. Under X, it does get a little annoying to use, but from a console you don't even notice the load. (And with amp's realtime playback, your MP3's go through with nary a pop or stutter.

    True, I haven't also tried a forkbomb [while (fork()>=0) ;] concurrently to all of the above, but I expect it to handle that too.

    Linux can handle that load fine, even on a little old P16, so your anecdote doesn't carry much weight, at least with me. :)

  32. Re:Imagine the possibilities... by Cuthalion · · Score: 2

    Even if you could, there's no IO to get that much video bandwidth out of the computer - your screen won't do more than, what, 120 hz? Your eyes barely do 60..

    --
    Trees can't go dancing
    So do them a big favor
    Pretend dancing stinks!
  33. Re:Who's buying Suns? by rjstanford · · Score: 2
    The OS is waaay overpriced.

    Be fare. I don't see how "free" ( + media charge ) can be considered as overpriced.

    --
    You're special forces then? That's great! I just love your olympics!
  34. Single-Process-Per-CPU multiprocessor machines by billstewart · · Score: 2

    There have been machines that almost worked that way. One of the early hypercube machines (N-Cube? IIRC) had a master node, and 2**N small nodes with a CPU, RAM, and communication connectors. It took care of virtual memory by assigning each process as many nodes as it needed, rather than assigning blocks from a shared memory space.

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
  35. Re:You're smoking crack - Fortune 500 runs on Inte by rambone · · Score: 2
    What's your point?

    Its fairly obvious - anyone who passes off ridiculous statements like "x86 has no place in production environment" clearly hasn't been in one, ever.

    Before you reply, decide whether you consider half the web companies running multibillion operations on linux/BSD running on x86 not to be in "production".

  36. Re:We have lots of Suns here at Intel by rambone · · Score: 2
    Uh oh, there's a counter example. Guess that burns my whole argument.

    I guess all the multibillion dollar web operations I saw running on x86 boxes over at globalcenter and exodus were just illusions.

  37. Sun "quality" is over-rated by rambone · · Score: 2
    I've found that the extra quality you get with a Sun box is irrelvant - you upgrade it due to performance issues inherent in any system long before you deal with MTBF and other issues that may have "quality" ramifications.

    Like it or lump it, disposable computing is the way to go. If you're going to upgrade a box in 18 months, why get fleeced on the price?

    As it stands, Sun boxes at the high end do have nice features - at the low end, the quality is typically far inferior to what you get in name brand PCs.

  38. You're smoking crack - Fortune 500 runs on Intel by rambone · · Score: 2
    Running x86 in a production environment is laughable

    Don't tell that to nearly every company running a server farm at any colocation I've ever been to in Silicon Valley, or to nearly any Frotune 500 company that invariably uses Intel boxes in almost all environments.

    Intel sells 85% of the world's CPUs. They're everywhere. Deal with it.

  39. Sun heading for same "boutique" biz IBM now owns by rambone · · Score: 2
    Sun equipment continues to eat away at the mainframe market, and Lintel equipment continues to eat away at the Sun market.

    Sooner or later Sun will have to combat the Lintel market directly - the low end is where its at for web companies in particular (no, no one runs Apache on an E10k).

    Sun's current strategy is to continue to go higher up the food chain, but they're soon going to find out that IBM is defending their mainframe turf vigorously, with uptimes and sustainability that even Sun boxes can't touch.

    Meanwhile, companies like VA are eating Sun's lunch at the low end.

    I predict that pressures from both directions will invariably force Sun to choose the weaker opponent - VA - and attack the low end vigorously. Thats going to mean lower prices for the same equipment. Look for lower Sun profits as the Linux freeware brigade takes it toll on Sun's fat margins.

  40. Predictions like this come back to haunt you by rambone · · Score: 2
    What's interesting to me about Sun is how well they've done by keeping control of their key technology

    No, you're confusing "control" with "closed". Sun used to actually be about open systems - now its about Sun end-to-end solutions that are out of step with trends in open computing.

    Sun has control over their own operating system(s),they're successfully pushing their own language, Java

    You don't follow standards proceedings, do you? Sun's recent double-talk attempt at "opening" Java was met with deserved jeers - Sun wants to control the code in a closed fashion while having the moral legitimacy of an blessed standard. Thankfully other companies joined with ISO and ECMA to derail this ludicrous strategy. Sun's moves with Java smack of pure McNealy arrogance.

    SGI same thing, total failure trying to sell their own NT workstations

    SGI was already doomed when they took this step. Their downfall had little to do with their strategy with regards to NT.

    I don't get it, it just seems common sense to me for companies to keep control of technology.

    Like Microsoft keeping undocumented calls in its API?

    If the existence of the Internet hasn't convinced of the value of open standards, then really there is no hope for you.

  41. no pic? by DeXtR · · Score: 2

    Excuse me to go into the petty details of... graphical gratifiacation... but 3 pages of specs, no PICTURE!? is there a pic of the damn thing? did i miss it?

    --

    Istigkeit -"is-ness" being and becoming & i'dfiying it with the mathematical abstraction of the idea

  42. finally! by Anonymous Coward · · Score: 3

    1000 processors... that's enough to spell check an article that hemos wrote! maybe there is hope after all.

  43. Re:Power consumption questions. by sjames · · Score: 3

    WOW! And people think that Intel chips (and Alphas) consume a lot of power!

    They are a bit power hungry, but for applications where you need them (bad enough to cough up $10,000+), you won't care! Let's face it, these are not PCs we're talking about here.

    The large die size is required to cram everything they want (for performance reasons) on a single die. I imagine that they're speced at .25 because it's a lot easier to move to a finer process than to a coarser one. Also, nobody minds if you come in better than spec.

  44. Re:Wouldn't 1000 CPUs thrash over lone mem/data bu by sjames · · Score: 3

    I fail to see how 1000 CPUs is of any advantage. A few maybe (up to 8 or so). Go overboard and they'll burn cycles just waiting for access to memory, etc.

    In an SMP machine, that is absolutly true. On a bus, 4-8 is about the limit. a crossbar connection can scale to more like 32 or 64 (but the OS becomes a mess with all the locks). After that, NUMA (Non Uniform Memory Access) is in order. In those systems, CPUMemory access is kept off the common path as much as possable (sort of like splitting an overcrowded ethernet segment in half with a brouter).

    The 1000 CPU machine will be less tightly coupled than SMP, but more tightly coupled than Beowulf. (On that scale, uniprocessor is trivially the most tightly coupled, and a sort of distributed net over floppies would be the loosest).

    The 8M cache is a big help in any event.

  45. Re:Power consumption questions. by ChrisRijk · · Score: 3
    Later on in my article it suggests that they'll be moving to 0.18 much quicker than indicated by the IEEE paper. It seems to me currently, that they'll start at 0.18 micron instead of 0.25 (partly because, it's late, so easier to start at 0.18). This'll help reduce power consumption.

    Sun's high-end kit doesn't take a standard mains socket either ^-^ But no prob - most places you're likely to install them will have the required power supplies. The Starfire can have up to 5 redundant power line cords, each of which has to be able to handle 24 amps...

    The reason why the power consumption is so high is that there's so many pins on the packaging, there's so many high-bandwidth data pipes etc. Ie it's both because they're using slightly out of date fabs from TI, and because of the design. The UltraSPARC-IIs consume much much less power - they're a lot smaller and were originally designed for a 0.45 micron process, I think it was.

  46. A good, non-fluffy tech piece. by slothbait · · Score: 3

    Its good to see a decent review of a chip from an architectural standpoint. Sites like Ars are starting to address such things, but don't go into much technical detail.

    The cache discussion is very interesting. Its true that most academic papers make large simplifying assumptions. (You spend that much time running hardware sims, and you'll look for ways to simplify your life, too.) Its interesting that other companies maintained those assumptions in their designs, even when they weren't particularly valid.

    This paper is also good for illustrating the simple fact that processor performance relies on a hell of a lot more than just MHz. I think any serious computer user should learn atleast some basics of computer architecture, so that they will be better informed when comparing different hardware systems.

    Most software folks I know (except the compiler guys) are fairly ignorant of computer architecture as a field. Articles like this are good for drawing people in a bit. Many techies are drawn to Linux because they can see what's "under the hood". Its also good to know a bit about what's "under the hood" of your hardware.

    --Lenny

  47. Yes, Suns are expensive ... by morven2 · · Score: 3

    However, make sure you're comparing like for like. It's easy to say 'Well, I can buy a 450 MHz processor, 18GB of disk and 256MB of RAM as a PC for ~$1000, and as a Sun for ~3000, so Suns are overpriced' but that's not the full story.

    Sun systems are made to a much higher quality than any PC I've ever found, even the high end servers from Compaq et al. [this doesn't mean that a few products of theirs haven't been total dogs, but in general ...] Also, Sun systems generally have better memory bandwidth, IO bandwidth, etc. than PCs of seemingly equivalent spec. And they last *forever*.

    I'm involved in running the web site for a public radio station, running on hand-me-down Sun equipment obtained from the affiliated university.

    We're serving a web site, doing audio streaming in both GTS's Java technology and Shoutcast, DNS service, plus email and interactive logons for about 50 staff members ...

    On what hardware?

    One SPARCstation 5. Single SPARC processor, I think 50 (50!) MHz, 128Mb memory, old scsi disk. The system must be six years old at least.

    Now that's lasting value. Not a cutting edge system any more by any means, but it's quite something to still be using a system that old for a production server ...

  48. Sun machines are fast enough by PD · · Score: 3

    The things that they do don't require as much CPU as they need disk and memory speed. Sun delivers in that department.

    I'm working at IBM, and our AIX servers are pretty much the same. Slow CPU's, but pretty good disk storage and plenty of RAM. This is exactly what we need to run DB2 and Apache. And we've got the 2nd biggest web site (dollar wise) on the internet. These are the things that are important.

    Microsoft has a serious problem in this department. Their OS only runs on Intel platforms, and for sheer IO power, the Intel platforms lag behind the others. Even if W2K is a sweet reliable OS, it still can only go as fast as the hardware.

  49. OT: 2 Terabyte Linux Support and /. content by FreeUser · · Score: 3

    Why was this posted and the article on 2 TB memory support on Alpha Linux by SuSE that I submitted rejected, not once, but twice? SPARC is very cool, but the article isn't all that exciting IMO.

    I have to concur. I am generally not one to complain about editorial choices here, but 2 Terabyte memory support under Linux is IMHO much more interesting than the latest rumormongering from Sun. At the very least, both stories could have been linked.

    However, a story I forwarded from the mp3.com mailing list a while back (about the RIAA suit against them) was also dumped in favor of a movie review, mere days after the Motion Picture Association of America had begun thoroughly stomping the testicles of the Open Source community in the form of lawsuits against DeCSS, etc. Even something as dramatic as that didn't seem to have much affect on /. content (I mean, come on, helping the very crooks to market their product through reviews days after they've declared war on the community you purport to support?). Given that editorial history I doubt your complaining, or mine, will have any significant effect.

    However, all is not lost. Commander Taco, Hemos, et. al. have been kind enough to release the sources to slashdot under the GPL, so you and I both are free to take our sour grapes and ferment them into the wine of another, parallel open source site. :-) And despite all of the flaws, there is still sufficient good content here for me to keep coming back, reading the stories that interest me, and posting comments (most of them much more on topic than this).

    As a final aside, working for a company which has nearly completed the process of dumping Sun in favor of FreeBSD and Linux solutions, I found the entire story rather amusing. While there are certainly specialized applicaitons which will demand 1000 processor in parallel hardware, just about any job can be achieved far less expensively, and with far more flexibility, simply by using a beowulf, or similar, cluster of inexpensive PCs on the Open Source operating system of your choice. Of course, Sun Marketing will undoubtably convince some that they absolutly cannot live without the latest UltraSparc Millenium Parallel Honking Machine From Hell/1000, which can be yours for a mere $8.7 x 10^16 and will even run an operating system which has no compiler included (such "add-on" parts sold seperately at still greater cost) and still, to this day, defaults to "ed" whenever an unfortunate user attempts a "crontab -e".[1]

    [1]setting the EDITOR environment variable to "vi" or "emacs" will override this, but that doesn't make the default any less inane.

    --
    The Future of Human Evolution: Autonomy
  50. Re:Wouldn't 1000 CPUs thrash over lone mem/data bu by Abigail-II · · Score: 3
    IF the operating system natively supports upto 1000 processors (i'd assume 1024 would be logical), then that means you can run the same exact binary on a single CPU workstation all the way up to a supercomputer.

    Yes, this has always been one of the good points of Sun. I used to work for a company where developers had single CPU workstations (from Ultra 5's down all the way to Sparc Classics), but production machines would be multi-processor machines (up to 32 processors at some clients). No recompilation needed. Sun hardware really scales well - of course, kudos should go as well to the kernel, because if the kernel doesn't support scaling to multi processors well, the hardware won't do you much good.

    -- Abigail

  51. Re:Who's buying Suns? by Alpha_Geek · · Score: 3

    People may hate to admit it, but Sun hardware is probably the most reliable hardware out there. That is what you are paying for. Their stuff is designed for very large companies who will pay a premium for reliable systems. The problem with PC hardware is that so many different people make different parts that compatibility issues can and do arise, and that is not acceptable for critical servers. Also as much as people gripe about the OS it is also the most scalable OS out there, way better than NT, Netware, Irix or even (*gasp*) Linux for massive systems.
    -

  52. Re:Who's buying Suns? by SiliconJesus · · Score: 4

    Let me take it upon myself to defend Sun one line at a time from your complaints.

    1) The CPU's are overpriced.

    The CPU's are *MORE EXPENSIVE* yes, overpriced, no. Look at a comparison in the CPU's on just a very simple level. The CPU has 8 Megs of L2 Cache. Not 256k, not 512k, not 1 meg, 8 Megs. That Cache is running at CPU Speed. If there's anything at all that's slowing their speed down, its the large amounts of L2 Cache they run with their servers.

    2) Motherboards are overpriced.

    I honestly can't say I've ever priced a Sun Motherboard. There is no such animal.

    3) Memory is overpriced.

    Yes, yes it is. Buy Kingston.

    4) The funky hot-swap PCI cards are overpriced.

    First off, I'm Sun Hardware Certified, and I don't know of a single system in which you can hot-swap PCI cards. You can do this to drives and I/O Boards (on the Enterprise 3500+ systems), but not individual cards. Now getting back to PCI cards being overpriced, in Sun's specifications, it dictates that all hardware MUST have a PROM with the drivers on it to be certified as Sun Compatable. At boot time, all of the PROM's are polled and all of the drivers are loaded at the hardware level. Plug and play that really works, imagine that...

    5) The OS is waaay overpriced.

    Free, yeah way too expensive.

    6) What does Sun do that Lintel cannot?

    A lot of things. First, all of the workstations and servers have TRUE plug and play. There processors scale from Laptops (anyone remember Tadpoles) all the way up to Mainframe-sized computers (E10k). Also - hot-swappable I/O and CPU/Memory in the Enterprise systems. The E10K can scale up to 64 450 Meg processors with 8 megs of L2 Cache, 64 Gigs of Ram, and can run 4 Virtual Machines that can be dynmically allocated on the fly.

    7) Even a Farm of Lintel boxes can be had for less than that sun.

    Sometimes, true. If you had a farm of 386 Linux boxen, (~$5 apiece) will cost less than a fully loaded E10K (~$10,000,000). Realistically, the cost/performance is about 50/50. UltraPenguin is runs better IMHO than Alpha Linux or x86 Linux.

    Don't make opinions without the data to back it up.

    --
    Clinton made me a Republican. Bush made me a Libertarian. Trump is making me question reality.
  53. Power consumption questions. by Masker · · Score: 4

    So this is a 600 MHz RISC processor using .25 micron fabrication processes; that should be pretty fast. However, it consumes 75W power? AND the 750 MHz will consume an estimated 90W power (at .25 micron)?!?!

    WOW! And people think that Intel chips (and Alphas) consume a lot of power! The heat dissipation of these puppies will be monsterous! If you had a dual CPU workstation with 2 600MHz US-3s, the CPUs alone would require (at most) 150W of power. What sort of power supply would that need? 300W+, right? I'd really rather not have one of these sitting under my desk, considering the fan noise from the power supply, case and CPU fans.

    Why can't they use a smaller die size (which should reduce the power reqs and heat dissipation)? Is it just Sun's fabs, or is there some architechtural reason? Or are the power consumption specs they quote just OFF?

    --

    ---------The early bird gets the worm, but the second mouse gets the cheese.

  54. Throughput vs single app performance by ajiva · · Score: 4

    Its all about how fast the system can service request and not how fast a single app runs. My Ultra10 at work is very responsive even under heavy load (Loads of > 1.0). Plus Sun machines are very balanced. You don't have the CPU waiting for the memory, disk, etc. Unlike PC's today where the CPU's are fast, but are hindered by ATA disks, high latency caches and memory

  55. Written using emacs by ChrisRijk · · Score: 5
    Just thought I'd let you all know that I used emacs to write the whole article in HTML. (though the webmaster for Ace's Hardware did some final formatting to fit with the rest of the site). Written on a FreeBSD box too...

    I've already started writing a 2nd article, this time on Sun's MAJC chips, which have lots of interesting features. Yummy. The reason why I'm doing a bit about Sun hardware is because (a) I tend to follow what they're up to because they do occationally do pretty interesting stuff, and (b) nobody else has written much...

    Wish they weren't so secretive sometimes though. If you actually look at Sun's site, there's almost nothing about the US-3 technically. Still have to wait until Sun start actually selling US-3 hardware before can be certain of anything...