Hardware Selection for AMD64 + Linux?
MrClever asks: "After a disaster involving my cat, a pot of coffee and my workstation, I am now in the market for a new machine. I thought I'd jump on the AMD64 wagon and keep running Linux. After some initial investigation, it became clear that ATi, Promise and other manufacturers don't have 64bit drivers for Linux, which rules out most motherboards with onboard P/SATA RAID, thus limiting my available choices. I know you can run 32bit on AMD64, but if I wanted that I'd get an AthlonXP. So, what AMD64 hardware is the best supported in 64bit mode under Linux? Seems NVidia have 64bit drivers, does anyone else?"
You spilled coffee on your cat, causing 3rd degree burns. S/he starting meowing in pain and you jumped to the rescue, accidently knocking your computer off the desk.
Oh, you mean your cat just knocked the coffee onto the computer? Never mind...
Vonal Declosion
Wait for Socket 939 boards & CPUs - the current Socket 754 has a very limited lifespan. Socket 939 processors are due VERY soon now (just saw the first leaked report on one yesterday). FYI.
Of course, this doesn't apply if you're thinking about the Opteron, with its Socket 940.
Most of the RAID on the motherboards are really software RAID that runs in a Windows driver or Linux driver. Since each slot usually shows up as a normal PATA or SATA device, one could then just use Software RAID under linux and get the same effect as the "on board" RAID under 64-bit x86.
The Promise controller on the Tyan Opteron motherboards works perfectly in both Red Hat Enterprise Linux (with Update 2), and Fedora Core 1/2 for AMD64.. That same chipset (PDC20378) is available on Athlon64/AthlonFX motherboards as well.
Since I hate in movies when someone pulls a gun and shoots a screen which magically destroys all the data on the computer
:)
Unless of course it's a first edition iMac.
I watched C-beams glitter in the dark near the Tannhauser gate.
3ware cards work a treat in amd64 systems with one caveat - using the PATA Escalade 7500-series cards on the Tyan Thunder K8W (opteron) MB is asking for trouble. The SATA cards work fine.
Promise is junk anyhow; it's not a hardware raid controller, just a dumb ATA controller card with software RAID drivers.
Just do your own software raid in Linux or buy a real (e.g 3ware) controller.
-Isaac
I am not a lawyer, and this is not legal advice. For Entertainment Purposes Only.
Maybe you should either tell us what kind of applications that you want to run. Video drivers aren't too important for a headless box that sits in a closet.
/dev/null will fail, but cat /dev/null will not. You will find these limitations from time to time, and rarely does the platform matter.
I'm guessing that you are planning on running very large memory applications (> 2 Gig per process), otherwise 64bit support is useless. Especially since _many_ of Linux's applications still have 32bit limitations, even when compiled for 64bit platforms. I've run 64bit linux for 6 or 7 years now, and I'm still pissed that I run into 2Gb file size limits. Remember an int on 64bit linux is still 4 bytes as it is on 32bit systems, so each application has to either use size_t or long to get 64bit integers (which will work on either a 32bit or 64bit machine). Just today I had a user mail me with an error with rcp because it could not transfer a file that was 2.1Gigs. I believe 'cat' has the same limitation, unless it is done as a pipe. For example, cat over_2Gig_file >
Also, Linux has other limitations like it cannot access a block device over 1 or 2 Tb (depending on the kernel version).
I think that the 64bit hype is amusing. I'm not sure, but an amd64 system running int 64bit mode might be slower than a 32bit offering from either intel or amd. You will have to look at the numbers, but they are hard to find. All of the benchmarks for the opteron that I have seen were run on 32bit applications that were complied with the _Intel_ compiler, or sometimes gcc (and then I believe that they were in 32bit mode).
My recommendation is to 1) kill you cat (just kidding), and 2) just by a stock machine that is either 32bits or look for an integrated 64bit system for linux already, or get a really nice 64bit system (but I wouldn't put Linux on one of those).
Maybe the support database of a linux company like SuSE may be helpful.
the second cat command should be cat < over_2Gig_file > /dev/null
the 1st one took I guess because the < > were unbalanced.
After a disaster involving my cat, a pot of coffee and my workstation...
:)
I can just see it:
"So there I was, petting my cup of coffee and drinking my cat..."
Dual opteron just rocks
I have mod points and I am not afraid to use them
64 bit is very fine and snazzy, but what are the consumer options and why do I want them? Lets assume I dont plan on having more then 2^32 bytes of memory for a while, why do I want a 64bit cpu?
because a lot of software can use 64 bits of data at a time in their maths loops which makes everything a lot faster ?
I'm using a VIA-based Gigabyte m/b and basically everything works fine (SATA, sound), but the famous AMD HALT bug is still not fixed in the latest BIOS, so the kernel is running in polling mode. It means that the CPU cannot switch to sleep mode when there's nothing to do. *Very* irritating. BIOS coders are eventually more evil than trade mark/IP lawyers.
You may not want an Athlon 64 simply because it's 64-bit capable, but because it runs 32-bit x86 software (on average, depending on application, of course), faster than anything else. Even if you never run it in 64-bit mode, it's still the fastest thing out there, especially for the money. Don't worry about the 64-bit stuff for now.
I just got a Presario R3000 (R3140US to be exact) and it's not bad.
Linux (slackware) runs just fine in 32bit mode. Even faster than the WinXP that came with it.
It's got the Nividia Video/sound chipsets, Broadcom wireless, RTL8139 ethernet, and modem built in. All I have working (the Broadcom needed the Linuxant driver but it's working like a charm).
I haven't tried the modem yet, but I may in the future.
To answer your question, Linux works fine in 32 bit mode on AMD64s. I'll let you know how 64bit Linux works when Slackware comes out with a AMD64 version.
Sorry to cut this short but, work calls
Your thin skin doesn't make me a troll
After a disaster involving my cat, a pot of coffee and my workstation, I am now in the market for a new machine.
And a new cat.
-why do I want a 64bit cpu?
In nerd-world, it means you have a bigger dick.
What's more it's really fucking inconvenient and I hate being forced to use lower-quality software because of greed.
I'm sure there are more than a few upset nforce users for example. The ones who aren't upset, wait till they find a bug or find their performance isn't up to par and take their problems to the lkml. They'll find out that since their platform is a black box they can't get any support and are stuck with what they're forced to use.
I was going to buy an nforce3 dual opteron motherboard but I can't stomach having to use a bunch of proprietary drivers.
I also used to think that it was ok if just the video card had a proprietary driver. It's just one driver afterall right? well apparently the slippery slope has slipped. From now on I will refuse to use any drivers which taint the kernel.
On top of all this, I have to really question the legality of all these proprietary drivers that are popping up. I know there were some threads on the lkml about this recently.
Basically they came to the conclusion that if a driver was written for another OS and merely released for linux as an afterthought it was legal. However if it was written for linux it came under a derrivative work and was not legal.
Either way... PROPRIETARY DRIVERS SUCK
Liberty.
i didn't see it mentioned here by anyone else, but as reported on a couple of (sites for one)
;-)
there's a neat new box coming out from IWILL that crams two(2) Opterons in a SFF case.
Unfortunately, if you need something now, this one will be coming too late for you unless you're a
developer/partner/etc:
"IWILL ZMAX based on nVIDIA nForce3 Pro 250Gb chipset will sample in July.
Volume production is planned in September, with a suggested price of $499.
IWILL plans to get attention in workstation market. ZMAXdp will include proprietary
form factor motherboard, 300W power supply, up to 2x3.5" HDD bay, and 1xAGP;
PCI and SI can offer various configurations for workstation market demand."
it sounds like it could be a nice little box...
other pre-built systems include:
Pre-built
Caliber
there are others, but I've lost my wish-list
You could also build one yourself, but I'd look for the nForce3 pro 250 or 250Gb, the NF3-150 didn't
exactly get extraordinary reviews.
Good Luck!
"...that's as white as it gets; all the bits are on..."
I do it all the time. It is true that it just boots of the first responding drive, so a bad block halfway through the kernel image can hang the boot until drives are swapped (while a BIOS hook would allow changeover to a good drive mid-boot), but that's still awfully damn good.
The x86 architecture is register-starved. AMD's extensions allow 64-bit code to make use of many more registers, which gives a performance improvement. Lots of fast cache helps, but not as much, because the cache can't reliably know what's needed next or most often, while the compiler often can. For example, Vorbis encoding has a 30% improvement when compiled in 64-bit mode.
well, 8 GPRs + 8 SSE2 does not really qualify as "many more", but an increase of 100% in the number of available registers counts for something. Balance that against slighter larger memory usage due to the 64bit prefixes and pointers and you get ... about 20-30% speed increase on average.
YMMV, of course.
The performance increases of 10-20% is precisely what people got by recompiling with gcc for AMD64. This is, indeed, the reason 64-bit architectures perform better than standard x86/32 bits (Itanium has 128 GPRs for instance ...)
The Raven
Why do I want a 64bit cpu?
At the end of the day 64bit is the next step for general purpose computing. By jumping on the 64bit bandwagon you are preparing yourself for the future. Although at the moment you may find little advantages in speed or performance for certain tasks, as soon as the software begins to reap the advantages you will be ready.Generally speaking you aint going to lose a huge amount with 32bit backward applications, as soon as that 64bit "killer app" comes along you will be ready and waiting to enjoy the rewards .
Electronic Music Made Using Linux http://soundcloud.com/polyp
after posting some hardware sugs, i forgot about the driver issue:most of the newest 64bit driver work from the
major manufacturers appear to be for Windows(ech). ( Here's a review that came out today.)
The latest Linux drivers from nvidia aren't too old; their last nForce3 update was in Dec 2003 and the gpu drivers in Jan 2004
Tyan have a page of drivers, as does Highpoint, and Adaptec
Look into the suse amd64 message boards - they seem to be having some success...
"...that's as white as it gets; all the bits are on..."
is simple
MSI k8t neo FSIR2 motherboard (some issues with slow bios upgrades)
MSI Geforce FX5950ultra 256MB
Soundblaster Audigy
2 x 120GB ATA4 HDD
1 x 36GB SATA 10k drive
1 x dvd+/-rw CDrw combo
amd64 3200+
1 GB (2 x 512MB) kingston ddr333
This system runs gentoo 2004.1 64bit linux fine. SATA and PATA work fine, but there is not now nor, hopefully, will there ever be support for Software RAID as you find on motherboards (it is pointless feature creep IMHO).
Whilst I would say that ASUS appear to be on the ball with bios updates compared to MSI, my system runs fine (even manages wine using 32bit compatibility libraries and runs windows progs...).
I wholeheartedly recommend 64bit linux and would say that EVERYTHING works except high end ATI radeons (ATI couldn'f find their arsehole with two hands and a roadmap in 64bit terms) and many 802.11g cards (mostly due to the atheros binary driver crap, but support is slowly improving). Couple this with *no* support for software RAID (which is no real use anyway) and you nicely encapsulate most of the problems with 64bit linux. Sure, grub and lilo dont play well at 64 bit, so you will need a liveCD or a chrooted 32bit environment to build them (and some other apps); but 32bit apps execute fine as long as you have a set of 32bit libraries for them to play with.
Go for it, join us, we tools who double as early adopters... then you too can whine at manufacturers for their tardiness in supporting "production ready" 64bit OS'... lol
hope this helps...
err!
jak.
Don't forget the new nonexecutable page flag! It reduces the severity of buffer overflows, which is far from useless in my opinion. (I'm not sure if the processor has to run in 64 bit for it to work, but as far as I know, its only available on the 64 bit chips -- someone correct me if I'm wrong.)
-jim
- Amount of performance you'll gain/lose when switching to 64 bit mode depends on the application you intend to run (for instance big gains on SSH/SSL )
- sizes of executables (programs, libs) are significantly larger in 64 bit mode
Of course in the case of AMD64 you will also gain something because of ability to use more registers, which is not the case with sparc.And one more thing - do take a look at the Solaris 64-bit Developer's Guide. They have done the migration 32->64 long time ago. Learn from them.
You can defy gravity... for a short time
Except for NVidia/ATI GPU's you do not need any other drivers from manufacturers. Everything is in kernel. And nobody will help you with kernel proplems if you have third-party drivers/modules loaded (have tainted the kernel). So stick with what kernel comes with and use NVIdia/ATI drivers for their GPUs if you really need 3d acceleration and such.
In a moment of madness I though about installing bochs on my Athlon set up to emulate AMD64 and see if I could bootstrap a 64-bit Slackware compiled from source...
Stick Men
I've been having major problems with Promise tech support. The technical support manager has NO technical background. The company has been unwilling to fix problems.
Just today I had a user mail me with an error with rcp because it could not transfer a file that was 2.1Gigs.
For example, cat over_2Gig_file > /dev/null will fail
I could see this as being true "6 or 7 years" ago, but any remotely modern linux distribution will NOT have a problem with this, even on 32-bit platforms. Here is a screenshot debunking your claims for both rcp and cat.
Perhaps your problem is that you're not compiling your applications using the large file support API, which all modern distributions do for you whenever possible.
You will find these limitations from time to time, and rarely does the platform matter.
You take a look at this screenshot and try to tell me that platform doesn't matter.
Also, Linux has other limitations like it cannot access a block device over 1 or 2 Tb (depending on the kernel version).
Ironically, the one limitation that you do state correctly is also one of the limitations that only applies to 32-bit systems. It sounds like you need a 64-bit system after all, preferably a modern distribution like Fedora 2 or SuSE 9.1 that doesn't have any of the weird userspace problems that you bring up.
Currently we (computer support for state university EE/CE dept) are looking into picking up some Athlon64 machines. The machines will be dual-booting Windows and Linux, most likely being used as fast 32bit machines.
The problem is that The Powers That Be insist on us purchasing the systems from a large vendor (Dell, HP, etc) and, from what I can tell, none of the large established vendors have Athlon64 systems available (HPaq has one, but it's in their 'home line' and not actually sold through their business division).
Plenty of people offer Opteron systems, but we're looking for a good vendor to pick up some Athlon64 systems from, does anyone know of one?
my sig's at the bottom of the page.
I think that 64 bit systems are pretty cool personally, but for what its worth, I'm totally happy with my XP2400+. Cheap, powerfull, and stable. Three good things right there.
Clickety Click
Aopen AK86-L
WD HDDs
Aopen DVDROM/CDRW and DVD+RW
Nvidia FX 5900 Ultra
Redhat WS AMD-64
all's running awesome except I cant get damn palmPilot to sync : (
rm -rf ms/*
Comparing your experience with HP 64 bit with future experience with x86-64 isn't really fair. AMD's 64 is the first 64 bit machine that average consumers and most importantly gamers are buying. If these people are buying in mass, you KNOW the software for it will follow. Noone bothered making software for HP 64 because there just wasn't the market for it.
however, I think the ATI 9200 series meets your requirements.
The http://dri.sf.net project is the place to get the scoop on fully open source supported 3D cards.
The Internet's nature is peer to peer - 20050301_cs_profs.pdf
The kernel guys will ignore a system with them installed as well. They taint the kernel too.
The Internet's nature is peer to peer - 20050301_cs_profs.pdf
Are you saying that if you buy a graphics card from any manufacturer other than ATI or nvidia, you will find that there is full, 3-d accelerated kernel support for those graphics cards?
I have SuSE 9 with a self compiled 2.6.5 kernel (no ROM drives and broken bits last fixed in 2.6.2-mjb), Gentoo stage 1 build with self-compiled Gentoo 2.6.5 kernel (lotsa missing kernel options) that just doesn't boot, Slackware 9 with self-compiled 32-bit 2.6.5 that *nearly* hits the mark except for KDE and all (at least it sees the SATA drives, if not as RAID0). Under SuSE, my lovely Sony USB 3.5 inch floppy shows up as a squillion drives or not at all in other builds. Create a boot disk? pffft! And NVidia 64-bit drivers? BWAHAHA!
FreeBSD 5.2 AMD64 is fast, dull, mysterious and very weird, but still lovable even though it doesn't see GRUB.
Windows XP 64-bit runs native 64-bit ports very well, but WOW (Windows On Windows) for your 32-bit apps sucks. "Does your 32-bit app run in 16 colours or 256 colours?". 3DBench that, people.
Then there's the Envy 7:1 surround sound. Win 32 land again only.
It may break my heart now, but all things happen in the fullness of time.
I have two Opteron 242s on a Tyan K8W (S2885). Linux has great support for this sytem, and I am verey happy with it. The SATA controller works well, and linux supports the on-board gigabit ethernet controller. I have an AGP nVidia graphics card which is also supported in 64-bit mode. The on-board sound works and sounds great, and the FDD and IDE controllers are supported as well.
I run gentoo, and I would recommend that anyone useing linux on an AMD64 platform do so. I used SuSE 9.0 for AMD64 for a few months, and I was dissapointed with it. Gentoo seems to be much faster and more stable. If you're going ot run linux, also be sure you use a 2.6 series kernel because it has great K8 NUMA support.
This is the fastest system I've ever used, and I would recommend it to anyone!
I am a viral sig. Please help me spread.
That's what I said.