NT faster than Linux in tests
Mike_Miller writes "The lastest Mindcraft Study claims that Microsoft Windows NT Server is 2.5 times faster than Linux as a file server and 3.7 times faster as a web server. Their white paper shows that NT beats Linux on every test. " Anyone have a critique?
Fished out of dejanews -- the Mindcraft folks used the pseudonym 'will@whistlingfish.net'
(If this was posted earlier, I didn't see it...)
Can anybody here respond to this?
Hi Everybody,
We're considering using Linux + Apache as a web server. The hardware
is a 4-processor 400 MHz (Xeon) server with 1GB of ram, a RAID controller,
and six disks. We have Redhat 5.2 installed and compiled an SMP version
of the 2.2.2 Linux kernel. For the web server we used the latest 2.0.3
version of Apache.
The scenario: we're bangin' on this web server with a bunch of clients
to try and get a handle on its capacity. Simple static HTML requests,
no heavy CGI yet. My Apache server is tuned up, MaxClients is 460.
I recompiled with HARD_SERVER_LIMIT set to 500. Limit on number of
processes is 512, imit on file descriptors is 1024.
The problem: the server performs well, delivering in excess of 1300
HTTP GET requests per second. But then performance drops WAAAY
off, like down to 70 connections per second. We're not swapping,
the network isn't saturated (4 x 100Mbit nets), disks are hardly used,
but the system is just crawling. If it were saturated then performance
should level off, not drop like this. Neither vmstat nor top show
anything unusual. No error messages in the web server. Its puzzling.
Any ideas? Any tips, suggestions, or pointers would be appreciated.
Thanks!
slashdot broke my sig
Apache collapsed after 250 threads on a Quad 400Mhz Xeon? Something is definately screwy there..
I have average close to 60-70 Apache threads running as a regular load on Pentium-120 with 64megs of ram without any problems. Most of those are database-generated, rather than plain file GETs. Someone has been either drinking or got paid some dough..
If a Linux kernel can only see 970 MB RAM, it's been misconfigured. To make it see more, there's a source file that has to be edited - but why isn't it an option selectable from 'make config'? SMP is... maybe this'll motivate the change.
I see M$ is still up to their old tricks. Oh well. It'll be nice in a few years when they're not even around anymore.
Really; the Winbox had most of its services shut off, while the Linbox was running SMB, NFS, etc. My guess is that they were probably hitting those other services while they were taking the numbers.
Besides, this runs contrary to every other (non-MS paid-for) study I've seen. Mayhaps someone should do some independent verification. Be sure check if the Windows numbers were a "demo".
Hey, they lied to Justice; why wouldn't they lie to us?
----
Every year during my review, I just pray the words "slashdot.org" aren't mentioned.
I agree, it is hard to believe.
And: These people are *LIARS*. They say the posted messages asking for help on the Linux newsgroups. There are *NO* messages from the mindcraft domain anywhere on the Linux newsgroups. So I did DejaNews searches of "performance tuning", "performance tune", "kernel tuning", "kernel 2.2 tuning", between January 1 1999 and today, and examined the results to see if there were any messages that may have been by MindCraft researchers (i.e., that were referring to performance problems with a large-memory machine). There were *NONE*. Zero. Zilch. Which means that if they did ask any performance tuning questions, they did not use those words in the message.
Anyhow: VA Research already loaned a quad-processor Xeon machine to PC-Week and it blew away NT 4.0 in their SAMBA benchmarks. VA Research's quad-processor Xeon machine is the same machine that we sell, and the same machine that Penguin Computing sells (we all get them from Intel, and then dress them slightly differently once we get them, e.g. VA Research uses a Mylex RAID card while we and Penguin use ICP-Vortex RAID cards). So we already have the benchmark that shows that their SAMBA benchmark is full of ****. But that's not going to matter to pointy-haired bosses because they recognize only those reports and studies that say what they want to hear.
Am I steamed? You bet! I *HATE* liars!
-- Eric
Send mail here if you want to reach me.
that they had the Apache config set to allow up to 127 servers, and they had not raised file_max from 1024 to something decent. Do the math. Each Apache server has 8 file handles open just sitting there doing nothing. If it then goes to open a file to serve it, and file_max has been exceeded, guess what happens? Yep, Apache collapses!
-- Eric
Send mail here if you want to reach me.
Thanks. I just checked that out. It does appear that they asked a single question about Apache performance. I remember seeing that posting myself and blowing it off because there wasn't enough info to tell him anything and I didn't feel like going into the give-and-take to get enough info to do something. (I do enough of that supporting my own customers!). Now, in hindsight, knowing what he did not do to Linux, the answer is obvious: he was running out of file handles. Do the math. An inactive Apache server has 8 file handles open. 127 servers max * 8 = 1016. Default file_max is 1024 for Linux, of which 150 or so are usually open while the system is at a rest. Apache could not bind a socket to a file handle for incoming connections because there were no file handles. So Apache was basically deadlocked, waiting for file handles to come free so it could accept() the socket but it was already holding all the file handles!
If there had been questions about general tuning of such a large system, that would have solved the problem because someone would have remembered about file_max. But one cryptic query that didn't give enough information to get help does not an honest effort make.
Anyhow: I guess I have to post a partial retraction. They did post a *SINGLE* query to the net.
-- Eric
Send mail here if you want to reach me.
Posted by The Chicken of Darkness:
Let's see here... they were using a ZD program to test SMB performance? To a certain degree NT would have an edge, given MS made the SMB protocol and since it is a Ziff-Davis program. The headline doesn't even specify "fileserver". I'm sure Apache would shread NT as a netserver, performance wise and in up-time.
Posted by LOTHAR, of the Hill People:
c es:
..."
I supect that the people conducting the test were not proficient linux users/administrators. The Linux installation followed defalut settings except for Kernal automounting. The fact that
"NFS file system support = yes "
makes me wonder how the drives were partitioned (RAID configuration as well)
The test also mentioned
"The Linux kernel limited itself to use only 960 MB of RAM"
Which is a subject dicussed here last week
The NT installation was not default, the Registry was directly changed.
"Server set to maximize throughput for file sharing"
"Set registry entries: HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Servi
\NDIS\Parameters\ProcessorAffinityMask=0
Tcpip\Parameters\Tcpwindowsize = 65535"
"Used the affinity tool
I do not consider the test valid.
The NT installation was tuned (if even slightly)
The Linux installation was not.
We need o third party with a though understanding of both OS's to administer an accurate test.
Posted by the order of His Majesty:
Not regarding the web server, but I noticed that they set NT's pagefile to 1GB and didn't mention Linux's swap configuration at all.
Taking everything that they did to misconfigure Linux it doesn't surprise me that it doesn't perform spectacularly, it's like turning off L1 and L2 cache, turning off shadow ram, and setting 4 wait states to a PentiumPro 200 - it turns into a 386!
Stuff like this ought to let people see what Microsoft's game plan really is (assuming they even have one, after reading the Halloween docs (: )
If they had availed themselves of a Linux expert (or gotten Linux pre-installed by a good VAR), they would have tuned the kernel to at least use 2G of RAM. All you have to do is change __PAGE_OFFSET to 0x80000000.
Compare and contrast:
NT 4.0 is 2.5 times faster than Linux as a File Server and 3.7 times faster as a Web Server
with ZDNet's findings on the subject of the same benchmarks of Linux vs NT benches.
The same thing could have happened if smp were "Accidentally" left out of the linux machine's kernel.
I doubt that any amount of "tuning" would generate this type of difference. With apache, perhaps realtime ip resolution would do it, but I don't see how that would figure in with Samba.
Set OPTIM = "-04 -m486" before compiling
on 4 x 400 MHz Pentium II Xeon
Samba 2.0.1 Configuration
wide links = no
That creates a bottleneck in Samba performance, see here
the following processes were running ... (kswapd), /sbin/kerneld,syslogd,
not sure if that means something, but why they run kerneld with 2.2 kernel ?
On NT side:
Tcpip\Parameters\Tcpwindowsize = 65535
that makes huge boost on network performance, but only on local network where packets don't get lost
Set Logging - "Next Log Time Period" = "When file size reaches 100 MB"
Logs on the F: drive (RAID) along with the WebBench data files So basically server does much less logging than Apache - and since it's many small requests, and since Apache writes logs on a non-RAID disk all together it'll be a big bottleneck
Anyone noted anything else wrong with this benchmark ?
From all my experience it looks like pure crap
P.S. Why they needed NFS ? inetd ?
Obama 2012: our incompetent asshole is slightly less of an incompetent asshole than the other incompetent asshole !
The problem is that Linux needs kernel patches for more filehandles, >960MB memory, etc. etc. It's very sad IMO.... a sysadmin should NOT be expected to have to apply patches.... menuconfig options maybe, but not patches.....
People complain about tests like this and DH Brown, but really only somewhat out-of-box solutions should be tested.
"We work with you to define the goals you want to achieve via testing."
As their main web page states, they define the goals before they test. The only goal was to say NT runs faster than Linux. I've never heard of this company before. I now know why.
-m486 is pretty standard. I would be very surprised to see a performance gain of more than about 1% between -m686 or similar and -m486.
wide links=no has been explained on other threads. It certainly slowed down performance by an unreal amount. This is a paranoia security measure that apparently some admins would use. I don't know that it's fair to assume that they put this in solely to skew the results.
As for kerneld, inetd, NFS, etc.: all right it's unnecessary, but will use under 1MB of RAM and under 0.1% CPU most likely. I don't see this as an issue.
My best guesses for the apalling results are something like this:
- the wide links=no thing. NT doesn't have to worry about symlinks. I think this is unnecessary in pretty darn well every case. This could either be intentional malicious intent for the pro-NT side, or inexperience/a mistake. Either way, it would be nice to show some number with this turned on.
- pure speculation here, but they may have set up Apache to do real-time hostname lookups. This is an absolute no-no for any serious server. Again, possibly inexperience or a mistake.
- the >512MB RAM Linux bug. I've heard horror stories, and I've read people with no problem at all. Also, I believe this was a problem with PIIs only, and they were using Xeons in this report. Who knows.
Anyway it appears to be a bad combination of very silly yet somewhat understandable (for newbies) software misconfigurations, and some bad choices in hardware. Which brings me to another point: quad Xeon for a server? My K6-166 could handle a few thousand hits a second I'm fairly certain. Adding more processors will only slow things down when you're dealing with file serving.
It's hard to say whether or not they did this intentionally. It's fairly obvious that they didn't know exactly what was going on with Linux. I'd say Microsoft has a list of hardware that they know works well, and when these people asked for sponsorship, some Microsoft people said "OK here's some hardware that we know works. BTW doing this and this and this might help out your performance". Not to say that Microsoft went out of its way to hurt Linux, but they probably know what works best on their own systems.
More than something screwy. You can't use more than 100 threads on IIS 4. It uses Microsoft's Transaction Server thread resource pooling to do thread management, and MTS is internally limited to never handing out more than 100 threads. So basically at least some of it is incorrect.
echo 8192 > /proc/sys/fs/file-max
kernel patches my ass..
-- You can be a geeklord too
If you look at the certification section it is "mindcraft" admits that MS paid them to do this benchmark. Frankly, I can't see how that could possibly make an objective benchmark.
If you look at the other whitepapers that this company has done it is very evident that they are highly biased towards NT.
Just look at the SMP Ultra Sparc machine getting
beat 4x over by some NT PC.
Over at linuxtoday.com one of the Samba team members gives other information
emad
Famous Last Words:
The only way to work this out (apparently) is if representatives of "both sides" came together and defined parameters of a test. They should specify things such as what hardware the server should run, what services should be running (and more stuff that you sysadmins know about for a living). The group should also lay down specifications on how this should be measured. Then, these specifications should be publically reviewed, and revised if necessary.
Then there should be a test for extremists on both sides to tune the OS of their choice to achieve the best possible performance on the specified platform.
If a vendor (say, Dell, Compaq, IBM, or one of the other companies that now presumably deliver both OS's) could put up a number of similar boxes and have a "tweaking contest" on a software convention or whatever, that would be even better. However, I cannot believe for a second that Microsoft would have the balls to allow such a shoot-out...
Chilli
-=- Just a random lambda hacker
I just wanted to mention that I've recently set up a Dell Poweredge server with PERC RAID controllers, 512MB RAM, Dual processor Pentium II 450s, and Linux 2.2.5.
This machine serves over 100 clients, and it functions as a primary domain controller running Samba 2.0.3. It has worked phenomenally for the all NT network my client has, and it also serves Email, IMAP, POP3, and is a web server for all the users here. It also does a myriad of other tasks, and the load never even hits 1. And this thing is a less powerful machine than they tested, but it can serve over 100 clients with ease.
I don't know where they cooked up the figures they have, but this server gets plenty of use, and it's never buckled or given me any problems setting it up.
By the way, does anyone know where I could go to find out how to increase the maximum number of files, and/or to further tune this machine, because I've had a couple of small problems with running out of file handles for the whole system. Anyone have any suggestions for a site I could go to?
Yeah, this study is sponsored by Microsoft, if you read the fine print:
Mindcraft Certification
Mindcraft, Inc. conducted the performance tests described in this report between March 10 and March 13, 1999. Microsoft Corporation sponsored the testing reported herein.
Looks like you can buy anything you want with enough money. It doesn't make it a true indication of a real-world situation.
I think that there's enough evidence to the contrary already out there, and this will only serve to discredit Mindcraft.
According to a posting on Linux Today by Jeremy Alison of the Samba Team, it seems that the Mindcraft study crippled the Samba server in the tests:
:)
From Andrew Trigell (original Author of Samba):
They set "widelinks = no" now I wonder why they did that
In case you haven't guessed, that will lower the performance enormously. It adds 3 chdir() calls and 3 getwd() calls to every filename lookup. That will especially hurt on a SMP system.
I think it is important that the Linux community contests these results, as they certainely seem skewed, but I hope we can do it calmly and with dignity.
With the amount of equipment involved, I believe it would take VA Research or a company of that ilk to try a similar test.
(Could we do a test on a less expensive set of equipment?)
If the results of the original report are not reproducible, then what they did is bad science. I think that trying to reproduce the results, but with people who know how to optimize the Linux set-up (and be fair and optimize the Windows set-up too) would do much more for how Linux is preceived than by us doing a lot of name calling and questioning the motives of Mindcraft.
The point is, if everybody else who does the test gets completely different results, that will be all we ever need to say.
Let's respond in a way befitting the wonderful operating system that Linux is.
http://linuxtoday.comf tcheck.html
also provides a link to an article about a similar incident Novell had with Mindcraft.
http://linuxtoday.com/stories/4937.html
http://www.novell.com/advantage/nw5/nw5-mindcra
The one on the novell website is epecially informative. It is the exact same situation in which results published by Ziff-Davis show NT at a disadvantage, but when Mindcraft does the test, NT comes out ahead!
>Linux 2.2.x has the same default window size. The memory limit is hard coded in Linux, unless you apply some patches.
I'd beg to differ here - passing mem=000M via lilo will cause linux to address that memory - provided the system has that much addressible space.
--
As I read the configuration, the NIC configuration really jumped out at me. They explicitly set the NICs to 100Mbit, and set them to bind to one CPU each. Now I don't know much about the EEPro 10/100, but will it automatically use 100Mbit on Linux without explicitly using it? As well, if they didn't bind the NICs to each CPU in Linux, won't you get a bottleneck as all 4 cards fight for the CPUs?
/etc/conf.modules and kernel boot line.
I also noticed that the NT box was tuned by someone who is obviously very well versed in NT internals. The Linux box appears to be an out-of-the-box install, with the proper settings turned on. They didn't even include the
One more thing, notice the cache TTL and max number of open files for IIS. Both are set to very high settings, which will ensure that files will not be paged out during the runs.
This is the introduction to the "general performance tips" section of the apache manual.
------------------------------
Apache Performance Notes
Author: Dean Gaudet
Introduction
Apache is a general webserver, which is designed to be correct first, and fast second. Even so, it's performance is quite satisfactory. Most sites have less than 10Mbits of outgoing bandwidth, which Apache can fill using only a low end Pentium-based webserver. In practice sites with more bandwidth require more than one machine to fill the bandwidth due to other constraints (such as CGI or database transaction overhead). For these reasons the development focus has been mostly on correctness and configurability.
Unfortunately many folks overlook these facts and cite raw performance numbers as if they are some indication of the quality of a web server product. There is a bare minimum performance that is acceptable, beyond that extra speed only caters to a much smaller segment of the market. But in order to avoid this hurdle to the acceptance of Apache in some markets, effort was put into Apache 1.3 to bring performance up to a point where the difference with other high-end webservers is minimal.
This is just like television, only you can see much further.
Okay, folks. So we have a bit of egg on our face for this one, because nobody (to my knowledge) has really stepped forward with large-server Linux benchmarks which demonstrate anything differently. It may be that Mindcraft royally screwed up, or it might be that Linux really is slower than NT for a certain set of benchmarks -- the truth is more likely a combination of these factors.
If Linux is going to be treated as a serious operating system by the majority of the IT community, it's going to have to step up to the plate and demonstrate scalability and performance which does rival NT server in this area. Most of our knowledge about Linux-vs-NT performance is somewhat anecdotal -- we haven't really "put our money where our mouth is" and shown objectively that Linux can outperform NT in these areas.
Rather than dismissing this study as FUD, I think we could learn a few valuable lessons from this study. We should seek to understand why the benchmark results weren't as great as we would have liked. We should fix any obvious bugs or misfeatures in Samba, Apache, and the Linux kernel which stood in the way of higher performance. And we should stive to improve the entire system to make it be a true NT rival.
We have a lot going for us. First of all, we can innovate at a much more rapid pace than Microsoft -- so hopefully within just a few short months (and I'm being pessimistic!) we could demonstrate a high-performance Linux file and Web server which kicks NT's butt all over the place.
Nobody said building a high-performance, scalable Internet server operating system was easy. Let's get to it!
Matt Welsh, mdw@metalab.unc.edu
Pretty much all high-traffic sites have dynamic content. They are not limited by the kind of web server performance these systems measure, but by the technology you use for generating the dynamic content (Perl, CGI, Servlets, databases, etc.).
Throughput of more than a few megabits per second is also pretty academic, at least for Internet sites and most intranet sites, simply because the network can't handle more than that.
Furthermore, Microsoft has been foremost in doing funny things with their TCP/IP implementation, both on their servers and on their clients, to look better on these kinds of benchmarks. If you look at the TCP/IP specs, it's actually impossible to achieve the kinds of hit rates they claim with a compliant implementation. Microsoft also seems to have done other things with timing and sequence in the past that made their systems look good and other systems trying to interoperate with them look bad (accident? you tell me...). So, even if NT performs better with 95/98 clients, that doesn't necessarily imply that NT is a more efficient system.
Another problem with their study is that it makes little sense to buy a four processor Xeon machine to run web sites with Linux. Four separate Linux machines are going to be more robust, easier to install, easier to maintain, perform better, and cost less. Of course, with Windows NT, because of the hassles of administering machines and because of the cost of the various software licenses involved, people may end up having to buy expensive, high-end SMP machines. I view that as a strike against NT.
They also don't seem to have tested systems where multiple, different server processes need to run on the same machine (web server, database, etc.). NT seems to perform poorly in those situations.
I can't comment as much about the Samba results. What I do know is that the Microsoft SMB servers we use seem to perform very poorly compared to the Samba servers on Solaris in practice. These are both professionally installed and maintained systems on high end hardware with hundreds of clients.
Altogether, their study strikes me as biased and meaningless. To me, NT isn't even in the running for building large, high-performance web services. For the performance characteristics and functionality that matter on real web servers, a Linux or BSD server farm is a cost effective way to go.
There are not many things to shoot at.
:)
Linux does not appear to have done well. How does this test translate into a real world situation? Isn't Slashdot running on a lesser machine than the test server? And cranking nicely with perl and Apache doing the dirtywork?
Someone has already mentioned the 960 MB self imposed Linux RAM use limit... Looks like a typo more than anything else.
Pretty graphs that an MBA would appreciate looking at.
The testbed was purely Win95 and Win98 machines running Microsoft TCP/IP - how this translates into 'extend and embrace' is interesting.
The one major anti-Linux thing said was that documentation and support were not forthcoming for the kernel and Apache, but the Samba docs were decent. Is this because Samba is a 'clone' of a Microsoft product?
Just how intimidating is the lack of formal documentation, for an enterprise level web server? After all, the people responsible for handling such an animal would surely have readily available access to the 'routine' expertise, and quirks and oddities are not something even Microsoft documents eagerly.
Ah well.. Back to time off.
-- What you do today will cost you a day of your life.
Well, it says that the NT servers peaked at *112* clients during the SMB test. Looking at the street value of the system, a 20 user pack is about $2000 CDN. 112 users would cost a company *over $10000 CDN* for just the software alone!
:)
This is just plain stupid.
æeee!
The net posts asking for help that are mentioned in the white paper appear to have been most likely made under the pseudonym:
will@whistlingfish.net
Use DejaNews.
No-one seems to have done that and talked about it. I did; h ere's the relevant link that lists all the messages from this guy on Usenet. Take a look at them and post what you think about them. It seems to me he hit a strange, obscure bug in GNU, Linux, or Apache, and it might have something to do with network adapter or SCSI adapter problems.
--jon. Postel is dead. May we all mourn his, and our, loss.
These tricks probably need to be documented somewhere.
As Linux becomes used for bigger jobs in buisness a high quality Kernal Tuning HOWTO would be good. Even if it were a published book.
So they have 4 network cards in that nice little Dell machine, and they specifically mention "Used the affinity tool to bind one NIC to each CPU", so my question is whether they even bothered to use the other 3 NICs under Linux.
It seems to me that Linux with one network card doing only 2.5 times under NT with 4 network cards sounds about right. Give Linux 4 network cards and you get performace that easily blows NT away.
To use multiply NICs you have to use the network driver as a module I believe, did they bother to do that? I can't imagine Red Hat's installer "How many network cards do you have, but then again maybe it does, I'm a Slackware kinda person...
---- Gee, I wish I could read Kanji...
The beowulf newsgroup had a couple short threads a couple months ago about consistently abyssmal performance on redhat 5.2 SMP machines running 2.x with > 512 MB of RAM. The two threads [ one, two] deal with users who had horrendous performance problems with their new machines (both running 2.2.2, the same kernel as in the report) when they used more than 512 MB of ram, but the performance jumped right back up when they used 512 or less. Check out the articles to see how bad the performance was; it's pretty surprising, and presents an interesting opportunity for detractors of linux:
Linux definitely has some hardware/kernel combinations that would seem OK by design on paper, but exhibit peculiar behavior in practice, especially with SMP. I wouldn't rule out the possibility of the testers (or financial backers) hand-picking kernels/hardware configurations that could affect results while seeming perfectly viable to the layman.
It seems very likely to me that if Microsoft did not outwardly donate the hardware to the testing company, they at least made suggestions on its configuration. The open nature of linux development and bug disclosure could easily be used by companies wishing to stage biased demonstrations; Microsoft almost certainly does a thorough job tracking linux kernel development and bug reports.
-- Scott
Now, here's the complete reply they got.
In article ,
will@whistlingfish.net wrote:
> We're considering using Linux + Apache as a web server.
Excellent choice.
> The hardware is a 4-processor 400 MHz (Xeon) server with 1GB of ram, a RAID
> controller, and six disks. We have Redhat 5.2 installed and compiled an SMP
> version of the 2.2.2 Linux kernel.
I hope it's not too late to change your hardware, because your box is a
complete waste of money. SMP gives you *nothing* with regards to web
serving, and it makes your OS flaky as all hell. The RAM is nice, but the
processor speed is overkill and having 4 of them is just plain wasteful. The
network card would saturate completely before you even came remotely close to
using up the resources of even a single P2 200Mhz.
> For the web server we used the latest 2.0.3 version of Apache.
Stick with what works. I'd use 1.3.4, as it's generally considered more
'stable'. You don't *always* want to be "bleeding edge".
> The scenario: we're bangin' on this web server with a bunch of clients
> to try and get a handle on its capacity. Simple static HTML requests,
> no heavy CGI yet.
Another suggestion: mod_php3. I guarantee that if you ever see large
amounts of traffic, CGI will rapidly become your worst nightmare. There are
a variety of _internal_ Apache modules that give you everthing CGI can do,
but faster better and more efficiently. Keep in mind that CGI requires you
to fork() another process to handle each web request, which can very quickly
run you up against the process limit on a heavily loaded machine. PHP3 is a
PERL-like, C-like programming language that's relatively lightweight. You
can download the sources from http://www.php.net/, where they also provide
instructions on how to build it into Apache.
> The problem: the server performs well, delivering in excess of 1300
> HTTP GET requests per second. But then performance just drops WAAAY
> off, like down to 70 connections per second. We're not swapping,
> the network isn't saturated (4 x 100Mbit nets), disks are hardly used,
> but the system is just crawling. Neither vmstat nor top show anything
> unusual. No error messages in the web server. Its puzzling.
Try various flags to netstat, see what they say. If you could post the
details of several different commands that would be helpful in diagnosing the
problem.
> Any ideas? Any tips, suggestions, or pointers would be appreciated.
> Thanks!
What type of network load do you expect to see on your box in the long run?
What type of applications does it need to run (other than Apache and its
modules)? I know it's blasphemy in this group, but if you're just doing "raw"
webserving (no database interaction) you'd see *much* better performance with
some variant of BSD (for example, FreeBSD from http://www.freebsd.org). If
you're more into running a K-rAd k00l website with lots of doo-dads and gizmos
(and don't care about performance under heavy load), then Linux is your best
bet.
-Bill Clark
-- Alastair
Anybody know what this does:
Used the affinity tool to bind one NIC to each CPU
(ftp://ftp.microsof t.com/bussys/winnt/winnt-public/tools/affinity/)
If this does what I THINK it does it would explain a lot.
Say I put /home/samba on as a public SMB share. Also say that there is a symlink called "root" in this directory that points to /. Then someone accessing this share can "cd root" to access the whole filesystem. Setting "wide links = no" prevents this by causing samba to check if symlinks are outside the share before following them. However, NT4 doesn't have symlinks at all anyway, so in comparing the two, it is acceptable to just delete all symlinks from SMB shares (or at least all those that point outside the share).
Why is anyone surprised at this? Microsoft attacks anything that is a threat. Microsoft has always attacked a strong competitor with overwhelming market force. It will consistently produce more evidence of how poorly it's competitors' products 'truly' stands against its products.
Their corporate methodology has been clear since their beginning. They assume the competition's strengths into their products, and then they state that their product is then the superior product. Their tactics have always been obvious and simplistic, and their tactics have also been very effective, until now.
They face a quandary with Linux: how does a business compete with a product that has no specific vendor to attack? How do they compete with a product that is communistic in nature? It is more than their product's competitor; it is becoming their corporate nemesis. They cannot overwhelm something that has no boundaries, that is developed without regard for specific profit, and that has their own corporate policy as it's core design: 'Be the Borg.' -- take the best of your competition's strategies and products, and make it part of your own structure. Anyone who has followed the history of the computer's evolution will remember that Microsoft started as a forced progression of business policy into non-mainframe OS software development in the late 70's. Anyone who remembers the early days of the PC (or then known as microcomputer) will remember that the thought of 'licensed' software that was property of only the company that created it was laughed at initially as unworkable or unsustainable, but Microsoft succeeded in making that policy work. Microsoft grew rich on that one idea, and it is the reason that Microsoft has been able to achieve dominance in the OS arena.
BUT, Linux has changed something important, and Linus probably didn't realize how important what he did was at that time, or what part of it was important. Linux by itself would never have had the possibility of competing against any dominant OS. It would have been another hacked OS that would never have left the collegiate world. It IS the Open-source licensing structure that has added the needed element to the software that has made it into an upheaval in software design methodologies. It's the Open-source piece that has turned a lot of heads due to its impact on the software industry. This is due to the fact that Linux (and through Linux, the Open-source licensing structure) is an evolutionary change in software design. Linux started as a free, cooperatively evolving OS that has returned the unstructured human element to the process of business software development. Sadly, this human element has always existed in the academic community, but died in the business community with the domination of Microsoft as the dominant business model in the software industry. The corporate structure that has grownup around Linux is just a natural reaction of capitalism to anything that has the ability to produce revenue, but Linux remains a communistic product by it's licensing structure. And that's a good thing for it; it's the only way it will be able to remain a strong and vibrant competitor of Microsoft for the long term.
So, in the end, the analysis of Linux vs. Microsoft is a null argument. Microsoft cannot compete with a product that is not a product, but a movement. Linux is fundamentally restructuring corporate policy towards software development. I just hope Linux's impact will survive the greed that will try to control it's nature while the Open-source movement grows up.
And I hope the 'Borg' in Microsoft can change it's ways so that it can allow another dominant player into the game without it having to feel the need to annihilate it.
-- The violin is playing in the background for those who are listening to it too.
To dream... To fly... What I really want is to be the fly on the wall of your dreams.
The time lost every time they had to reboot NT.
'nuff said.
OK.. no one mentioned it that I've seen so far, but it kinda glared out at me: the fact that he mentions performance "in excess of 1300 req/sec"
before it falls down.. then in the report, that shrinks somehow to 1000 req/sec??
Kinda makes (me at least) ya go Hmmm...
Anyway... I'm looking forward to results on the same kind of hardware, peaked by people who know how. Hope they get that re-test project going!
I'd like to see this sort of test with a third, control group thrown in for good measure, such as Solaris. I personally couldn't give two hoots about NT vs anything, it's not unix which is all I want on my systems, and I'm sure there's a lot of managers out there who think the same.
NT and unix are too disparate for a balanced comparison, high-end Solaris vs Linux comparisons would offer a clearer perspective in the real world.
POKE 36879,8
According to Alan Cox (and he should know) 2.2.2 has a known TCP flaw that is triggered when talking to NT servers. Apparently, this bug still exists.
:)
The Linux developers care about this issue, but not so many of them have NT running at home...
They claim that they contacted RedHat for help with configuring the kernel and RedHat wouldn't help. Makes me wonder... They also said they posted in various news groups and didn't receive any help. This goes against all of my experiences with the the newsgroups. This really smells of FUD... You have to give the boys from Redmond credit, they are very good at promoting their products and FUD.
Look at the OS Configurations:
...
For one, NT used 1Gb of ram will Linux used only 960MB. Surely they could have passed the parameter MEM=1024M to the kernel
Additionally they tuned tcpwindowsize under NT to 65536, and adjusted buffers on the network card to 200 (from 32).
They made no TCP/IP stack adjustments OR adjustments to the netcards under linux.
Just look at the sections explaining the myriad of things they did to "tune" NT. Then look at linux. Enable NFS. The following daemons were run. blah blah. Didn't bother to work on anything.
James
From my meager understanding of web servers, it is not surprising that Apache came in a bit behind IIS when servering static pages. My experience is that for true static content many webservers like IIS and Lotus Go, are faster. Where apache gets major kudos is when running cgi, as the fork and :)
exec of the script environment seems much better. Try running a good hunky perl program on each request and see what you get.
The other thing is that although I am a big fan of linux on powerful machines, its greatest charm is that you can run it on a 486 with 16 megs of ram, and have a relatively well behaved web server that can stay up for 60+ days with no user intervention.
There is no silver bullet. Plus, werewolves make better neighbors than zombies or vampires anyway.
If the numbers are incorrect, the only thing that's
going to convince me is an actual reproduction of the test,
second best is technical information, which is what
some posters are providing.
Your own contribution ("I've never read a bigger pack of lies")
doesn't tell me anything useful and only takes away credibility
from the criticism posted by others. You are damaging this forum.
Argue the facts, not the circumstance that the report serves Microsoft's interests.
The fact that Microsoft won't use their own servers on one of their own sites, shows how much they rely on their product. If an NT server isn't good enough to handle their own web services, why should it be good enough to handle mine?
This one got the charts right:
Linux Up Close: Time To Switch
See "RELATED LINKS": The Best Windows File Server: Links & Linux Is The Web Server's Choice
You have to edit a few lines in the kernel to get it to support more than 960 MB of physical memory.
What I found interesting was that they apparently didn't make a separate swap partition for the linux box (they said 1 OS partition and 1 data partition)... hm...
See what I mean? It used 1024Mb.
Coming soon - pyrogyra
From Andrew Trigell (original Author of Samba):
:)
They set "widelinks = no" now I wonder why they did that
My guess would be so that you would have a secure system, which is what 99% of admins not trying to rig benchmark results would arguably prefer.
widelinks = yes gets you hit on the nose with a soggy newspaper, if you're an admin.
Coming soon - pyrogyra
Wow! It seems like all of our true anonymouse cowards have come out of there holes.
I must say I find it amazing how quick a lot of our fellow slashdotr's are to judge. I work on a production team for a major high tech company. A lot of our Database servers run NT, Anything that is doing security is running some flavor of Unix or Linux.
Just today my mentor(Yes im an Intern, and 16 at that) was telling me we may have to add 3 BSDI servers to our network. I was floored! We already have about 5 diffrent OS's on our network(thats counting diffrent flovors/versions of unix and Linux)
When i asked her why the answer was pretty simple. The program out grand high mucky mucks had dessignated for Ecommerce was optimized for use with BSDI. Now i have to learn yet another OS.
I enjoy hte learning, its why im here, but I have learned one thing. SQL doesnt work well Linux boxes. NT4 has a few security holes that NT5 doesnt. You can fix those with SP4 but then our back end doesnt work.
Ive learned how to set up security on a Unix box in such away that it will make the NT boxes more secure.
I have also learned that most OS are really good at a specific task, and that Zealots will use that to the best of there advantage.
Every OS i have used had some really positive points and some really good points. Linux is great, But i wouldnt want my grandmother using it. The MacOS is great when you want simplicity or are doing major graphics. Windows on the other hand is great if you want to do just day to day stuff. I would hate writting a term paper in Vi or Emacs. Heck i would even hate doing it in Pico! But Word works really well, and notepad can be the "quick and dirty" programmers best friend, especially with HTML stuff that you need NOW.
Everything has a positive, everything has a negative. Lets not get to angry at those who are willing to actually admit they agree with somthing we dont. If everyone was like that this whole world would be like Kosovo.
Lissell (where have all the cowboys gone?)
Linux as we all know runs very well on single processor machines. It also runs well on 2 processor SMP systems. But above that the principle of diminishing marginal returns begins to kick in hard. NT simply makes better use of resources on SMP systems than linux currently does. This is not suprising since few linux devlopers own a 4-way SMP system whereas Microsoft can buy all they could ever want. This is a rigged study. Apple pulls similar tricks when they compare their G3 systems to x86 machines. If Mindcraft were to compare Linux and NT on a single or dual processor machine I'm sure the results would be quite different. As SMP systems become more affordable and commonplace I'm sure that linux will catch up and likely surpass NT in this area. Microsoft claims that NT will scale up to 32 processors but the truth is that it begins to decay rapidly above 4 processors and so the version which is supposed to work with more than 4 processors is rare and not commonly available. Mindcraft would do well to throw Solaris into this comparison, but they won't do that because NT would get it's clock cleaned.
Muslim community leaders warn of backlash from tomorrow morning's terrorist attack.
I agree their methods and configuration must be questioned. In defense of Linux this month's Microsoft Certified Professional Magazine has a focus on Linux/Samba and NT (Front Cover). The person who wrote the artice works for SGI and is on the Samba Programming Team - All this in a PRO-Microsoft Mag. He even states that in their tests that NT 4.0 is faster when serving UP 16 Client requests but under HIGHER LOADS Samba/Linux performs better. THIS WAS IN BLACK and WHITE.
...Only on a lightly loaded server, with 1 or 16 test systems, does Linux/Samba outperform Windows NT Server and then by only 26%....
Another thing about Mindcraft's testing was
This is contrary to Statements made in the May MCP Magizine. I find that they both have their strengths and as a MCSE have seen NT systems that are properly configured perform their server duties well (with careful observation and maintenance). I have also seen Solaris/Linux/AIX all perform as well as or better in the same environments as NT.
Just 2 Cents from yet ANOTHER MCSE & LINUX User (Bet you don't see that everyday...)
Please submit any inconsistancies you see in this document (and if you don't see any, please shoot yourself in the head) to lwn@lwn.net. They are readying a response as we speak.