Slashdot Mirror


Benchmark Software For Windows 7 Rollout?

tdisalvo writes "We are doing a Windows 7 rollout and I will have to compare major PC vendors. I am looking for vendor-neutral tests that will give me the data I need to present an educated opinion to my CIO. Clear, pretty charts are nice since it is for C level execs, and we need to make it understandable for nontechnical as well as technical people. More specifically, I am looking for something that will clearly show how the same processor performs (better or worse) with a particular build, motherboard, RAM, power supply, etc. My plan is to get very similar machines from major vendors and see which one's build has the highest independent benchmarks. Something with which I could test multiple computers and report on the differences in score would be ideal." As usual, free is an advantage.

23 of 215 comments (clear)

  1. My question is... by Knara · · Score: 4, Insightful

    Is this really necessary for a Windows 7 rollout with corporate desktops? Most machines are already overpowered for the average user using Office and what not.

    I'd think the cost per machine for good 3-4 year warranties would be more important. At least, it has been in my experience.

    I could see doing something like this just for developer machines, but general roll-out? I dunno. Seems like you'd just compare pricing and go with the one that makes the most budget sense.

    1. Re:My question is... by Anonymous Coward · · Score: 1, Insightful

      Exactly, those benchmarks will mean diddly squat as users load their crap-ware.
      I totally get this for server infrastructure, but desktop benchmarks? parent poster is right: warranty duration, coverate, and MTBF are more important.

    2. Re:My question is... by palegray.net · · Score: 4, Insightful

      I almost completely agree, with a couple of additions. When comparing pricing, it's important to consider what kind warranties and/or service and support arrangements are included with each build, especially if you're pricing out a large deployment. Looking for independent reliability reports isn't a bad idea, either.

    3. Re:My question is... by nmb3000 · · Score: 3, Insightful

      This is exactly it. Our department typically buys Dell Optiplex (business class) machines with the cheapest processor and a minimal amount of memory (around 2GB lately). Combined with a 5-year NBD warranty and we have a machine that is a perfectly capable office machine for 5 years.

      Who cares if Vendor A's machine performs 5% better than Vendor B at the same price? That analysis is a waste of time -- you'd be better off spending it researching reliability and compatibility. Any more a modern computer's hardware will fail before the system becomes too underpowered to be useful.

      --
      "What do you despise? By this are you truly known." --Princess Irulan, Manual of Muad'Dib
      /)
    4. Re:My question is... by Real1tyCzech · · Score: 4, Insightful

      "that sucks up effects like made"

      I think I am beginning to see a common denominator between all the Win7 haters here...

      FYI, rob: I have 2 laptops running Windows 7 at home that both have 1GB of RAM. They both boot in under 30 seconds and run Aero just fine. In fact, I almost think it helps that the hardware is older, thus I don't have to deal with the 85+GB drivers, just the basic one's that ship and update with 7. Sure, they won't break any records (the youngest one is 4 years old), but for netflix, Office, and Pandora, they both work beautifully...

    5. Re:My question is... by Jaime2 · · Score: 2, Insightful

      I agree with everything except the warranty. A home user should get a warranty, but medium to large corporatations should buy reliable computers and deal with failure themselves. Buying one spare for every ten computers costs far less than a warranty on all of the computers an gives you immediate repacement instead of one day. The pulled computers can be refurbed at your liesure. A typical failure will be a hard drive, power supply, or maybe RAM. That's less than a hundred bucks in parts. The labor is usually about the same because a corporate tech usually has to let the Dell guy in, walk him to the site, and then install all the custom stuff after he leaves.

    6. Re:My question is... by pandaman9000 · · Score: 2, Insightful

      Win 7 will -operate- with 1 GB RAM.... sure. The difference between 1,2, and 4 GB is in number of open apps and speed of opening/navigation. Windows prefetching will not perform well on a 1GB system, and may actually disable itself, as will most of the efficient caching systems that allow multiple windows to run fairly fluidly. Firefox without prefetch can take 10 seconds to open. With prefetch it is near instantaneous. Corporate users are real negative towards IT departments that do costly upgrades, with no real improvement in performance or usability.

      Memory is cheap, and is the single most performance improving/reducing hardware choice for a corporate desktop at this time.

      TL;DR version- You are wrong.

    7. Re:My question is... by Anonymous Coward · · Score: 1, Insightful

      I think it would also be worth considering the power consumption/performance ratio - particularly if this is a large deployment - there is the possibility of saving a considerable sum going forward if you look after this.

    8. Re:My question is... by srothroc · · Score: 2, Insightful

      It's easy enough to say "might as well" when you're an individual user talking about $75, but if you're attempting to justify the purchase and deployment of, say, 1000 computers, that "might as well" costs $75,000 and isn't such a little sum anymore. You need to back it up with data showing that the additional outlay would be justified by a return in performance.

    9. Re:My question is... by afidel · · Score: 3, Insightful

      When you are talking about a rollout that will end up costing ~$1-1.5M then $75k isn't such a big deal, especially if it makes people more productive. Think about it this way, the job of IT is to make peoples job more efficient and $75k is only one FTE, if a trippled ram upgrade can't wring out .1% more efficiency then your organization has other issues because that should be a significant boost to productivity.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    10. Re:My question is... by jimicus · · Score: 3, Insightful

      If you're in a company with enough staff to merit an IT department and you don't have your spares pre-built with the corporate image and an internal update server so it can download the latest updates at LAN speeds, you are very definitely Doing It Wrong.

  2. Synthetic Benchmarks are Bullshit by Anonymous Coward · · Score: 2, Insightful

    You haven't said what you actually do with these computers. The relevant benchmarks should look like your actual workflow, otherwise you are just drag racing.

  3. Authority by White+Flame · · Score: 5, Insightful

    Questions:
    A. Do have the authority to make the decision?
    B. Are you tasked with giving him your "expert opinion" on the matter?
    C. Are you tasked to actually educate him enough about a technical decision that he has no technical skills to currently evaluate an answer?

    Answers:
    A. Evaluate on the specs you know are important on the job, give him a specific brand, and say "trust me, buy these"
    B. Evaluate on the specs you know are important on the job, give him a specific brand, and say "trust me, buy these"
    C. You're boned.

  4. The Real Question is by imemyself · · Score: 4, Insightful

    Why should C-level execs care about what model processor is used in their computers? Office users aren't looking for the absolute greatest performance, they're looking for reliability, manageability, and cost. I can guarantee that no typical* medium or large size business will make a decision on which vendor to use for office computers based on the performance benchmarks. Frankly, who gives a shit about the motherboard in a typical office user's computer. It doesn't matter, certainly not to upper management. Choose something that has a reasonable cost, a solid long term support contract, and is easy to manage in your existing environment. If anything, the support contract, expandability (adding dual monitors later, or adding more memory for heavy data analysts or future software upgrades), and the existing vendor relationships are far more important than performance benchmarks. *Assuming they're not using them to render lots of graphics or do other very specific, specialized tasks.

    --
    Every time you post an article on Slashdot, I kill a server. Think of the servers!
  5. Barking up the wrong tree by whomeyup · · Score: 5, Insightful

    Performance? Really? Personally I'd want stability, reliability, and top notch support. Your average computer user loses far more productivity from downtime due to cheap hardware dying, unstable drivers, etc than to their machine starting (insert app of your choice) .2 seconds slower. I want to be able to order an exact replacement 2 years down the road if a machine dies. I want replacement parts available for the forseeable lifetime of the machines on which I standardize.

  6. You forgot to mention .... by Anonymous Coward · · Score: 1, Insightful

    You forgot to mention what kind of workload you're needing the machines for. A machine used for CAD or FEM used in construction or achitecture will have very different requirements from a database-heavy stand-alone machine that might get used for human resources or controlling.

    What business are you in?

    That said, for most applications or average office users, terminal services plus thin clients are the way to go. It may look similarily expensive compared to individual PCs at the first look but if you have/are a capable Windows admin, your business is gonna save hugely on deployment and management costs.

    That's the number you want to present to your CIO.

  7. Last we did a competitive evaluation... by fuzzyfuzzyfungus · · Score: 4, Insightful

    Not only were the machines similar they were virtually identical. Unless you were looking at the case badge, or the PCI vendor strings, you would have been hard-pressed to tell which was which. Same intel silicon, very similar HDDs and optical drives(not that that really mattered, neither party was willing to quote anything other than a capacity, so the brands we got in the test boxes were assurances of nothing). The RAM was within spitting distance of one another and(again), the vendors would assure us of nothing other than "X capacity, verified compatible) so it wasn't as though the specifics of the test samples told us much.

    We ended up going with Dell, just because they were cheaper, their driver download pages are modestly less unpleasant, and their "ImageDirect" tool is actually pretty handy.

    Unless you have particular reason to believe otherwise, exhaustive benchmarking will be a waste of your, and the exec's time. The only exception that I can think of would be if you were advocating for something unusual but potentially interesting(ie. Most corporate desktops are brutally I/O bound, straining under the load of A/V, constant patches and updates, and so forth. SSDs would make them fly, comparatively. Particularly if your company actually has a lot of expensive people running around, a "number of minutes from cold boot to productivity" benchmark could be eye-opening.)

  8. Re:Multiple software produces the best result by Anonymous Coward · · Score: 5, Insightful

    What a waste of time and effort. Firstly some machines will perform better on some benchmarks than others. Secondly there are costs, availability, configuration, reliability and many other factors to evaluate. Its hard to believe you are going to look at a few percent performance differences (if that much). After all, PCs are practically the definition of a commodity market. You might be better off picking the machines with the best paint jobs. You ought to get a job at the Pentagon where they specialize in meaningless power point slides.

  9. You won't like the answer. by golden.radish · · Score: 2, Insightful

    There's no business/office productivity software that requires Vista or Windows 7. In fact, I'm not aware of any software of any kind that REQUIRES Windows 7.

    You can run everything on XP.

    Now ask yourself: "Why are we spending -any- money on upgrades?"

    Two paths from this point.

    1) Slap yourself, rebuild your corporate image with a nice current minimal build and give users the option to rebuild their machines with said image dynamically, at boot time. This will produce vastly greater productivity than any attempt to upgrade.

    OR

    2) Continue on your current path to justify your continued employment and claim Windows 7 is necessary and the upgrade is "a must have" to remain competitive.

    In no test, on the same hardware, will you see any performance increases, by any time based measurement when comparing Windows XP SP3 vs. Windows 7. Windows 7 will always be slower. Boot time, shutdown time, application launch time, or install time. All slower. And you don't have to take my word for it, break out your stopwatch, you can see it for yourself.

    1. Re:You won't like the answer. by smash · · Score: 2, Insightful

      A few reasons why you should go Win7

      • Windows XP SP3 support from microsoft ends in mid 2011
      • Branchcache
      • DirectAccess
      • Powershell 2.0 and WinRM on all your desktops as standard
      • You can bet your arse that future MS offerings will not support Windows XP

      If you have hardware that was even half reasonably specc'd in the past 3 years, Windows 7 is fine. And it is not always slower than XP. Try doing a search through your email in XP vs Win7 (you know, something that actually MATTERS in reality) and compare.

      --
      I run: Windows, OS X, Linux, FreeBSD. Just because you have a hammer, doesn't mean everything is a nail.
  10. Re:Multiple software produces the best result by jayhawk88 · · Score: 4, Insightful

    Yeah I have to agree with this, came here to say the same thing. Benchmarks have their uses, but chances are the real world difference between similarly-built machines is not going to be significant. Let's be honest here: Unless you're doing a roll-out to a bunch of coders or CIA Photoshop experts, chances are most of these PC's are going to be running a web browser, a groupware client, and a document/spreadsheet editor like 75% of the time.

    Choosing a PC vendor based on price, reliability, and service is going to be far more useful and have a far greater RIO than picking the one that scored 5 points higher on 3DMark or whatever. There have to be much better uses of your time.

  11. I hope you're not a manager... by vinn · · Score: 2, Insightful

    I hope you were merely tasked with finding benchmarks and that you're just a tech. If your CIO tasked you with picking the next platform and you decided to perform technical benchmarks, then you really missed the boat.

    1. First, you need to be analyzing support you'll get. Don't get too hung up on it, but you need something better than a 90-day warranty. There are diminishing returns though, at some point it's not worth getting a 3 year or 4 year contract.

    2. Next, you need a vendor that will help you with license management. Being able to audit your licenses for Office or Symantec or whatever quickly will help you. If you don't have volume licensing, now is the time your vendor should be helping you with it.

    3. Usability matters a lot, but what matters almost as much is how cool your laptops are. When your marketing director, you know, the one that always wears cool clothes and would have to have his iPhone pried out of his cold dead hands, goes to a conference you better make sure he has the coolest laptop of any of the other marketing geeks. A lot of companies overlook this, but I guarantee you he doesn't want to be carrying around a Latitude E6510 clunker.

    4. There's a nice price point right now around $1000 for decent corporate laptops and you'll get about 3 years out of them.

    5. You need to be negotiating with your sales rep hard if you're making a purchase like this. Your rep isn't going to be able to make huge discounts on laptops like they can on server equipment or some software licenses, so see if you can get some killer pricing on servers while you're shopping for a big laptop package.

    Skip the benchmarks, it's not worth your time. Anything you teach your boss about Core duo, i5, etc will be useless knowledge for him in six months when Intel introduces some new spec.

    --
    ----- obSig
  12. missing the point, imho by smash · · Score: 2, Insightful

    Performance benchmarks for typical desktop office machines are pointless. What is FAR more important is: driver stability/support and vendor support in the case of hardware malfunction. So long as your desktops have > 1gb ram they will be fine for 7, for normal office use.

    We're currently a dell shop (sigh), my baseline cut-off for Dell laptops is Latitude D510 with 1GB ram for Win7 pro x86. Desktop machines - anything with similar spec to that is fine for x86.

    --
    I run: Windows, OS X, Linux, FreeBSD. Just because you have a hammer, doesn't mean everything is a nail.