Slashdot Mirror


Ask Slashdot: Should CPU, GPU Name-Numbering Indicate Real World Performance?

dryriver writes: Anyone who has built a PC in recent years knows how confusing the letters and numbers that trail modern CPU and GPU names can be because they do not necessarily tell you how fast one electronic part is compared to another electronic part. A Zoomdaahl Core C-5 7780 is not necessarily faster than a Boomberg ElectronRipper V-6 6220 -- the number at the end, unlike a GFLOPS or TFLOPS number for example, tells you very little about the real-world performance of the part. It is not easy to create one unified, standardized performance benchmark that could change this. One part may be great for 3D gaming, a competing part may smoke the first part in a database server application, and a third part may compress 4K HEVC video 11% faster. So creating something like, say, a Standardized Real-World Application Performance Score (SRWAPS) and putting that score next to the part name, letters, or series number will probably never happen. A lot of competing companies would have to agree to a particular type of benchmark, make sure all benchmarking is done fairly and accurately, and so on and so forth.

But how are the average consumers just trying to buy the right home laptop or gaming PC for their kids supposed to cope with the "letters and numbers salad" that follows CPU, GPU and other computer part names? If you are computer literate, you can dive right into the different performance benchmarks for a certain part on a typical tech site that benchmarks parts. But what if you are "Computer Buyer Joe" or "Jane Average" and you just want to glean quickly which two products -- two budget priced laptops listed on Amazon.com for example -- have the better performance overall? Is there no way to create some kind of rough numeric indicator of real-world performance and put it into a product's specs for quick comparison?

26 of 184 comments (clear)

  1. What's "real world performance"? by imgod2u · · Score: 5, Insightful

    As soon as someone gives me a definitive definition of what "real world performance" for a CPU/GPU is that doesn't change over time/software-version/user-care-ometer is, I might agree that it's feasible to use it to name models.

    1. Re:What's "real world performance"? by cheesybagel · · Score: 3, Informative

      Someone created such a system once. It was called the "PR" or Performance Rating. It was used by AMD and Cyrix at a time when they had processors with different MIPS/Hz than Intel. The thing is, the benchmark was mostly integer based, so when games like Quake came out, which used the Intel Pentium's pipelined FPU, which the other manufacturer's processors didn't have, the PR kind fell by the wayside.

    2. Re:What's "real world performance"? by jellomizer · · Score: 2

      Exactly. Normally hardware makers don't make their top of the line products suck. But they may make different design decisions.
      GPU A may be able to dump out billions more polygons per second then GPU B. But GPU B does more advanced coloring and edge rounding and environmental effects. So GPU A may work better on a higher resolution screen, but on normal resolution screens GPU B gives better results.

      Back in the 1990's The key indicator was the Megahertz, So people normally would opt for the 386 25mhz computer over the more expensive 486 25mhz (especially being DOS and windows 3.1 barely supported 32bit support at the time the difference between the two chips were not noticeable)
      Or between the 486DX 66Mhz and the Pentium 66mhz or the Pentium 200mhz vs the Pentium Pro 200Mhz.

      PC owners were laughing at Apple owners because while their PC's with Pentium 3 were running in the Gigahertz range, The Apple Power PC were only around the 600mhz range.
      However this is also the point of the problem, Unlike comparing x86 chips with other x86 chips where mhz is a major factor, Comparing different design approaches to chips became much harder. A RISC Chip can perform more operations per mhz then a CISC chip can on average. However a CISC instruction often can do more then an RISC instruction. So the Apple PC of the time was able to crunch a complex Photoshop job faster then a compatible PC. However that PC may crunch a spread sheet much faster.

      I know as consumers we want to pick our products on a nice linear line of bad and cheap to best and expensive. But in real life there are more dimensions . If you are making a killer Gaming PC, then the questions is what games do you want to play? Which aspects in these games are important to your gaming. What other hardware are you expecting to be using on it?

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
  2. Passmark by darkain · · Score: 4, Informative

    Passmark. You're welcome. https://www.passmark.com/

    1. Re:Passmark by war4peace · · Score: 4, Informative

      That's useful AFTER you bought the machine.
      What's useful BEFORE you buy the machine? Simple: CPUBoss and GPUBoss.
      http://cpuboss.com/compare-cpu...
      http://gpuboss.com/compare-gpu...

      --
      ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)
    2. Re:Passmark by jma05 · · Score: 3, Informative
  3. Define 'real world performance' by Rick+Schumann · · Score: 4, Insightful

    'Real world performance' according to who or what, precisely?
    Clock speed doesn't tell you the whole story and to the vast majority of people (read as: non-technical people) it wouldn't mean anything to them anyway, other than maybe one number is bigger than another number.
    Same goes for so-called 'benchmark' test suites, which I think can be argued as being biased in one way or another (or a processor gaming the system to make it appear it's faster on such-and-such benchmark test).
    I think that for the people such information matters to, they're going to already know what's what without anyone spelling it out for them.

  4. Exactly. Stupid idea for many reasons. by thesupraman · · Score: 2

    What exact 'performance' figure does dryriver suggest?
    Raw GIPS/TFLOPS? pretty much meaningless and very easy to get an achievable peak number.
    SPECINT/SPECFP? with what OS, compiler, flags, version, etc?

    Anyone who knows much about cpu/gpu performance knows why this is a very very very silly 'suggestion'. It would be not more meaningful than the numbers they assign now.

    The complain should be with the manufacturers - please come up with more sensible naming practices, but in the end, thats their decision.

    Marketing is what is being questioned here - nothing technical - and good luck with that..
    Market separation/obfuscation through complex naming schemes is seen as a feature by manufacturers, not a problem..

    1. Re:Exactly. Stupid idea for many reasons. by Rick+Schumann · · Score: 4, Insightful

      Even then what's being asked here is like asking which power supply will make your computer faster; it makes no sense. You could have the hottest-shit-fast CPU available, and since you're booting it off a cheap USB 2 flash drive and a USB 2 video adapter, the performance will suck. Then you put it side-by-side with the cheapest shittiest CPU you can find, but with the best x16 PCIe graphics card and a top of the line SATA SSD, and it kicks the other systems' ass.

    2. Re:Exactly. Stupid idea for many reasons. by MoralCharacter · · Score: 2

      It's likely impossible to walk into a Best Buy or Fry's Electronics and purchase any off the shelf computer that is incapable of meeting the needs of 'joe or jane average'. They can all run a browser (meeting social media needs), they can all run the MS Office Suite (meeting productivity needs) and they are more than capable of running casual entertainment - movies, music, streaming media, and casual games. Even a chromebook can meet a users needs - Microsoft has had cloud versions of their productivity software available for several years now. Most other 'business' productivity tools are cloud apps as well, such as Slack, Basecamp, Trello etc People who have specific performance needs aren't a 'Joe or Jane average'. Gaming, Media production, engineering/scientific R&D, and so on are all niche requirements compared to the rest of the 'average' population. Other than those who need performance for their hobbies, most niche computer needs will be fulfilled by an IT employee or department (or a consultant) that is paid to find and purchase sufficient hardware to meet employee performance needs - and this is handled as a cost of doing business.

    3. Re:Exactly. Stupid idea for many reasons. by MoralCharacter · · Score: 2

      Some common ground numbers could be posted with PC specs though - boot times, average FPS in a current popular game, load time of MS Word, time to copy a large file... that probably covers most of the needs of a typical user.

    4. Re:Exactly. Stupid idea for many reasons. by another_twilight · · Score: 4, Insightful

      No, you dont need 850w for your single GPU PC

      True except for some edge cases.

      Its job is to turn on, not die, and when it does die, not take out everything else with it

      You missed "deliver power at the specified voltage and amperage, within tolerances, including not sagging, spiking or being 'noisy'". Bonus if it can do this for more than five years.

      It sounds like you've never had intermittent faults that turned out to be the fault of a cheap PSU aging _way_ too soon and far from gracefully.

      There are reasons some people insist that your PSU is (at least) as important as any other component, and it has nothing to do with 'bigger is better'.
      But hey, don't let your ignorance stop you 'shit[ting] on' someone else's.

    5. Re: Exactly. Stupid idea for many reasons. by J.+T.+MacLeod · · Score: 3, Insightful

      The PSU is very important, for all the reasons you say.

      But there is a culture that advocates much bigger and more expensive PSUs than required, and that is bleeding into the realm of casual PC builders.

  5. Same as cars by war4peace · · Score: 5, Insightful

    Cars are also complex, they don't have simple-to-understand names and variants and require you to document yourself and investigate for large amounts of time before committing to a purchase.

    Don't try to dumb down complex machinery. It will never work.

    --
    ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)
  6. Well, sure, but... by Radical+Moderate · · Score: 4, Insightful

    1. Like EPA fuel mileage tests, manufacturers will find ways to rig their chips so they benchmark better.
    2. Unlike the EPA/feds, there's nobody to punish corporations when they cheat.

    It's really not hard to do a little research to see how CPUs compare. Yes, it's a PIA if you're buying spur-of-the-moment and comparing laptops at the Big Box Store. But you need to do research. Hyperthreading and multiprocs will speed up some apps and do very little for others, some standardized benchmark number printed in the specs won't really tell consumers anything very useful. Too many variables and dependencies.

    --
    Never let a lack of data get in the way of a good rant.
  7. The shoe doesn't always fit by Nethemas+the+Great · · Score: 3, Insightful

    I'll try a novel analogy instead of the typical car thing. Imagine these chips (CPUs, GPUs, etc.) as shoes. Yes, shoes. Now there are obviously shoes of all kinds of sizes and types, and no one shoe of a certain size/type can be said to fit a particular person's requirements. Too big, too small. Great (9) for the red carpet runway, not so much (2) the tarmac kind. Perfect (10) for the alpine, chafing and sweaty (1) on the beach.

    User A does spreadsheets all day, B does FPS games, C does CAD, D AI research, etc.. Some require multi-threaded performance; some, single-threaded, etc. etc.. What might seem like a good performance for one use is weak for another. It's just not possible to come up with a workable single axis performance metric when performance is determined by multiple variables, each having their own weight depending upon the user.

    If you want to shop for kit that best fits your needs, you first need to come up with an understanding of the importance of each of the variables then go comparison shop the various benchmarks out there. As with most nearly everything it's best to just ignore the marketing speech and go do your own research.

    --
    Two of my imaginary friends reproduced once ... with negative results.
  8. The obfuscation goes back at least to the Core 2 by SIGBUS · · Score: 2

    I got bitten by Intel Obfuscation Syndrome when I bought a Core 2 Quad Q8200, not realizing that it was the only one of the Core 2 Quads to not have virtualization. Yeah, I should have looked before I leaped. In the end, it was a bad buy all around, as the DG43NB motherboard I bought to go with it also ended up crapping out in a surprisingly short time, but lasting long enough to be out of warranty. Needless to say, all of my later builds have been AMD (with various makes of motherboards).

    --
    Oh, no! You have walked into the slavering fangs of a lurking grue!
  9. market solution by PopeRatzo · · Score: 4, Funny

    But what if you are "Computer Buyer Joe"

    As "Computer Buyer Joe", I have found that the best approach is to get my computer nerd nephew to hook me up with the good shit. I tell him how much I can spend and which games I want to play and he does the rest. Then, I throw him $50, which he immediately spends on oxycontin or rap records or whatever it is that kids spend money on these days.

    --
    You are welcome on my lawn.
  10. Already Done by dohzer · · Score: 5, Insightful

    They already do this. Always look for the standardised number following the dollar sign.

  11. Educate yourself by InfiniteBlaze · · Score: 2

    I can dive right into the numbers because I've been immersed in tech for 25 years. Put in the time to learn it or lean on someone who already has and compensate them fairly. If it's a friend or family member, do them a favor; if not, then buy the parts from whoever you talk to, or compensate them monetarily. You can't trivialize this...you can't boil it down to some simple number to describe all types of components.

  12. Not real performance, but product differences by Anonymous Coward · · Score: 2, Interesting

    I don't think the name needs to denote real performance numbers. However, it ABSOLUTELY SHOULD denote different products which HAVE PERFORMANCE DIFFERENCES! Case and point, AMD first released a RX560 which was benchmarked and reviewed by all the media/press which used 1024 Stream Processors and 16 compute units. A few weeks/months later, AMD quietly released a new version, still calling it the RX560 (with no other indication of a change and no announcement of a change), and instead having 896 Stream Processors and 14 compute units. Nothing indicates the difference between the two versions, but one version is absolutely less powerful than the other. Nvidia is now essentially doing a similar thing with the MX150, releasing a new version that uses less power, and runs with a 36% slower base clock speed, 32% slower boost clock speed, and 17% slower memory clock speed. Benchmarks are showing it having about a 20-25% slower performance as a result. Yet, it is still called MX150, and will be advertised as such when people go and look at the part.
     
    In both these cases, they should be clearly renamed a different product, denoting the actual product, which you can then get clear idea of the performance of the product based on reviews and benchmarks.

  13. Price == performance by petes_PoV · · Score: 4, Insightful

    But how are the average consumers just trying to buy the right home laptop or gaming PC for their kids supposed to cope

    They don't need to. The average user will have their needs met by any computer built in the past 10 years.

    if you want high-end or specialised stuff, just let the price guide you. The more expensive (so long as you don't get suckered into paying a brand premium) a generic computer is, the better it will perform.

    Most people buy to a budget, anyway - not to a specification. That is why the first question a sales-droid will ask you is "how much do you have to spend?".

    --
    politicians are like babies' nappies: they should both be changed regularly and for the same reasons
  14. It already exists, ... to a point by stikves · · Score: 2

    The model names are mostly standardized now, even across different manufacturers.

    Intel has, for example Core i7-4790K, and Core i7-8700K. AMD would have Ryzen 2950x, and nVidia would have GTX 1070 Ti. There is a similar pattern in all of them.

    Intel (desktop) chips read like 4-7-90-K, 4th generation, i7, last iteration (highest performance variant), unlocked (non-K versions are not enabled for overclocking). Then 8-7-00-K would be 8th generation, i7, first iteration.

    AMD copied this to an extend. 2-9-50X would ve second generation Ryzen, i9 counterpart, mid-level, but -X suffix seem to mean slightly improved performance (all AMD chips were unlocked for overclocking).

    nVidia is similar 970 would be 9th generation GTX, second highest level (geared towards gamers with mid-to-large budgets), while 10-80 Ti would be 10th generation GTX, highest level (geared towards people with serious money), and updated (Ti) edition.

    In general, generation increases add significant power reduction, allowing less running cost, and higher performance for the same price. In fact a future i3 might be better than a previous i5.

    (I'm skipping Pentium/Celeron which are lower binned silicones of the same design, and Atoms, and of course Xeon server and workstation chips).

    Looking at Wikipedia for the CPU/GPU generation gives sufficient detail for differences between offerings. If I'm planning to purchase a CPU to use for many years, I would benefit spending some time understanding those differences.

  15. Pretty sure the model numbers are not arbitrary by n3r0.m4dski11z · · Score: 2

    https://en.wikipedia.org/wiki/...
    A table like the above, will explain the breakdown of the numbering. It hasn't changed much with each generation since the core series lineup came in 10 years ago.
    Here is a better breakdown with more words than numbers. https://www.intel.com/content/...

    But perhaps youre a casual and that's all a bit too esoteric for you?

    If you want to easy it up, just go to www.cpubenchmark.net and you can easily compare all cpus and pricepoints. Look at single thread performance if that's all your application can handle (or you are a gamer..), and total performance if its multithreaded. There is a wealth of user submitted data there that i would never view processor advertisements without.

    Its really not something you need to spend more than an afternoon getting acquainted with. An exercise that anyone who wants to spend $500+ on a new PC should be more than willing to do. As others have said, basic research is important when buying most things.

    --
    -
  16. Just make the model numbers unique by Gadget_Guy · · Score: 2

    This is not specific to CPUs and GPUs, but I am sick of model names/numbers being reused for different products. I was browsing Dell's website recently and found it frustrating to find that the Inspiron 3000 series comes in 15" and New 15" varieties. The 15" variety could use either a Celeron or Pentium processor, while the New 15" ones could be either 7th or 8th generation i3, i5 or i7. Why have three 0s in the number if you are never going to change any of those digits?

    And don't get me started on the Inspiron 5000 15" and New 15" range or the Inspiron 7000 15" (but no New 15") range. There is also the Nvidia GTX1060, which comes in two varieties that performs differently.

  17. No. Just no. by Opportunist · · Score: 2

    It's already bad enough that hardware manufacturers tweak and skew their drivers to eke out another dot at some artificial benchmark program, I don't want them to actually produce their hardware to fit an arbitrary metric that has nothing to do with real world problems because they have to since some illiterates want to compare numbers instead of finding out what they mean.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.