Slashdot Mirror


More 'Application-Specific' Optimizations in NVidia Drivers

EconolineCrush writes "Futuremark and NVIDIA have been embroiled in a spat over various cheat/optimizations in 3DMark03 for several weeks now. Last week, the soap opera appeared to be over; Futuremark and NVIDIA released a joint statement in which Futuremark clarified that NVIDIA was optimizing its drivers for 3DMark03 rather than cheating. This story, however, appears to be far from over. Tech Report has uncovered a new series of optimizations in NVIDIA's Detonator FX drivers that affect image quality in even Futuremark's latest 3DMark03 build. What's more, if you rename the 3DMark03 executable, the optimizations disappear."

15 of 361 comments (clear)

  1. and they all told me I was crazy.... by sweeney37 · · Score: 5, Funny

    well luckily for me I've renamed all my executables files 3DMark03.exe for some time now.

    Mike

  2. It's the reviewers' fault by 91degrees · · Score: 5, Insightful

    They always use the 3DMark results as though it's some sort of holy scripture, and as though a benchmark can indicate how well it will work in a real everyday situation. Every industry optimises for benchmarks. From a marketing point of view, it's insane not to.

    The only reliable way to test is by testing it withthe applications it's used for. Get some actual games, and see what the frame rate is. If they optimise for those tests then it doesn't matter! It means they're oiptmised for real world situations.

    1. Re:It's the reviewers' fault by DrXym · · Score: 5, Insightful
      By all means, hardware vendors should use benchmarks and games to optimise performance. A well designed benchmark will exercise a driver in a controlled manner in a way it will be typically in real life and thus is a good way to improve real world performance.


      But this is not optimising, it's deliberately cheating. That's what it's called when you ignore the settings you were told to use and substitute in your own faster ones, simply because you know you're running a benchmark programme used by consumers and reviewers to determine performance. Cheating may not a strong enough word - this almost amounts to fraud, claiming one thing and delivering another.

  3. High or low level strategy? by MattGrounds · · Score: 5, Interesting
    What I'm interested in is:

    a) Is this indicative of a high level strategy by NVidia's management, who's marketing department is pressuring them to have higher 3DMark2003 scores than ATI?

    OR

    b) Has some low level device driver programmer (intern?) looked to get some easy brownie points by "optimising" the drivers for 3dMark2003 in a slightly clunky way?

    Either is quite interesting :) I've been a victim/perpetrator of both in the past.

    1. Re:High or low level strategy? by somberlain · · Score: 5, Informative

      Well... All I know is, that a lot of companies do this... This is also the case for CD-R/RW-writers. When using tools like Nero CD-Speed etc, this problem is always solved by 'cheating' on the program. Been there for a while in this sector of hardware testing...

    2. Re:High or low level strategy? by BigFootApe · · Score: 5, Interesting

      a) Is this indicative of a high level strategy by NVidia's management, who's marketing department is pressuring them to have higher 3DMark2003 scores than ATI?

      Of course it is. Fudging the drivers for a synthetic benchmark are a time honored way to make crappy hardware look good.

  4. Make NVIDIA drivers Open Source! by Lieutenant_Dan · · Score: 5, Interesting

    If we could have the Open Source developer community review and improve these drivers we would not encounter any problems with them. The experience and integrity of the Open Source developer community would be vital for the consumer to take Nvidia cards seriously in the market.

    Benchmarks would reflect the actual performance of the card instead of skewing the results in order to garner favorable reviews.

    Only when we allow Nvidia to see the benefits of Open Source can we free the graphic benchmark software from the clutches of Matrox.

    --
    Wearing pants should always be optional.
    1. Re:Make NVIDIA drivers Open Source! by iainl · · Score: 5, Informative

      Lovely idea in theory.

      In practice, nVidia have made it painfully aware on numerous occasions that they CANNOT do this. Its not just them being nasty closed-source meanies. The driver binaries contain licensed tech from numerous third parties that their license doesn't let them reveal the source to.

      --
      "I Know You Are But What Am I?"
  5. Renaming by jabbadabbadoo · · Score: 5, Funny

    I tried various tricks too. Oddly, renaming it to Outlook.exe made it crash.

    1. Re:Renaming by crawling_chaos · · Score: 5, Funny
      Oddly, renaming it to Outlook.exe made it crash

      It also sent an e-mail with "I Love You" in the subject to all of your contacts. I wonder if the reason for delays on the FX card was that they'd renamed the burn-in application DukeNukemForeever.exe?

      Thank you, thank you. I'll be here all week.

      --
      You can only drink 30 or 40 glasses of beer a day, no matter how rich you are.
      -- Colonel Adolphus Busch
  6. I will take a wait and see attitude. by Prince_Ali · · Score: 5, Insightful

    You can't trust results for older games, and you can't trust benchmarks evidenlty. I think the best thing is just to wait for the new generation of games which will surely clear things up.
    It doesn't make sense to buy a card to run Doom 3 when the game isn't out. Here is a clue, when Doom 3 does come out I will be able to buy something as powerful as the FX 5900 for $150.
    I'm going to go into an offtopic rant now. It is sad that we have huge displays and crazy-go-nuts graphics processors on computers, but consoles will probably always beat PCs for game size. Game makers are too scared to release a DVD only game, so our games are limited to 700MB by disk, and don't even get me started on controllers.

  7. Shades of 3DFX in nVidia by saden1 · · Score: 5, Interesting

    If nVidia continues to have these bulky video cards which take two PCI slots and make noise like a whale they just might go by the way side just like 3DFX.

    nVidia is walking a tight rope and for the first time in six years I'm actually going to consider buying an ATI. Come September 30th there is 90% chance that I'll have an ATI card on my machine.

    --

    -----
    One is born into aristocracy, but mediocrity can only be achieved through hard work.
  8. Re:So What? Who Cares? by confused+one · · Score: 5, Insightful
    Uh, no. The mass market will buy the box with the prettier logo, The box with the lower price, or the box that magazine xyz (that they read) says is best.

    Sad, but true.

    Most people will shop around, to make sure the features they're looking for are simply there and work. Beyond that, they don't do the research to understand which version is better unless they're forced to.

  9. Re:Who cares about benchmark software? by Tipsy+McStagger · · Score: 5, Informative

    the q3 physics when jumping works best with fps's where the rounding errors in calculating the path through discrete points are maximised.

    43 76 & 125 all produce similar results.

    http://ucguides.savagehelp.com/Quake3/FAQFPSJump s. html

  10. Re:So What? Who Cares? by Slack-Jawed+Local · · Score: 5, Insightful

    Absolutely! I can't believe that some people are saying this isn't cheating!! Here's the deal, prior to any optimisation/cheating... App programmer tells card to render something -> Card renders it the way app programmer tells it to -> User sees what app programmer intended. After optimisation... App programmer tells card to render something -> Card renders it the way app programmer tells it to, but faster -> User sees what app programmer intended. After cheating... Programmer tells card to render something -> Driver programmer decides that, actually app programmer doesn't know what he/she is talking about and shouldn't have told it to render the thing that way and that they know a much better way to render it -> Card renders it the way the driver programmer tells it to, which (surprise!) is faster -> User sees what driver programmer intended. The point is that what the app programmer and driver programmer intended are different things. This, in itself is not a cheat. The cheat comes in when the driver programmer doesn't tell people about the change and instead let's people think that a difference in FPS between competitor cards is because of differences in power, rather than differences in what they are trying to render. It's a matter of trust that graphics cards render things the way the app tells them to. To do otherwise is cheating. Plain and simple.