Intel Mac Performance Behind Hype
Barry Norton writes "Steve Jobs, at the MacWorld tradeshow, boasted: 'the new iMac [with] Intel processor is two to three times faster than the iMac G5.' MacWorld (the publication) has been putting the iMacs through their paces. The results are a good deal less impressive than Steve's boast, showing an average performance increase of 10 to 25 per cent while performing a series of everyday tasks with software specially designed for the new systems." Ars Technica had another perspective on the new systems earlier this week.
Company performs benchmarks to show product in best light!
From http://www.apple.com/imac/intelcoreduo.html:
2. Testing conducted by Apple in December 2005 using preproduction 20-inch iMac units with 2GHz Intel Core Duo; all other systems were shipping units. All scores are estimated.SPEC is a registered trademark of the Standard Performance Evaluation Corporation (SPEC); see www.spec.org for more information. Benchmarks were compiled using the IBM compiler and a beta version of the Intel compiler for Mac OS.
3. Testing conducted by Apple in December 2005 using preproduction 20-inch iMac units with 2GHz Intel Core Duo; all other systems were shipping units. All of the iMac and iMac G5 systems ran beta Universal version of Modo. All other applications were beta versions.
And since actual application performance has been subjective since the dawn of time, how is this surprising?
I mean, we're talking about a company that said no one wanted flash players until they made one, that no one wanted to watch video on an iPod until they made an iPod that played video, and that said all x86 architecture and CISC processors sucked until they switched to them.
And you know what? All of the above statements had significant elements of truth to them. Apple is doing nothing more than showing its products, accurately insofar as it goes, in the best possible light. Is this the least bit stunning?
What compiler does Apple use? As they are starting from scratch, they should be able to optimise for this specific chip without taking backward compatibility into account...
10 ?"Hello World" life was simple then
Steve Jobs said that he was talking about the processors being faster...and he specifically said not everything is going to be faster like the hard drives and memory etc etc. Just the processors which is why he showed the SPECmarks or whatever this phantom benchmark that, to my knowledge, isn't a free download from anywhere. Or was I the only one that heard him prefacing the results?
Oh well, let the Mac bashing continue, blood is in the water.
"Leo Fender was in a 'state of grace' when he designed the Stratocaster." -- Paul Reed Smith
Despite the switch to Intel CPUs, the time honored tradition of "Apple benchmarks" continues :)
Steve Jobs was reporting improvments in CPU benchmarks, but the article refers to application benchmarks.
The CPU is going to be doing different things from those benchmarks in those applications- and may not even be the bottleneck in any given "real world" task.
Now whether Steve should have demonstrated "real world" improvements is up for debate, but all he presented were CPU benchmarks. He made no claim about application performance.
Lots of people here have run Linux or a Unix variant on very similar hardware. Surely they knew already the kind of performance they would get out of it, since OS X is basically unix under the covers. I don't think this should really be a surprise to many.
Apparently nobody watched the Keynote, in which Steve himself said that other components (hard disk, memory, etc) were not faster, so the overall experience would not be as fast as the 2-3x numbers he posted. Based on the specInt numbers he shows, sure, it's a 2-3 times improvement, but even he caveated it!
If this were digg I'd call for a "No digg!" right about now.
--- witty signature
But what was more significant was his frank acknowledgement that Photoshop operating via Rosetta wasn't going to be usable by professionals. The people jumping on the accusation of hype bandwagon need to take those comments into consideration. It's not often that on a new product rollout something is said that directly translates into "Hey, don't go out and buy this right now."
it should be noted that these are all single-threaded benchmarks so the second core doesn't help that much.
it should be interesting how these machines compare doing more things at once or running multi-threaded tasks.
Yes, Mac users have a well-deserved reputation for being fanatical (and sometimes even for good reason). But then along comes a story like this one that smears Apple for no particularly good reason and without much of an argument, and you have to ask yourself WTF.
Um, it's pretty safe to say that even in pure cpu performance the intel processor is NOT 2-3x faster then the G5's overall.
Steve probably just showed just one category of a processor benchmark where intel exceeded it and probably played around a bit more with it to make it look better.
Hmmm... Pie...
Steve Jobs during the keynote at MacExpo when presenting Photoshop running on Rosetta:
Speed is a marketing issue. Real world performance not surprisingly lower.
memomo: free web based language trainer DE-EN-ES-FR-IT
You do realize there is a *reason* no one has tried such, right?
Integrate Keynote and LaTeX
And even though Mac carried on a subversion PC program for a while, they stopped a while ago. As the OS changed, the code changed, and they had to start all over.
Somehow, I can't help but feel this article is encouraging Microsoft-fanboy flaming.
Let's reserve judgement for "Mac Pro" (that is, the pro level desktop machine) when it comes out. There will be no excuses at all if that machine does not kick serious ass.
Benchmarks are always hyped by a company. But the fact is, my 20" iMac is noticeably faster than the dual 2ghz G5 it replaced. Anyone who believes subjective benchmarks anymore is naive.
Apparently the iMovie compression/export times were "dramatically slower" on the intel machine. They didn't list the results, stating that it was likely a bug; probably just the lack of Altivec support though. I think the value of Altivec on the PowerPC will only become more apparent over time.
The Core Duo is about twice as fast because, as Steve said, each core is about as fast as a G5 and there are two of them.
This means that for most tasks which are single-threaded (searching for text in BBEdit) there's going to be a modest or zero speed increase. For those rare tasks that are written to be multithreaded it'll be ~1.8x as fast (thread overhead, bus contention, etc.)
I'm not surprised either by Steve's stated SPEC benchmarks or real world app benchmarks. That's how concurrency works in the real world whether it's on a dual-core Mac running OSX or a dual-core Athlon running Linux.
Yes, Steve said that processors are faster in 2 specific benchmark tests. /. to do that.
Yes, the marketing on the website is misleading. (2x, 4x)
It's bad enough that Apple and clueless media are taking things out of their context, we don't need
Everyone on slashdot, I presume, knows at least the basics of how to benchmark a CPU, system, process whatever...
We don't process media feeds on IT specs as facts.
If you don't know what AltaVista is (was), get off my lawn.
Performance apart, it seems that good ol' Apple is charging $1300 for a machine that costs around $900(according to market research firm iSuppli) to them. A markup of around 45% in a ultra-competitive market like PC hardware!
Build cheap, claim big, advertise huge...no wonder the stock market can't get enough of Steve Jobs. I'd envy a man who has the ability to charge above market prices for a near commodity product(a PC) and in the process command a cultish following among the buyers.
Steve may have prefaced his remarks, but the 2x speed claims are mentioned several times on the Apple website. http://www.apple.com/imac/ In most places they do include a footnote disclaimer or say "up to" 2x, but the boldface text on the intro page clearly says "Rev up your digital life at speeds twice as fast as the previous iMac." There's also a blurb about a "whole new architecture".
I'd love to see some tests with Pro Apps like Apeture and Final Cut Pro. The other telling one would be Maya for rendering. Most people don't need their word processor to run faster but higher end graphics software needs speed. The Apple tests seemed to lean on the side of graphics intensive software so I'm curious about those numbers. I did play with Apeture on one. It was a single chip dual core. Opening files and some functions hesitated but we're talking RAW files on a single chip machine. I was pretty impressed and I'm not a Mac person. I'm sure if most of that was Apeture and not the machine but it's pretty amazing either way. There definately seems to be an overall speed increase no matter who tests them. These are transitional machines and they are selling basically for what current Macs of a similar speed do. I have to believe once they settle in and the chips are better supported they will be much faster. One of the biggest benefits no one hardly talks about is hardware multitasking. I think if you started a shot rendering say in Maya then started working on a model in Modo you'd find little or no slow down if Maya was set to single node. Normally the apps would be stepping on each other. I haven't had a chance to try running multiple apps since I haven't had a chance to build out a dual chip PC system but there's a definate benefit over software multitasking. I'd give the new Mac a year to settle in before debating speed too seriously. Remember the debacle with the P4s when they came out? They cost a fortune and inspite of denials at the time turned out to be much slower because the apps weren't taking advantage of the P4 architecture. Apple switched to a whole new chipset. Having them come out faster is impressive on it's own. Even the apps that are called native I'm sure need refinements. Most of these aren't going to be optimized for dual chips. Non pro apps normally either don't take advantage or don't take full advantage. With dual core the new standard that will change.
It took Intel until now to come up with something a little more powerful than a G5 that runs cooler than a G5. And they had to go dual-core and next-generation 65-nanometer to do it. This does not reflect well on the x86 architecture. But now that Steve is committed to x86, he seems to have resorted to citing the old tried-and-true PC-fan-boy benchmark, SPEC. Steve really was right about the G5 being faster before. If Intel's latest and greatest dual-core is only 10-15% faster than the single-core G5, he was spot-on about performance claims before the architecture change.
Nice machines though.
Interesting how all the WinTel fans used to use SPEC benchmarks to bash Macs and the PowerPC processor. Now, in some ironic twist of fate, the same people are using the fact that SPECmarks are fairly useless to say that Apple is lying. The bottom line is that the benchmarks are useless except for people doing specialized tasks. The amount of work you can get done in a day has not changed much unless you do serious rendering work, finite element work, or something similarly CPU intensive.
I understand that it is not really a fair fight, but they are directly comparing chips available in that specific model, and to the best of my knowledge, the dual-core G5s did not make it into the iMacs. If Apple wanted to see what chips were the fastest bar none, yeah, then they would put a dual-core G5 vs. a Core Duo.
Just "gittin-r-done," day after day.
So the MacIntels using the Core Duo, seem to be faster than the G5, but not by much (at least in real life). From the keynote we learnt that MacBook Pros are also faster than PowerBooks G4. I wonder, in real life, how faster will the successors of the iBooks G4 be, since they will most likely use the Core Solo? I am really curious, since the iBooks G4 uses chips that are not significantly different from the Powerbooks G4. Will the Core Solo be up to the job?
How much does the extra core help here? Someone needs to fire up CHUD, turn off one of the procs and re-run the benchmarks.
It blew away MMX back when it was first released, and was somewhat better than SSE.
It isn't really much better than SSE2 at all.
The issue here is that Apple had years to do hand optimization of key routines for Altivec, they haven't had as much time to optimize for SSE2.
retrorocket.o not found, launch anyway?
For one, UI responsiveness and multitasking. I know that if I've got an application soaking up all of 1 processor, I'm not going to cause it to go belly-up by shoving it in the background and surfing the web while some single-threaded app happily churns away on that thread.
<Mac Snobbery>Oh, and that reminds me of the nicest feature of OS X: That pop-ups can't take the focus away from you. I hate hitting spacebar, thinking I'm typing into Notepad, and actually I've agreed to a window that flashed up on my screen for about a half a second and I'm wondering if I just bought viagra.</Mac Snobbery>
Right on both counts, and I think these are the reasons:
People who actually will buy a top-of-the-line system because a few extra FLOPS saves them hours and hours of time running photoshop filters are going to see the improvements because by and large, the applications that they use are designed to leverage multiple processors. If they're not, they need to bitch at their vendors, because that's ostensibly why Photoshop costs x-hundred dollars.
People like me, who just want to run World of Warcraft in the foreground and have safari open to look things up on Thottbot as necessary and surf the web during transit, are going to notice the UI responsiveness. Nothing's more annoying than when I can't click on Start for 10 seconds because I'm ripping a CD, or the Java VM is starting up for the first time at the behest of a web application running in the background.
Single-threaded performance is slightly overrated. No task I do, except compilation, gaming, and XSLT transformations, is going to benefit heavily from being twice as fast, even on a single thread. If you stuck a gigabyte of ram into my circa-2001 1GHz P3, set it up next to my office 3.2GHz P4 with HT disabled, and had me take the Pepsi Challenge, I would be hard-pressed to tell the difference in most of the applications I use without getting a stop watch or running Doom 3.
From a email to the xcode-users list...
...also from a blog entry...
In our tests, a large C++ project finishes a full clean build slightly (a matter of seconds) sooner on a Quad Tower than it does on a Core Duo iMac. So the 2-core Intel is only slightly slower than the 4-core Quad for full builds.
Warning: every project is different, and the dynamics of disk and cache speed and latency, processor saturation, process threading, and system memory will affect your results significantly. But we are very pleased with the IDE and compiler performance on the Intel chip.
gcc is certainly faster. Subversion compiled in 5 minutes, 16 seconds on my dual 2.7 g5 with 1.5 gigs of ram. It compiles in 4:32 on the 1.83ghz intel mac with 1 gig of ram. Which makes me happy.
... for some time.
Really, be serious. They take a dual core - which is much like 2 seperate CPUs - and throw a bunch of non-optimized, single-threaded applications at it.
*NO WONDER* that the CPU does not perform 2-3 times as fast as the PowerPC; one of the two cores can't on his own. Steve never told us that applications will be 2-3 times faster. He just showed some flops. If people still can't understand a benchmark *phew*
In fact, the 10-20% increase in spead is exactly the gain that one would expect who knows that MacOS X usually takes 10-20% system load when doing any transfer task (like memory-to-disk and stuff); so it seems to me that this is what happened with those programs.
Also, the article does not give any suspicions why the architecture performes so bad, no background information about the hardware at all (like, jikes, completly different motherboard architecture, different bus system).
In short: from the technical aspect, bad article.
PLEASE, guys, next time, throw in some common sense and benchmark at least one real multiprocessor optimized program, i.e. Cinema4D rendering.
From Steve's keynote:
And we've got the numbers which speak for themselves, so let's take a look at them. The iMac G5 and the iMac Core Duo. Let's take a look at SPECmarks. SPEC2000, integer performance, the most important benchmark of computer performance: 10.2 on the iMac G5, 32.6 on the iMac Core Duo. 3.2X. And these are using the best compilers on each: IBM's compilers on the G5, and Intel's compilers on the Core Duo. For floating point, 13.0 on the G5, 27.1 on the Core Duo, for 2.1. So, in the most important benchmarks of performance, 2-3X. Now everything's not going to run 2-3X. You know the disks aren't 2-3X faster, etc., but on the most important benchmarks, 2 to 3 times faster.
What, you say? Everyone here bitching about Steve Jobs and his "hype" didn't even watch the keynote where Jobs honestly described the new Mac performance? I bet they don't read the articles either...
"Sufferin' succotash."
Did you read the article? The only non-Rosetta result that was slower was iPhoto (export to files). It came in at a "dramatic" 0.91x as fast as the G5. Well, I wouldn't call that dramatically slower.
Why was it slower? It's probably spending the vast majority of its time writing data to files. And guess what's the bottleneck there? The hard disk. The disk in the new Intel iMac is most likely slower than the disk in the older G5 (non-iSight) iMac. this post at the Ars forum explains why. Apparently older iMacs had Maxtor disks, newer ones have Western Digital. And according to that post, the Maxtors are faster. Case closed.
As for the other tests, it would be interesting to see the results with varying (but equal) RAM configurations -- say, 512M, 1G, 2G. Does the Intel machine get faster relative to the G5 when both have more memory? Or does the memory help the G5 more? Does extra memory help Rosetta? What about running Rosetta apps multiple times?
It's a shame that none of the current reviews have done such a thorough enough test yet. It should be fairly easy to do, and vastly more informative!
Say hello to zMac.
Wait, I don't get it. Are we making fun of Apple because now it appears that G4/5 CPUs are actually about the same as Intel?
Isn't this what Mac lovers have been saying for the past 10 years, but were laughed out of the room?
Does Intel automatically start sucking, because Apple moves to the the CPU? Does PPC get magically better?
Maybe those Macs that were "1/2 as fast and twice as expensive" for the last few years weren't really so slow or so expensive after all--meaning who's the fool?
--
$tar -xvf
Actually, the ads to which you refer were made by TBWA Chiat/Day, when Steve Jobs was CEO of Apple. However, you're right that it was a long time ago (1998). See the Great Apple Ads page for details.
Uh this comparison while meaningful in it's own right is downright silly in the text desrciption.
The core Duo is a dual processor. The G5 in question is a single processor. The applications are not explicitly multi-processor applications. They might be multi-threaded having a Gui thread and a calaculation thread, but unless they are explicitly written for multiple processors the heavy lifting is going to be occurring on a single processor. Thus this comparison is essentially between a single processor Pentium M and Single processor G5.
Now on most days saying your new Single processor is 20% to 30 % faster is big news. And look you get two of them, so it's got twice the capacity. Not twice the speed.
I have little doubt that the Spec marks jobs cited were multi-processor aware. it's would be sort of stupid to be otherwise. So his claims seem pretty much in line with the results of the application tests in this article.
Additionally this article is doing imovie and iphoto operations which are disk and memory intensive. As a result you cannot expect the speed of the system to follow the speed of the processor.
One the other hand if you were actually working on the core duo you would notice the following. While your iDVD movie was being compressed to mpeg2, and you went to check your mail or perhaps were doing something else processor intensive the the machine would not be dogged at all by the intense iDVD calculation since it has two processors one of which is twiddling it's thumbs waiting slavishly on you.
In short the UI of the dual is going to seem very peppy no matter what apps you are running in the background. (*execpt ones that bog the disk).
Eventually more apps will be multi-processor aware and you will have a choce of faster apps or leaving that peppy UI.
In any case you have a machine that costs the same but is 20 to 30% faster for applications and has twice the processor capacity to either multi-task or exploit for mulit-processor aware apps. What's the big deal.
Some drink at the fountain of knowledge. Others just gargle.
Barry Norton writes "Steve Jobs, at the MacWorld tradeshow, boasted: 'the new iMac [with] Intel processor is two to three times faster than the iMac G5.'
No, that's not what he said, stop twisting his words to set up a straw man you can then revel in knocking down. If you watch Jobs' full keynote presentation you'll see that he specifically compares only processor benchmarks, not system benchmarks. He even made the disclaimer: "Now everything's not gonna run 2 to 3 X faster, you know the disks aren't 2 to 3 X, etc., but on the most important benchmarks, [the Core Duo] is 2 to 3 times faster [than the G5]."
Flying is easy, just throw yourself at the ground and miss. -Douglas Adams