Slashdot Mirror
Hydrogenaudio AAC Listening Test Results
caffeine_monkey writes "Hydrogenaudio's AAC public listening test, previously posted on Slashdot, is now over and the results are in. The test compared five codecs at 128 kbps, including Psytel, Nero, Sorenson Squeeze, QuickTime, and FAAC. The winner? 'QuickTime is a clear winner, performing much better than the competition. Sorenson Squeeze, Psytel AACenc and Nero are tied, with Sorenson slightly higher than the others. Faac is clearly the worst.'"
I have the Ultimate Guide
I'm not Seth.
Because comparing apples to oranges is never a bright idea. The comparison is between AAC codecs not a few AAC codecs vs WMA.
Do not confuse FAAC and FLAC (the lossless audio format from Xiph).
Btw, why does this test compare only proprietary formats and not free (as speech) formats like Ogg Vorbis or FLAC ?
The following are actual quotes I've read from audiophiles on the net. Enjoy.
"Pulling harmonics together from a jumbled auditory stream to form a coherent harmonic envelope."
"Image outlines were sharply focused in space with believable palpability."
"There was plenty of bass detail to behold."
"The music flows with gusto and verve. It squeezes instrumental images into incredibly palpable outlines."
"...more muscle and definition, and a heart that is pure gold."
"Most preamps when pushed hard change their sonic signature."
"Harmonic colors were somewhat on the dark side."
"By using the $450 gold plated RCA stereo jumper cables for all line-level connections, and the newly available $1200 gold plated XYZ speaker wires, we were able to achieve a distinct improvement in highs and the deepest rich bass lows I have ever heard. A massive improvement over ordinary old copper."
"These cables deliver big time! The sound is surprsingly smooth and spacious, with particularly sweet upper octaves."
"If you connect a ground to the chassis of your power amplifer and use 4 gauge wire connected to a bucket of salt water with a copper coil in it, your mids and highs will be the sweetest you have ever heard. Works with car audio systems too. Place the bucket in the trunk and reduce speed on corners and when braking, to avoid spillage."
"Special wooden resonator disks made in Asia from a special tree, only found in one area. Placing these under EACH of your components, at strategic locations will remove 'unwanted resonances', and DRAMATIC improval tonal quality. The difference is astounding. These disks of wood sell for around $100 to $400 EACH (depending on size)." (See the top of this web page!)
"somewhat fuzzy portrayal of image outlines."
"Harmonic textures ebbed and flowed with startling dynamic nuances and the sort of liquidity and purity one only comes to associate with world-class audio products."
"Harmonic textures are painted slightly gray in color."
"Spatial detail was painted with a fine brush that readily resolved massed voices and the air around individual instruments."
"Image outlines, however, are more precisely focused within the soundstage and in general the Accordance is capable of sketching out a convincing 3-D acoustic impression."
"It felt like I had crawled into a warm and inviting sonic womb."
"Not content with straight S.E.X. (the single-ended experimenter's kit), the Doctor introduces the "69" tapered pipe loudspeaker. Sounds like a recipe for a mind-blowing sonic orgasm."
"The impression of speed and control was strong."
"Bass lines were fleshed out with excellent definition."
"It is less lush sounding than..."
"...force feeding the listener an earful of detail; more accurately, a barrage of in-your-face zingers that becomes almost an instant irritant."
"Each tube brand seems to have a unique flavor of its own."
"Certain busy passages of music get congested."
"... sounds either euphonic or bright."
"The Equilibre ($8,475) - nominally a 60-watt stereo amp."
"It could well explain the sweet sounds that come from using passive preamps straight into the power amplifiers."
"...with an easy-to-drive impedance magnitude."
"Rendition of harmonic colors was suave and smooth, with a believable sugar coating."
"Exposure of low-level detail, even in complex passages, without leaving anything to the imagination."
"The mids are vivid in spades with wave after wave of honey-coated harmonic bliss."
"The midbass region is "fun"
"the upper mids are a bit more laid back than I would like."
"the low bottom end is not there..."
I'm not Seth.
Did you even read the blurb? Quicktime's AAC encoder won.
apple refer to there container format, player and codecs all as quicktime. the story should have arguably refered to it as the quicktime aac codec or possibly the apple quicktime aac codec or even the apple propriatory quicktime aac compression engine
but it just used quicktime and we all knew what it ment
**** lying is wrong even for sleeping dogs
Would I be correct in assuming that it is the QuickTime codec that is used in iTunes? I can't imagine Apple would go to the trouble of writing two different codecs.
"Reality is merely an illusion, albeit a very persistent one " -Albert Einstein
What I'm curious about is, there was some discussion before about the differences between the original AAC encoder that came with QT, and the newer one that now ships with QT 6.3 (and ties to iTunes). The original encoder was said to have sucked. This one, if I'm reading this right, is now very good...?
Anyways, I must have lead ears. I used to rip my MP3s at 160kbps, now I do 160kbit AACs, and cannot really tell the difference. AAC seems a tiny bit better maybe but could be a placebo effect.
If Jesus wants me it knows where to find me.
From Apple's AAC page
Because of its exceptional performance and quality, Advanced Audio Coding (AAC) is at the core of the MPEG-4 and 3GPP specifications and is the new audio codec of choice for Internet, wireless, and digital broadcast arenas. AAC provides audio encoding that compresses much more efficiently than older formats such as MP3, yet delivers quality rivaling that of uncompressed CD audio.
AAC was developed by the MPEG group that includes Dolby, Fraunhofer (FhG), AT&T, Sony, and Nokia--companies that have also been involved in the development of audio codecs such as MP3 and AC3 (also known as Dolby Digital). The AAC codec in QuickTime 6 builds upon new, state-of-the art signal processing technology from Dolby Laboratories and brings true variable bit rate (VBR) audio encoding to QuickTime.
From Via Licensing
MPEG-4 AAC has been specified as the high-quality general audio coder for 3G wireless terminals. Apple Computer has incorporated MPEG-4 AAC into QuickTime 6 and iTunes 4, as well as the latest version of its award-winning iPod portable music player. The Digital Radio Mondiale system (the next-generation digital replacement for radio broadcasting under 30 MHZ) builds on the audio coding of MPEG-4 AAC. These exciting platforms represent the state of the art in audio coding--and Via Licensing is pleased to offer the MPEG-4 AAC Patent License Agreement.
The MPEG-4 AAC standard incorporates MPEG-2 AAC, forming the basis of the MPEG-4 audio compression technology for data rates above 32 kbps per channel. Additional tools increase the effectiveness of MPEG-2 AAC at lower bit rates, and add scalability or error resilience characteristics. These additional tools extend AAC into its MPEG-4 incarnation (ISO/IEC 14496-3, Subpart 4).
A copy of the MPEG-4 Audio standard can be purchased from the ISO online store (search for "14496-3").
" Its pretty widely known that WMA offers superior quality"
Actually, the tests that show this were at the 64kbs range which is not useful except for voice. The break-even point is 128, and above that sampling rate, virtually everything (including MP3) is superior to WMA.
So I guess if you want a good voice-streaming codec, WMA is your codec. But for music, it isn't very good.
But perhaps you're a person who primarily listens to books on tape or something like that?
AAC is not necessarily copy protected. For instance, if you encode your own music with iTunes, the files are not protected in any way.
Obviously, it would be difficult to conduct a listening test if the files in question wouldn't play on everyone's computers because of digital rights management, right?
Actually I do not agree with you at all. Comparing different encoders for a certain format is a complete test. In this particular case, the goal was to find out which AAC encoder is the best. The results answered that question.
As an Open-Source (and open standards) advocate it is easy to look at such a test and say "but Ogg/MP3/whatever is better anyways, they should have included them". Actually saying so leads nowhere at all.
If you want a comparison between Ogg, AAC, WMA and MP3, then do such a comparison. But this was not a test to find our which format/algorithm was the best, it was a test to find out which AAC encoder was the best, which is also what the test answered.
Not every test in the world should always include all and every variant of the test subject in question. Just because you're comparing the quality of carrots from different farmers, you shouldn't automatically be expected to include potatoes in the comparison just because there are people that prefer potatoes over carrots. If the test question was "which is the best vegetable", then omitting potatoes could be considered careless.
And, in very much the same way, if the test question is "which is the best AAC encoder", including MP3-or Ogg-encoders would be just as wrong.
That's my view, at least.
/Viktor...
RTFA. This was onlyl the first step; next, HydrogenAudio will take the AAC winner (QuickTime) and compare it to what they consider the best encoders for the OGG Vorbis, WMA, MP3, etc.
Mod parent up!
Mod grandparent up!
Mod great-grandparent up!
Opinions on the Twiddler2 hand-held keyboard?
It is much more fun to cat files to a MIDI device, but you should not use ASCII, you need bytes with the high bit set. Try an XEmacs binary for example.
The article claims the QuickTime audio format as a clear winner. Yet in most graphs the 95% confidence markers overlapped with other formats. Most statisticians would then say "Not Enough Data!!"
OK The results suggest that Quicktime was better but its not a clear winner until the 99% confidence intervals don't overlap, let alone the 95% ones. As one other poster said. You need a bigger sample size.
As for the noise being louder in the balancing amps than from the RF, that's not true necessarily - I work at a radio station, in a high-RF environment. If we don't balance, we get audio on all of our long runs of wire... including our network cables.
-T
And to further your argument, if the question is 'which is the best sounding format, aac, ogg, or mp3?' then this test is a prerequsite. To compare the formats, one must pick an encoder to encode the samples. The only fair way to do this is to use the best encoder from each group. This test shows that it would be unfair to use faac, for example, to encode the AAC samples.
So, the self-righteous open-standards advocates (no denegration intended) ought to be organizing a test just like this article talks about for ogg and mp3 if there's not a suitable prior study.
Only then can they properly organize the audio-format bake-off.
My God, it's Full of Source!
OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
There are three speed/quality settings in QuickTime. The first is fast and cheap, and really only meant for real-time broadcasting. For this, we're interested in "Better" and "Best" modes. The only real difference between then is when working with more than 16-bit source. Better uses every quality optimization technique that works when the source is only 16-bit. Best uses additional techniques that improve quality with higher bit sources (like 20 or 24 bit, common in audio mastering).
iTunes is tuned for CD ripping, so using "Better" mode by default is just fine.
AAC-LC can also decode at more than 16-bit in some implementations. This means it's possible to make a AAC-LC encode that is better than CD quality, if the source is more than 16-bit. I gather Apple does this with the iTunes music store, using better than CD quality masters for the encode when available.
My video compression blog
There is a whole field of science which deals with the statistics of subjective measurement. Here's a reference to a book which you might pick up to inform yourself:
Sensory Evaluation Techniques
Subjective tests of codecs are not new or particularly controversial. See the MPEG group's own subjective test of AAC:
Report On The MPEG-2 AAC Stereo Verification Tests (PDF File)
The statistics in the hydrogenaudio test treats each listener as a "block," which takes into account the fact that different listeners will have different ideas about what constitutes a "4" or a "2," etc.
The next test will use an anchor (Blade mp3 at 128 kbit/s) to keep the ratings in perspective.
ff123