Public AAC Listening Test @ ~96 Kbps [July 2011].
The folks at the Hydrogen Audio Forums have for years been benefiting the world with their patience, technical skills, and hyper-focus on sound quality, by comparing the real-world sound of various codecs and bit-rates for audio encoding. Under the scope for the latest public listening test (slated to run until July 27) are the following AAC encoders: Nero 1.5.4; Apple QuickTime 7.6.9 true VBR; Apple QuickTime 7.6.9 constrained VBR; Fraunhofer (Winamp 5.62); Coding Technologies (Winamp 5.61); and ffmpeg's AAC (low anchor).
What, no comparison with LAME? How lame.
Life is not for the lazy.
FFmpeg's AAC encoder is not finished (yet?), and flagged as experimental. Including it in such a test is rather a dubious idea: it is likely to give a bad impression of the whole project.
Having the new vo-aacenc as contender for the Free Software community would IMHO have been more relevant.
If you really can easily distinguish well-encoded AAC or MP3 from FLAC you should lend us at HA your golden ears!
I rather strongly suspect once subjected to rigorous double-blinding you might not come back speaking so boldly.
Almost no one can hear a difference between loss-less and any of the codecs at high bit rates (256K+).
Though many think they can, until actually blind tested.
If you can reliably tell the difference in proper blind testing, you are likely have better hearing/perception than 99.9999 % of the population.
I think I have great hearing, but when I did some ABX testing, my ability to distinguish drops off completely by 160 K VBR on MP3s and that is in quiet room with quality headphones straining to ID any difference.
I am skeptical of any golden eared claims these days pooh-poohing modern codecs.
They are the reason we don't all live in caves banging rocks together.
The rock-bangers created Ogg.
When they came for the communists, I said "He's next door. Take him away. Goddam commies."
That is not a description of the type of artifact one is likely to find in AAC or MP3. Try again.
Nope, that isn't where lossy codecs fail either.
Up in arms? No. It was an honest inquiry. If you are truly able to distinguish AAC/MP3 from FLAC on a general basis you would be most valuable.
Ya see, lossy codecs tend to fail in particular ways on specific types of samples. If someone was able to readily distinguish lossless from lossy across a wide (or even moderate) collection of samples they would be damn near unique and quite useful as a tester of dev changes.
Alas lots of people talk and few actually prove they're swinging the big dick they brag about once subjected to double-blind testing.
The Hydrogen Audio Forums tests have traditionally used a sound methodology, it would probably be worth reading up on it before you comment, lest you make a fool out of yourself.
They will not be trying to measure how 'good' each codec sounds, they are trying to measure how close it is to the source material, with a 'perfect score' being statistically indistinguishable.
In a fair world, refrigerators would make electricity.
in my experience, the equipment attached to your skull is more important than the equipment you purchased.
I've seen people with complete CRAP gear ABX at higher bitrates than I can, and I've got a pretty stout rig.
I too had this same question awhile back. Why doesn't HA test commonly used codecs at, say, 192kbps or 256kbps?
The answer? the tests fail because nobody can tell the difference. they make for very boring results.
they run the test at 96kbps because they get usable results. people over a wide range of sound systems and hearing conditions can provide usable responses.
What would you do with that data? hard to say. you can't really extrapolate that, say, if codec A is better than codec B at 96kbps, the same will hold true at 192kbps. In fact, I've seen the direct opposite of that in past HA tests, where various codecs trade the lead depending on bitrate.
So "who is 96kbps for?" I don't know. but "why test 96kbps?" that's easy.
Rather than typical net snobbery against lossy encoders, the self proclaimed golden ears should really help out, they are the ones that can spot encodes a mile away, they should be able help find really good/bad encodes here.
I found myself humbled when I attempted to help out before. I had a hard time distinguishing anything but the poor encode used as control.
Really guys this is a chance to help out, or recalibrate your preconceptions about how good/bad modern encoders are.
Or would you rather just keep up with the unjustified snobbery?
I heard the difference between an iTunes-encoded 320kbps MP3 and FLAC in 2/7 samples I used. This is through ABXing and using statistics. Granted, these samples were chosen as good examples that show differences between lossy and lossless. I wrote up a series of blog posts on it here: http://www.vel.co.nz/vel.co.nz/Blog/Entries/2009/8/21_ABX_of_Lossless_versus_MP3_-_Part_3_-_Results_and_Discussion.html