Slashdot Mirror


Ogg beats MP3 & The Rest In Listening Test

Nice2Cats writes "The Ogg Vorbis format came out far ahead of MP3, MP3Pro, RealAudio Surround, and Windows Media 9 Beta in a comparison of different audio formats by Germany's respected computer magazine c't. More than 6,000 people took part in the test. Heise says Ogg's dominance was most pronounced with 64 kBit/sec samples; the full magazine article (out on Monday) mentions that in pre-tests, some people actually mistook the 128 kBit/sec Ogg samples for the uncoded version. Let's hear it for those strangely named open source file formats!"

14 of 501 comments (clear)

  1. Re:Time To Switch by dybvandal · · Score: 5, Informative

    do not convert from mp3->ogg
    this will not get you the result you want to

    i am afraid you will need to re-rip all your music

  2. Fullscale deployment by pajor · · Score: 5, Insightful

    I think we need to promote fullscale deployment of ogg vorbis. Windows Media, Quicktime, all of the major players should be equipped to play it. With Microsoft pushing WMA, Windows Media support is probably going to have to come from third parties. Ogg Vorbis playing hardware should be cheaper than proprietary format playing hardware, but I doubt anyone will release a player that DOESNT play mp3s.

    The best way to support ogg is probably to rip your entire cd collection as ogg; pull your mp3s off kazaa and share away. This action might possibly be illegal depending on your cd collection, but if the entirety of Slashdot stopped sharing mp3s and started sharing oggs, I bet the public would take notice and it would take off. Although, the media companies would probably take notice too.

    I do fear if ogg vorbis becomes to popular, patent holders will pop up (like the jpeg dilemma) and start wanting money. Ah well.

    --
    Gnuyen
    1. Re:Fullscale deployment by pajor · · Score: 5, Informative
      From Xiph.org:

      For companies to produce portable Vorbis players, they need to be made aware that there is a market for them. Every day, I hear the same thing from Vorbis listeners; 'I'm not buying a hardware portable music player unless it supports Ogg Vorbis.' It's nice to hear, but we can't do anything about it (we're not a hardware company). So, this page is here to let you send that message to people who can. Remember, be polite!

      The Companies:

      Frontier Labs - URL - has told a lot of people that they're considering implementing Vorbis support for the NEX II machine. Here's their information:

      Frontier Labs
      Unit 2206 - 8, Cyberincubator, Kodak House II
      No. 321 Java Road
      North Point, Hong Kong
      Telephone: 852.2527.3322
      Fax: 852.2528.5277
      E-mail: techsupport@frontierlabs.com

      iRiver - URL - has said they are planning to support Ogg Vorbis in the future via firmware upgrade, but the schedule is not yet finalized. Here's their information:

      iRiver America
      1716 Ringwood Avenue
      San Jose, CA 95131
      Telephone: 1-408-452-7940
      Fax: 1-408-452-9944
      E-mail: contact@iriveramerica.com

      UPDATE: Forwarded E-mail from iRiver America

      The engineers have Ogg Vorbis under consideration to support. However, at this time, there is no decision whether it will be supported in the future or not.

      Regards,

      Erica L. Briggs
      Customer Service Representative
      iRiver America, Inc.
      Direct: 408.452.7940

      Wouldn't you like to see Vorbis on the super-sexy iPod? We would, too. Here's some contact information for Apple Computer (URL):

      Apple
      1 Infinite Loop
      Cupertino, CA 95014
      Telephone: 408-996-1010

      UPDATE: Don't forget to drop a note to Apple about the iPod at http://www.apple.com/feedback/ipod.html!

      Other companies producing audio hardware:

      Archos Technology Inc. - URL
      3-A Goodyear
      Irvine, CA 92618
      Telephone: (949) 609-1400
      Fax: (949) 609-1414

      ReQuest Multimedia - URL
      435 2nd Ave.
      Troy, NY 12182
      E-mail: bizdev@request.com

      Evolution Technologies - URL
      118 Kitty Hawk Drive
      Morrisville, NC 27560
      Telephone: 919-544-3777 / toll-free: 866-848-8070
      E-mail: info@nowevolution.com

      UPDATE: Note from Evolution Technologies

      Evolution Technologies, Inc. is committed to support our consumers music appetite. We will support the formats that are consistent with both their desires and good business practices. While we have not ruled out supporting "open source" formats, we must first evaluate the acceptance levels with the buying public so that our organization can justify the expense of developing a new compatible CODEC. When the demand is sufficient, we will support the technology.

      Sonic Blue - URL
      2841 Mission College Blvd.
      Santa Clara, CA 95054-1838
      Telephone: (408) 588-8000

      I-Jam Multimedia LLC - URL
      1092 National Parkway
      Schaumburg, IL 60173
      Telephone: 847-839-1233
      Fax: 847-839-1277
      E-mail: ehamnett@geltzerpr.com

      Alaris, Inc. - URL
      44061 Nobel Drive
      Fremont, CA 94538

      Creative Labs, Inc. - URL
      Developer Relations
      1901 McCarthy Blvd.
      Milpitas, California 95035
      Telephone: 408-546-6425
      Fax: 408-432-6717
      E-mail: devmusic@creativelabs.com

      Daisy Technology, LLC - URL
      111 N. Market Street, Suite 624
      San Jose, CA 95113
      Telephone: 408-286-7697
      Fax: 408-351-3330
      E-mail: info@daisytech-usa.com

      Procell Media - URL
      69 Wrexham Road
      Whitchurch, Shropshire
      SY13 1HT
      UNITED KINGDOM
      Telephone: +44 (0)1948 665048
      Fax: +44 (0)1948 667099

      G-NET Canada Headquarters - URL
      11 Sinclair Court
      Cambridge, Ontario
      N1T 1K2 CANADA
      Telephone: 519-623-4901
      Fax: 519-623-3229

      --
      Gnuyen
  3. Ogg is only discernably better at lower bitrates.. by altgrr · · Score: 5, Insightful

    As the article says, despite all this hailing Ogg as the most wonderful format under the sun (as has been done quite a bit recently), look more carefully at what the article has to say: (translation follows)

    Especially at 64kbps Ogg Vorbis won over convincingly, and left the competition behind. From 128kbit/s, the noticeable difference between the formats became significantly lower, such that WMA, RealAudio, MP3Pro and also MP3, to most ears, was difficult to differentiate.

    Yes, Ogg is good for low bitrates, and it'd be great to see it adopted as a streaming format, but I don't think there's really a need to convert to Ogg yet.

    --


    Like car accidents, most hardware problems are due to driver error.
  4. I actually scored the 64kbps sample above.. by rseuhs · · Score: 5, Insightful
    ... the "original" wav. (The wav was at 3rd place, ogg first, mp3pro second)

    (No, I did not know which sample was which. I also know not enough about those codecs to recognize artifacts etc.)

    Actually c't has conducted listening tests some years ago (but only with mp3, they were interested in CD-music vs. compressed) and mp3 was found *better* than what is on the CD.

    It's probably the annoying frequencies that are filtered away in compression...

    My point?

    Well, there are a couple:

    • ogg is better than mp3 ;-)
    • There is no such thing as the "original", the material on CD is also a digitalized, sampled version of the real thing. A 256kbps ogg created with a higher sampling rate would probably be closer to the real "original" than what is currently shipped on CD.
    • Whatever is on the CD is not sacred, if my ogg that takes only 1/20th of space sounds better for me, I don't see the slightest problem. Who knows, maybe some bands run their stuff through a codec before it is put on CD to make it sound better? (Oh my a can feel the hatred of audiophiles against me right now...)
    1. Re:I actually scored the 64kbps sample above.. by Mwongozi · · Score: 5, Interesting
      I always wondered about tests like this.

      Would it not be a better idea to allow the participants to become familiar with the original, source audio, and then get them to rate the various compressed formats (without them knowing which is which) as to how much the sound like the original?

      Surely "How much does this sound like the original?" is a better test than "Which sounds best?"

  5. Of quality & compression by Powercntrl · · Score: 5, Interesting

    I've found 192kbit CBR MP3 to be more than adequate for my music copy-ahem- archival needs. The resulting quality is largely the result of using a good encoder. I can't read German and the fish is of little help, so I don't know if they used a good encoder like LAME or Fraunhofer, or some garbage like Xing when doing their MP3 comparison.

    MP3 player quality also seems to vary considerably. The best player I've heard on Win32 is one called Nad (seriously, that's the name). From what I understand, the author sold the rights to some company and that was the end of it... Winamp's quality has varied over the years as the decoding engine was changed several times over the course of its life. Sonique seems to be pretty good as well. While Fraunhofer's encoder is very good, the free playback-only codec bundled with Media Player seems to have lackluster high frequency response, giving the audio a less "defined" sound.

    Despite all my rambling, my point is simply that it is hard to do an objective comparison of MP3 to other formats since there are so many variations of the encoding and decoding software. I've done my own listening comparisons with OGG and found it to be comparable to MP3, but since my portable MP3 CD player only plays MP3s and redbook audio CDs, my use of OGG has been quite limited.

    While I applaud the open source community for producing such a high-quality competitor to MP3 as OGG, the real issue of getting people to switch still lies in hardware support and easy-to-use, CDDB compatible OGG CD-rip utilities.

    --

    ---
    DRM is like antifreeze, to the MPAA/RIAA it's sweet, to the consumers it's poison.
  6. The problem by Mr_Silver · · Score: 5, Insightful
    The problem I see here is that whilst Ogg may be better than MP3, it is not significantly better to get people to move over to it.

    As many companies have found out, if you're going to compete with someone who has a large share of the market - your product will fail if there is no absolutely compelling i-must-have-it reason for making the switch (and enduring all the recoding of your, possibly, hundreds of MP3 files).

    For me at the moment:

    • 128 kbps sampling is by no means perfect, but (for me) it's acceptable
    • There are hardware based MP3 players out there
    • All my friends encode MP3's - not one uses Ogg.
    • I have a large number of MP3's - it would be a serious slog to re-encode them
    • The amount of Ogg files available out there pale into comparison with MP3.
    In short, like the vast majority of people out there (who don't read slashdot and never have heard of Ogg), going to Ogg would be a step backwards for them. They'd have less choice, less options and would be isolating themselves from everyone else.

    In a situation like that, you have to have a pretty damned good reason for going through all that - and as of yet, for the common man, there isn't such a reason.

    Doesn't mean I won't keep watching Ogg though ...

    --
    Avantslash - View Slashdot cleanly on your mobile phone.
    1. Re:The problem by GigsVT · · Score: 5, Insightful

      In short, like the vast majority of people out there (who don't read slashdot and never have heard of Ogg), going to Ogg would be a step backwards for them. They'd have less choice, less options and would be isolating themselves from everyone else.

      Not to be rude, but what the fuck are you talking about? How much trouble is it to download and install another plugin for their players? No one has to reencode anything they don't want to. The migration to Ogg can be like the migration from old UNIX compress (.Z) to gzip (.gz). There is no reason someone can't have both at the same time.

      Most people will probably be introduced to Ogg when they go to a streaming site, and it says "hey you need to get this player (or plugin) from here to listen, don't worry, it's free, click OK a few times". Then when they see .ogg files on the net, they will double click them, and everything will work automagically.

      --
      I've had enough abrasive sigs. Kittens are cute and fuzzy.
    2. Re:The problem by Makali · · Score: 5, Informative

      What do you mean, there's little reason? There's little reason for the consumer, because the consumer doesn't give a monkey's: if people really cared about the sound quality, Kazaa and Gnutella wouldn't be flooded with 128kbit MP3s. MP3s encoded at a higher bitrate can be used as a solution to all of MP3's audio problems, and storage is cheap, so yes, it's unlikely that there'll be an instant switch to any better format, and if there is, it won't come from the consumer.

      Now, for the content provider, it's a different story entirely. Thomson/Fraunhofer are actively pursuing royalty fees, and all the other "next generation" codecs do too. Except Vorbis. With Vorbis (one of the Ogg formats; there are several), audio can be coded at a lower bitrate and sound the same as a higher-bitrated MP3, and there's no royalty fee which means the development costs are lower, and (potentially) the product is cheaper. Thomson aren't making any friends running around with their team of lawyers and threatening people left right and centre with license-fee demands. If a good quality alternative presents itself (quality as a function of price and ease of use, rather than audio quality), developers will be tempted to switch. From what I hear, the Vorbis libraries are very easy to use.

      New formats are being picked up by software developers (especially console game developers, where RAM and Storage are at a premium). Once developers start using the format, they'll use it in other products too. If it costs little to add a codec to encoding products (and well, the vorbis libraries are free, but you still have to pay a guy to learn the APIs and program for them), then there's little point in not implementing it.

      Ironically, Thomson/Fraunhofer are trying to play down the significance of MP3 because they're trying to sell AAC, which benefits all alternative codecs pretty much equally.

      Finally, don't be a fool. No one's asking anyone to recode anything. Unless there was an outright ban on the MP3 format tomorrow (and some way to enforce it), there's no point recoding your audio. There's no isolation in using Ogg when you can use MP3 at the same time. Winamp, the next version of RealPlayer, and Windows Media Player (via a DirectX plugin) all support OGG Vorbis files. To the consumer, little changes... to the average windows user, they probably won't even know! Windows hides file-extensions by default, so it'll just be another "Winamp Media File".

      There's no "step backwards"; it's a step /sideways/, but still going in the same direction. Instead of being on the centre path of MP3, you can switch to Ogg, and still have MP3 at your right hand. You're given /more/ choice, not less. You now have a choice whether to use OGG or MP3 in many applications. That's a good thing, right?

  7. Re:Time To Switch by CoolVibe · · Score: 5, Insightful
    Do you encode your mp3s with mp3? I guess not. Do you see my point?

    Don't convert your mp3s. Keep 'em. From now on, if you rip a new cd, use Ogg.

    Maybe on a boring afternoon you could re-rip your already ripped cd's to Ogg and send the old mp3s to the bitbucket.

    Fraunhofer's mp3pro doesn't have mp3->mp3pro converters. Why should Ogg Vorbis need that?

  8. What ogg is not... by BitGeek · · Score: 5, Insightful

    .. is a standard. AAC may not be as good as Ogg, but I'm encoding to it in my application because it is part of the MPEG-4 standard.

    The Ogg team should get on the MPEG bodies and start lobbying to be included. This is the only reason MP3 was able to be as popular as it is-- it was a clear standard. Ogg should do the same.

    IF, for instance, it had been part of Mpeg4 then any of the hundreds of thousands of cellphones, computers, pdas, musicplayers, stereos, tvs, DVD players, etc, that come out over the next 10 years that make use of the MPEG4 standard would be able to play back ogg content.

    The last major standard like this was MPEG2 (and MP3 is part of MPEG1) so these are not things that happen often, and companies are highly unlikely to add playback support for something that's not part of a standard.

    Phones will be MP3 capable going forward, but not ogg capable unless it becomes at least a defacto standard-- getting it into the Profile 0 of MPEG4 would have accomplished this....

    This is not to bash the Ogg developers, just to give a recommendation for going forward.

    --
    Yeah, and you guys panned the ipod too: http://apple.slashdot.org/article.pl?sid=01/10/23/ 1816257
  9. Ogg doesn't need to "win"... by mcrbids · · Score: 5, Interesting

    There's an interesting detail that's commonly misunderstood about OSS projects. They don't have to be #1 in market share to "win".

    All it takes for OSS projects (such as ogg) to succeed is that somebody continues to develop the project, and some people use it.

    Linux is just now really starting to "take the enterprise"... I read about it every week in my CRN weekly trade rag, but Linux has been around over 10 YEARS before this!

    Was Linux "losing" 4 years ago just because it wasn't well known yet?

    OSS slowly wins because it is:

    Good enough. Come on, let's face it: Apache isn't as easy to set up as IIS, and there are other alternatives out there that have some clear advantages over, say, Apache. But Apache is "good enough" and seems to have the most mindshare, so Apache it is.

    Cheap/Free: Traditionally, the low-price leader is the one that wins. EG: WalMart, Microsoft. Linux is free, Apache is free, and OGG is free.

    NT is cheaper than Unix (and so was slowly taking it over) until Linux came along, which is cheaper than NT. Now, Linux has arrested NT's progress into the enterprise & Unix spaces, and is slowly taking the market, piece by piece. Not overnight. Slowly. Linux will be here tomorrow, too.

    Market share changes happen more rapidly when circumstances change to provide a clear financial incentive to switch.

    Thus, Microsoft's license changes provide a financial incentive to switch. The active persuit of royalties for MP3 players provides a new financial incentive to switch.

    And the price doesn't have to be high, it just has to be higher than before.

    How many times have you driven by a gas station because the other one a mile down the road is $0.03 cheaper? Never mind that it adds up to $0.60 cents for a 20-gallon SUV, and you spend ~$0.50 of that savings driving the extra mile and a half, you do it. Be honest...

    And that, ladies and gentlemen, is why .ogg will win - eventually. So, re-rip your CDs, and with every single song, .ogg moves forward that much more.

    So, give it time, and ENJOY!

    --
    I have no problem with your religion until you decide it's reason to deprive others of the truth.
  10. Re:Ogg is only discernably better at lower bitrate by Chris+Johnson · · Score: 5, Insightful
    No. All they're saying is, they didn't use anyone capable of distinguishing much in the way of sound quality past a certain point. It proves nothing.

    I run an indie mastering house with room treatment and scary homebrew monitors, and I've distinguished 256K mp3 from 16 bit AIFF in an ABX double-blind test. I've also got very close to distinguishing dithered 16 bit from truncated 16 bit audio (only about 94% confidence- my ear gave out after about 10 trials! Fatigue!). Ogg Vorbis' strengths are absolutely relevant for high bit depths.

    In fact I've done an objective study on it- feeding encoders a 'torture test' sample, subtracting the spectrogram of it from the spectrogram of the original and looking at what was changed. Across the board, Ogg Vorbis does better than mp3 at maintaining both tonal purity and transient accuracy. Pretty much ALL mp3 encoders at ANY bit rate have to make a choice between these qualities, Ogg consistently manages to preserve both at once. At high bit rates it combines the tonal purity of BladeEnc with the transient aggression of Fraunhofer, while both of those encoders make a mess of each other's strong points at any bit rate- Fraunhofer never sounds really tonally convincing, and Blade can't do transients at any bit rate.

    I would say that Ogg Vorbis is BEST at really high bit rates. You can always strip it if you want lower bit rates out of it...