Working With Ogg Theora and the Video Tag
An anonymous reader writes "The Free Software Foundation's Holmes Wilson is just back from Berlin, where he participated in the Ogg Theora book sprint put on by FLOSS Manuals. Here is a broad look at Ogg Theora and how it fits into the push for free formats: where we're winning, what works, and what could be improved."
Unfortunately, Theora will stay irrelevant where it matters most. In sites like Youtube, h264 will prevail. And this time, h264 is the (much) better tech as well.
To get the same quality as h264 video, Theora video needs higher bit rates, which translates to higher traffic, and in the end costs more money. The much higher popularity of h264 compared to Theora doesn't help, either.
This sig does not contain any SCO code.
FTFA: Ogg Theora is becoming a big deal
I have worked at various companies, from small ventures up to well-known large corporations and have found the same thing at each. Employees think that their company is pretty well-known in their respective fields. While it may be true of some companies (IBM, Microsoft, Amazon, Johnson & Johnson, just to name a few), most third party vendors are mere gnats on the backs of those wildebeests.
This is myopia caused by too much focus on a specialized area. Yes, maybe within a very limited sector your technology may be making inroads, in general you are nothing more than a butterfly flapping its wings. Theora is not becoming a big deal. It is just another codec, and one that isn't particularly popular.
There are technical issues that need to be addressed technically, not simply (as the author of the article does) waved away as a future feature to be implemented when the codec becomes more popular. It will never become more popular until it can offer sufficient reason to switch. Relying on the negative influence of patent encumbrance to drive people towards the codec is a losing proposition. It is a reactive strategy that cannot eventually win.
What struck me most about this article was how even the FSF is not particularly behind Theora, per se. They are for "patent unencumbered" codecs, so they have no real inclination to push Theora in the marketplace. Without a proactive strategy to push Theora both in a business sense as well as technically, it will flounder.
Another codec bites the dust. Big deal.
To stay irrelevant wouldn't Theora need to be removed from browsers that natively implement it? Please provide the references for such plans by Mozilla or Google.
Also, why do people always leave out any comparison of the Vorbis audio? Is it just as irrelevant? The tag is still in the specs.
With regards to the video tag, why not support both h264 and Ogg Theora?
The game.
I dunno but I think "bites the dust" is a bit of a hyperbolic overstatement, don't you? I mean, I doubt Theora's market relevance or market saturation is on any sort of *decline* even if it clearly isn't catching up to h264 in any strategically important way either.
It sounds to me like you're saying here that just because the Ogg Theora team might be somewhat deluded about their codec's visual quality or market potential in the immediate future that it is proof they should just all give up and switch back to MJPEG.
Sure, it would take a lot more for large established companies like youtube to switch to Theora but that doesn't mean that h264 is flawless and everyone should just give up and surrender the entire market to it either. There is a value to the consumer simply in having a variety of video codecs available to choose from, especially ones that are free and tuned to conserve bandwidth.
Monty from Xiph has provided an update on the state of the upcoming 1.1 release. It makes for interesting reading.
I don't think there's any evidence that the video tag is catching on in any meaningful way. Can anyone point me to evidence of the contrary?
Who is to say that Flash's grasp is even weakening among major content providers? Is the video tag DRM friendly?
Certainly we are allowed some leeway for hyperbole here on /.!
No, Theora isn't dead yet. But with no true proactive strategy to switch users away from other codecs, Theora must rely on users switching away on their own. Given that Theora is, technically, inferior in many ways to other popular codecs and has no clear industry support to improve the codec, it's not clear to me why they would expect users to accept it on a technical level.
Yes, it has the benefit of being patent-unencumbered. However, this isn't as big a deal to users seeking higher quality with better compression, better streaming ability, and wide end-user support.
Please note that "user" encompasses anyone who would use the codec, including companies like Youtube as well as end users.
How do you subtitle ogg material. Without it, it does not have the relevance it could have. Thanks, GerardM
The main problem with Theora, is that it is clearly technically inferior.
For instance, Vorbis generates comparable or better quality than MP3 of the same size, so it has a hope to be pushed. Theora doesn't.
Chris DiBona of Slashdot fame now of Google fame had some choice words regarding Theora.
Try finding video editing software which can edit (not commandline like ffmpeg, I'm talking gui After Effects style) a Theora file.
Even on Linux where you would think ogg would be strongest is horrible in the ability to edit ogg files. I do screen captures from time to time and recordmydesktop only saves out ogg (ogv in later versions) files of the captures. I constantly have to run ffmpeg on the files and spit them out as png image sequences.
Outside the technical merits I don't know how you can expect to get traction on a format that barely anything if at all can edit the darn things.
Just my 2 cents.
Try finding video editing software which can edit (not commandline like ffmpeg, I'm talking gui After Effects style) a Theora file.
I've never used After Effects so I'm not sure what features it has. However, if you want a GUI editor which can handle theora files, then try LiVES. It's rather better (in features & interface) than avidemux or kdenlive, neither of which can handle theora. It's cross-platform OSS for BSD-Linux-Mac-Windows.
http://en.wikipedia.org/wiki/LiVES http://lives.sourceforge.net/
Those who can make you believe absurdities can make you commit atrocities. - Voltaire
Audio standardization is not only bigger than the Web, it's older, and it's MUCH more successful than any Web standardization to date, including HTML 5, which is still only 35% of desktops and 90% of mobiles.
I think until the Web development community actually creates and follows even just one of their own standards (maybe HTML 5 will be the one), browser makers and other principals should STFU about audio video standardization, which has been highly successful for 30 years.
During the 21st century thus far, you can't make one fucking Web page for all browsers. But the same ISO MPEG-4 audio video plays in both Adobe Flash and QuickTime Player; both iTunes and YouTube; both iPod and Blu-Ray; both iPhone and Blackberry. Camcorders from Sony and Kodak make the same MPEG-4 video format. Editors from Adobe and Apple edit and export the same MPEG-4 video format. Both NVIDIA and AMD GPU's have ISO MPEG-4 H.264/AAC decoders in them. There are MPEG-4 players from literally hundreds of manufacturers.
But consider that Linux and Windows can't play all of that audio video, and so we invoke Flash in a Web page, bring in a proprietary app with questionable security context and crashy history and also it changed owners twice already, just so we can make everyday standard audio video work in Linux and Windows!
And during the 21st century thus far, HTML has been static. The object tag bullshit from 2008 is the same object tag bullshit I used in 1998. The W3C and browser makers have contributed almost nothing to audio and video in the entire history of the Web. If not for the fact Tim Berners-Lee created the Web on a NeXT system that had 8-bit audio, maybe the Web would not have had audio at all from the beginning. The Web is turning 20 and still no consumer level audio, never mind pro audio. I produce music ... how can I express a 5 minute 24-track 24-bit 192kHz song made up of hundreds of synchronized audio clips in HTML so I can store it for posterity? You guys are not even getting started with what needs to be done with audio and video on the Web. And while HTML did nothing over the past 10 years, we got RSS and then podcasts, which are filled with ISO MPEG-4 audio video. Even MSNBC.com is MPEG-4 since podcasts, no more Windows Media. Set-top boxes with MPEG-4 decoders in them are downloading podcasts. These podcasts are viewable already in browsers. The browser today is interacting with a metric shitload of MPEG-4, but it's leaving it all to Flash and then ironically, the browser vendors complain that Flash crashes their browser! Incredible.
Think about the fact that Microsoft could not break MPEG-4 standardization in spite of using Windows and Internet Explorer to push Windows Media. That was years ago when MPEG-2 was changing over to MPEG-4. How is Firefox going to do it now, when all the media is MPEG-4 already?
Understand that music and movie makers are creating content for MPEG-4 in the way they used to make CD and DVD. Authoring tools have had MPEG-4 export for many years, it's extremely old news. And music and movies are not tolerant of format wars. The margins are too low. Most music albums and movies don't make money. A format war kills all the smaller artists who can't double up their production costs to make 2 products. Broken audio video standardization breaks artists. The media that is on iPod and YouTube and Blu-Ray is what is going to be on the Web servers. If Mozilla can't play it then Flash will be invoked perpetually. That is all Flash is used for now it seems, is to wrap MPEG-4 up to make it Linux and Windows safe.
Further, this is all political because there is no technical substitute for MPEG-4 that pleases Mozilla. Ogg is offered, but Google has already said that an Ogg YouTube would require more bandwidth than currently exists in the world today. Are you telling me that YouTube is not part of the World Wide Web? Ogg on iPod would get you one quarter battery life because there are no Ogg decoder chips. Should the audio from the Web not play on iPods
Well, the MPEG-LA is doing a good job with their plan to introduce per-download fees for people using H.264 next year. If you're still using H.264 for streaming video next year, for anything longer than a 10-minute clip, expect to be giving all of your profits away to the MPEG-LA. Or you could switch to some other CODEC like, for example, Theora, which doesn't have stupidly-expensive licensing fees.
To be honest, I'm more interested in Dirac than Theora. VC-2 is a profile of Dirac which, like Theora, is not patent-encumbered. It's based on wavelets and is much higher quality and has a lot more industry backing than Theora (the BBC, for example, are using it for archiving already). Currently, the CPU requirements for decoding Dirac are a bit high. Playing back the Big Buck Bunny example on my 2.16GHz Core 2 Duo uses 100% of one core (although I'm using a slightly old version of the CODEC, apparently the latest one is about 20-30% faster). The BBC is working with hardware manufacturers to get hardware decoders which should make it a lot more attractive. There's also a CUDA-based implementation and a GLSL version which are reported to be a lot faster than the CPU-based version (I've not tried either) and should work on most modern GPUs. Given that most modern handhelds now include an OpenGL ES 2.0 GPU, which means that they support GLSL, it's likely that Dirac playback on handhelds will work nicely soon.
Theora has much lower CPU requirements than even H.264, so using Theora for the low-quality version and Dirac for high quality sounds like a sensible approach.
I am TheRaven on Soylent News
I don't know why my post is marked as Troll.
Does no one know how many people rip stuff off youtube, vimeo, insert site X here, and edit the videos into parodies or god knows what else?
If you have a format that can't be readily edited I don't get how its going to go anywhere.
Not saying its ideal but it is a valid point.
VP6 (the current youtube codec) isn't hardware accelerated and it's doing just fine. YMMV.
Well, that's not very likely. The advantage of H.264 is that it saves bandwidth, indeed, that's what Google is seeing as the primary advantage, so the balance is going to be "What's the cost of bandwidth + free vs bandwidth - H.264 superiority + licensing fee? Assuming that H.264 genuinely is that much better than Theora, the probability is they'll continue to seriously consider H.264. It's also not entirely clear how large the fees will be, but based upon their general structure, there's a threshold below which no license fees are required and an upper limit on how much anyone can pay for using H.264 to deliver content.
So leaving moral and ethical issues aside and just considering the question of "I run a business, I expect to get $1 per viewer for ten minutes of streaming for my content in subscription fees or advertising, is it worth my while using H.264?", the question is still open, and there's a strong chance many businesses will consider it worth their while, depending on what they're trying to stream.
The other advantage of Dirac over Theora is that it probably is patent free - the BBC has conducted a fairly exhaustive search by all accounts, whereas Theora probably isn't. Theora exists in the same domain as all of the MPEG standards, which means many organizations have been developing in the same space, and the likelihood that a technology critical to Theora is encumbered by patents, the owner of which hasn't yet revealed it, is pretty high. Unlike the MPEG ISO/ITU standards, there's no incentive for companies to get it out in the open that they have patents on projects like Theora. With MPEG it's "Who wants some money? Get in line! You're going to look pretty silly and have lots of enemies if you don't get in line now!"
The disadvantage of Dirac is that right now current encoders are just not seen as high quality as H.264, and as you say, is extremely CPU intensive.
Personally I think someone should create a kick-ass MPEG-1 encoder, just to piss everyone off.
You are not alone. This is not normal. None of this is normal.
But the video itself is 1080p. That means the hardware has to deal with the 1080p video and then resize it to whatever the display resolution is. And guess what? Hardware is better at doing that kind of transform than software.
Theora exists in the same domain as all of the MPEG standards, which means many organizations have been developing in the same space, and the likelihood that a technology critical to Theora is encumbered by patents, the owner of which hasn't yet revealed it, is pretty high.
I'm not sure why you think this. On2 was selling VP3 for a long time, and Theora is a tweaked version of VP3, yet no one claimed it infringed their patents. A patent troll could just as easily have a submarine patent on H.264 as Theora - the MPEG-LA doesn't (and can't) guarantee that this won't happen. And, given that H.264 is a lot newer than VP3, this seems quite likely.
I am TheRaven on Soylent News
When On2 was selling VP3, it was a proprietary codec and wasn't exactly used that widely. Patent owners had no serious way to know that the codec infringed on any patents of their's and if they did, a lawsuit wouldn't be likely to achieve much.
I addressed the issue about submarine patents that H.264 might infringe upon in the post you responded to. Understanding why is key to understanding why companies like Nokia and Apple describe Theora as "proprietary" and why they're expressing very real concerns when they do.
To re-cap and expand upon what I said a little: The MPEG process is "open" - companies who believe they have technologies that would be useful in the standard can submit them as long as they agree to RAND terms for any licensing. Even if the existence of the technologies and their patents is made known after the technologies are unintentionally incorporated into the MPEG standard, patent owners can register the existence of their patents with the ITU and other similar bodies, and can negotiate with groups like Via Licensing and the MPEG LA to have them collect royalties on their behalf.
In short, having a "submarine patent" in an MPEG standard is completely f--king stupid.
As the Theora process is, by necessity, patent hostile, patent owners (who want to make money on their patents) are effectively discouraged from either suggesting technologies they "own" to the Theora team, or making the existence of their patents known until the standard achieves significant market share. Anyone suing today wouldn't get much. The time to sue is when Theora has taken off so far that there's no going back.
Theora, as I said, exists in the same domain as the MPEG standards. It's essentially based upon DCT transforms and macroblock/vector entropy encoding. It's where most of the research has been done since the mid eighties when H.261 came out and MPEG committee was formed. The Theora folks are trying to do the same thing that those developing AVC are doing, and trying to solve the same problems. The chances that they haven't solved problems the same way as others working in the same field is minimal.
While a fair amount of research has been done on wavelet compression, the research is much smaller, and the BBC is better able to get a handle on what patents cover technologies in the field. Therefore, I think Dirac is probably a safer codec.
You are not alone. This is not normal. None of this is normal.
In sites like Youtube, h264 will prevail. And this time, h264 is the (much) better tech as well.
To get the same quality as h264 video, Theora video needs higher bit rates, which translates to higher traffic, and in the end costs more money.
YouTube uses only a subset of h.264. This is likely due to the fact that they want to be able to take advantage of hardware acceleration on mobile devices, and using h.264 to its fullest potential would make most computers, especially mobile devices, use just too much processing power, often more than is available. It also takes longer to encode such streams, which would be less efficient for YouTube.
.
So, what you should be asking yourself is whether YouTube's h.264 is more efficient than Theora. The answer is: no. At the same bitrates, Theora looks just fine, thank you--and it's only going to get better.
Yeah, and who the hell is going to use Phoenix? I mean, Firebird. Oh, I guess it started getting popular. I mean, Firefox. Gee, I guess... things change.
But screw FLAC since it has no hardware support. If there's no audience, why would vendors opt to build in support? Oh, but I guess FLAC did get more popular. And more people adopted it despite lack of hardware support. Gee, I guess now... there is FLAC hardware support, and adoption rate speeds up because of it.
This phenomenon is similar to voting. Third party candidates are treated as not viable because they're not popular enough, so they don't get votes. But they can't achieve popularity without votes showing their viability... (This particular system, U.S. plurality voting, is fucked, though, as incremental progress is squashed by it being a non-preferential voting system. You can't cast a vote to demonstrate viability without disenfranchising yourself from the current round of political decision.)
We must support IE! The year of the Linux desktop will never come! People are just greedy and you can't be generous! Theora doesn't have hardware support! Blah blah blah!
My opinion? Folks fail to grasp that many, many systems are dynamics. Arrangements of smoothly continuous mutual influence. Instead they see only chickens or eggs, or the lack there of fully-formed ones. It's a misperception driven by erroneous expectation. I'm getting pretty sick of that.
is the best form exercising our political freedom, philosophy, and participate in democracy. It's really not that complicated. Plus, if you have a bet on who's going to win, you get to add your vote to your bet. Too bad you can't vote for the horses on the track and bet on them too.
Would you care to read the article and address the claims that the NEW Theora is just as good as H264 for web video (small formats) but not hi-def?
No?? Then you are OT.
The interesting thing I find here is everyone is so concerned with entirely subjective levels of visual quality (which 99% of real end-users don't *actually* care about even though they think they do because they don't have a trained eye or properly calibrated display equipment) and not even remotely concerned with practical issues like the amount of CPU load it takes to actually encode video for a given codec or down-to-the-byte actual bandwidth usage comparisons between different resolutions/quantifiable visual quality levels. I've worked at companies that wholly embraced proprietary codecs like ON2's VP6 for the superior visual quality at higher resolutions but I can tell you that if you're interested in LIVE streams good luck finding any CPU core today capable of encoding even one HD stream in real time, let alone multiple; even more so because multi-pass encoding is mandatory for realizing the full capability of most such codecs.
And this statement doesn't even address the fact that visual artifacts of entirely different codecs will have entirely different visibility depending on display dot-pitch and CRT vs LCD technology choice. Try it... take your favorite awesome codec and compare it with Theora at the same high bit-rate on both an LCD monitor and a high-end high-dot-pitch CRT monitor and tell me if the tables don't turn on effective visual quality.
I guess what I'm saying here is the trivialization of practical concerns other than perceived visual quality comparisons disturbs me. I agree with all the statements of the parent posts in this thread but I think you guys are sill missing the bigger picture - no pun intended. Youtube may be able to pick whatever codec they want but many smaller business entities companies may actually be currently being excluded from the market by lack of adoption of codecs like Theora that can perform well (forgive me here) "ghetto style."
Don't forget Google just bought On2 and thus the VP6 codec. I personally can't waaaaaaaaaait to see what they're going to do with this.