Why IE9 Will Not Support Codecs Other Than H.264
jlp2097 writes "There is a new article up on Microsoft's IEBlog explaining why IE9 will support only the H.264 codec: 'First and most important, we think it is the best available video codec today for HTML5 for our customers. Relative to alternatives, H.264 maintains strong hardware support in PCs and mobile devices as well as a breadth of implementation in consumer electronics devices around the world, excellent video quality, scale of existing usage, availability of tools and content authoring systems, and overall industry momentum – each an important factor that contributes to our point of view. H.264 also provides the best certainty and clarity with respect to legal rights from the many companies that have patents in this area.'"
This is actually the same thing that has been said in the older HTML5 discussions on slashdot too.
Ideologically Theora would be great. It's open and patent-free (supposedly). But it's not as good as H.264. We have already used H.264 with Flash and MPEG-2 and MPEG-4 from MPEG LA. It hasn't created any problems and its technically better. It would be better to have an open source and free codec, but people need to work to create it. Ideology doesn't go far in corporate world, and in my honest opinion, H.264 is better for end-user because it uses less bandwidth and provides better quality and is supported in a lot more devices already.
If MPEG LA would start asking website owners and end-users for fees it would basically mean this was their last iteration in video codecs. MPEG LA also uses patents owned by other companies, so they have a saying over it. I don't think they would be that stupid.
Don't be surprised to see a spate of patent attacks on Ogg Theora... which we may or may not fund ourselves.
If you keep throwing chairs, one day you'll break windows....
None of us people who actually create things and do the work wanted to see software patents become a reality. But the businessmen and lawyers have had their way with us. Now we just have to do all the extra work to create working computer systems, while a few individuals go laughing to the bank.
More than anything else, I think the H.264 nonsense demonstrates the lock-down that will mark a new era of the software industry.
Like all pain, suffering is a signal that something isn't right
The last phrase quoted is likely the key one - Microsoft is very focused on providing as much DRM as possible, and if this codec has the most potential in that regard from their POV, thats likely why they are supporting it. I am sure the Entertainment industry has been talking to MS about this and urging them to keep pushing on DRM type solutions.
"The first time I got drunk, I got married. The second time I bought a chimpanzee, after that I stayed sober" Arian Seid
::begin displaying ignorance::
What advantage is there to restricting IE9 to only H.264? How can natively supporting more codecs be a bad thing?
Living With a Nerd
in an unsurprising move, tomorrow morning Youtube and face book decide h.264 will not be used for video on there sites...
"You are still innocent until proven guilty. What's changed is what they do to innocent people." by notnAP (846325)
The Xbox 360 has supported H.264 for over a year now ...
http://support.xbox.com/support/en/us/nxe/gamesandmedia/movies/videofaq/viewvideoplaybackfaq.aspx
I for one am no expert in this subject, so here are some links I ended up reading:
wikipedia: http://en.wikipedia.org/wiki/H.264/MPEG-4_AVC
a decent article that could provide one with some insight on the patent "wars to come": http://www.vcodex.com/videocodingpatents.html
a random google search to a blog post with a good bit of information, but also opinionated: http://www.0xdeadbeef.com/weblog/2010/01/html5-video-and-h-264-what-history-tells-us-and-why-were-standing-with-the-web/
cnet on Microsoft's stance: http://news.cnet.com/8301-30685_3-20003838-264.html
Lastly, does anyone have a good article on Opera's stance? - I had heard they are against it, but not much more than that...
We should start a new Slashdot and return control to the geeks. It actually wouldn't be that hard to get some users to
From what I've seen of Theora, it's the performance limit, not the open source nature of it, which makes it a non-starter for many platforms. I've read some rumors about Google supposedly pushing their own open-source codec, but I haven't seen any actual products. Do they exist? Is there an open alternative that can compete with H.264 on a wide range of platforms?
From the article:
Of course, IE9 will continue to support Flash and other plug-ins. Developers who want to use the same markup today across different browsers rely on plug-ins. Plug-ins are also important for delivering innovation and functionality ahead of the standards process; mainstream video on the web today works primarily because of plug-ins. We’re committed to plug-in support because developer choice and opportunity in authoring web pages are very important; ISVs on a platform are what make it great. We fully expect to support plug-ins (of all types, including video) along with HTML5. There were also some comments asking about our work with Adobe on Flash and this report offers a recent discussion.
I love linux and think MS is rapidly falling behind, but let's not go overboard here.
I call it 'The Aristocrats'
There are several reasons for this decision. H.264 support in Windows is already paid for (if I'm not mistaken $25 million bucks annually) and taking into account the current software patents laws in the US Microsoft doesn't want any more headache facing lawsuits having implemented support for other codecs [read Theora] which patents status isn't entirely clear and there are no powerful organizations which will protect Microsoft if some company [troll] discovers Theora is infringing their patent portfolio.
The last and probably the most important reason is that H.264 is already an unwritten standard on the Internet and this codec has an unparalleled quality and can be used for pretty much any situations (mind that *all* other existing current codecs are inferior).
MPEG-LA's patent portfolio is sufficiently mighty that a competing video codec would have to be designed from the ground up with the specific design goal of avoiding infringement in order to escape it's shadow. This has not been done with Theora or any other codec that I'm aware of.
Combine this with the fact that MPEG-LA's licensing terms have been sufficiently reasonable that you can get $100-300 gizmos with hardware decoders built in, there's little reason why for anyone to oppose it on practical rather than philosophical grounds.
The obvious reason Microsoft has standardized on h.264 is its support for DRM. However, Ogg Theora is inferior to h.264 by any standard of measurement except for licensing.
Ars has a good article summarizing a comparison study between Theora and h.264. Basically, Theora produces much lower quality videos with larger filesizes and higher CPU utilization when compared to h.264 videos with identical bitrates.
I've heard Theora advocates say "just jack up the bitrates until it looks good - we're in the age of Hulu so no big deal." I find that unacceptable. Theora will have to up its game if it wants to be a true competitor to h.264. All it has going right now is an open license.
Comment removed based on user account deletion
But what's stupidest of all, of course, is that there are so many patent-free, open source options available for the vendors to standardize on.
"Hasn't been sued yet" is different from "patent-free".
Incidentally, HTML5 is a lot more than just video. Most of it is a great step forwards for web devs like myself.
MKV has nothing in particular to do with h.264, except that pirates like putting h.264 video in MKV containers. It's pretty obvious why Microsoft or anyone else has little interest in supporting it.
I just can't get interested in debating this stuff until Google open-sources VP8. Theora is a non-starter. It doesn't perform well and the marketplace already rejected it in enough places (i.e. virtually all portable devices) that it will never be a true competitor.
Once Google open-sources VP8 and makes it free (gratis and libre) then we'll have a real horse race. I'd love to see VP8 hardware support fast-tracked for all devices (mobile and otherwise) so we can have a competitive free solution for video.
http://lkml.org/lkml/2005/8/20/95
Alright, answer me two questions : HTML5 is really the flash killer, yes? Isn't an open replacement for Flash an improvement over flash? I'd assume that HTML5's openness will help avoid Flash's spammyness, right? In particular, all the pop-up ads that circumvent the "Block Pop-Ups" button are using Flash now, so they'll all go away right?
I'm not sure that HTML5 will beat the Flash plus FlashBlocker combo, but that's not realistic for most users, and variations on NoScript could accomplish the same ends.
The Christian religion has been and still is the principal enemy of moral progress in the world. -- Bertrand Russell
This is not insightful. HTML5 is a multi-vendor standard from the W3. The W3 only publish standards that are free of royalty standards (thanks to a big debate and campaign around the turn of the millenium).
HTML5 video is a major leap forward. Previously video was usually locked away behind proprietary Flash delivery interfaces. Already I am finding I can browse Youtube via my web browser and see videos (before I had to use totem's plugin or youtube-dl) because of HTML5 support. The same applies with other video sites, such as Vimeo and dailymotion that have (beta) HTML5 video players. Further, thanks to HTML5 browser support, extensions now exist which can take embedded flash video players of certain sites and transform them in place into HTML5 video.
HTML5 video is agnostic of codec - it does not specify what format video will be in, nor does it specify what formats browser must support. Just as the old IMG tag doesn't specify GIF, BMP, etc. The supported formats are whatever formats systems and browsers support. It would have been nice if W3 had been able to specify Ogg/Theora as a "must support" common-denominator format, but agreement could not be reached on that. That does NOT take away from the importance of HTML5 video.
I strongly suspect many of the people who argue against HTML5 video are people who are running proprietary video-delivery plugins in their browser.. I would ask such people to step back and reconsider the big picture:
a) Proprietary plugins running in your browser, interpreting proprietary blobs downloaded from websites, to play videos from websites using whatever format (be it patent encumbered or not)
versus
b) Your browser, potentially (likely?) free software, using openly specified standards to interpret video-player controls, to play videos from websites using whatever format (be it patent encumbered or not)
The 2nd option is a major step forward. I despair of anyone who argues that we should stick with option a because of the patent issues with /some/ video formats.
Next step: If you're in the UK, we need to lobby the BBC Trust and OfCom to get them to require the BBC to deliver its internet TV services in an open format - rather than via Adobe Flash.
I use Friend/Foe + mod-point modifiers as a karma/reputation system.
Alright, answer me two questions : HTML5 is really the flash killer, yes?
Definitely not. But we'd all be happy if it was the flashbasedvideoplayer killer.
hey could quite easily make it a plugin system where it would ship with one or two codecs, and users could "install" others if they choose
Malware posing as codecs is how you get shit like Antivirus XP on PCs.
What will really happen is that *everybody* will use H.264, but they'll either use the native HTML5 component or the Flash player for Firefox and Opera, if they don't implement it too.
Dilbert RSS feed
RIght now, there's hardly any money in any of the companies doing Theora, and suing just gets you no money at all. Mozilla? Xiph? Relatively poor, and probably good lawyers to get patents overturned. Not a good result. But get a Google, Microsoft or Apple supporting Theora, and these guys have cash.
Google Chrome plays both Theora and H.264, and Google has both cash and "probably good lawyers".
People keep making claims like yours and the Theora developers keep SPECIFICALLY addressing those claims, and yet you APPHOLES keep making those claims.
REFERENCE
If Microsoft could be sued for including a format then that is a good reason not too. The implication has been that Theora might infringe on some patents. It may, it may not. I don't know and likely nobody here does either.
The same thing applies to h.264 or any other codec, for that matter. The only thing the MPEG license buys you is indemnification from the patents that the consortium knows about, and they explicitly make no guarantee that other unlicensed patents weren't infringed along the way. You're on your own for that.
"Hasn't been sued yet" is different from "patent-free".
Sure, because those are totally orthogonal dimensions. You can get sued for using any codec (and you might even be a juicier target with something like h.264). When you buy an h.264 license, you're only indemnified against the patents the consortium holds, and you're explicitly not covered against anything else that was infringed along the way.
Wouldn't it be more like they were a workaround to the W3C's thing with spending years focusing on standards that nobody intends to implement or use?
-- "So they told me that using the download page to download something was not something they anticipated." - Bill Gates
It's not myopic. The web video problem has 2 dimensions:
1. The embedding/delivery dimension
2. The codec patent encumbrance problem
HTML5 video fixes the first and gives us a chance to wean the web off its addiction to a certain closed, proprietary plugin. With HTML5 the web can at least be accessible to free software (there are free implementations of H.264, even if there are patent issues).
It doesn't fix the 2nd problem. However it doesn't make it worse, indeed it probably it makes it /easier/ to start tackling this issue. The major HTML5 video browsers *already* support Ogg/Theora - unlike Flash!
I agree software patent issues are indeed a huge problem, but you can't always fix all problems in one go.
I use Friend/Foe + mod-point modifiers as a karma/reputation system.
Professional web dev here. I first heard about HTML 5 a year or two ago, in the context of their adding a bunch of new elements (<nav>, <header>, <sidebar> and so forth) and removing all the presentation markup.
Overall, HTML 5 is great. There are a few things from XHTML 1.1 which aren't going to be present which would be nice, but I can't name them offhand. The <video> tag was, to me, just a nice convenience. The war that's erupted over this is, IMO, kind of ridiculous; everyone should obviously support both if they can and Theora if they can't, unless legal issues materialize. And I think that's 100% FUD; the Xiph guys are meticulous about legality since it is basically the reason they exist. If anyone litigates Xiph, Xiph will win.
More than that, the <canvas> tag is a big deal. I hope all of CSS 3 gets implemented too. Things are looking pretty good overall. I think this video hysteria will probably blow over, and Theora will be widely available, if not installed by default, available as a plugin.
The BBC were doing just fine, even with iPlayer - I was using XBMC to watch beautiful HD content until they switched on swf verification on their streams. If they disabled this, or just offered up h.264 without the flash wrapper I would be happy again.
You are right, but at the same time you are completely ignoring the elephant in the room. Microsoft is putting HTML5 and *only* h.264 into IE9. This means that as HTML5 gets rolled out, it *will*have*patent*problems* for anyone who wants to do 'Free' video and doesn't want to convince their users to download a different browser.
Meta-rants aside, do you see the problems coming down the road? This is the topic of the article, after all.
HTML5 video is a major leap forward.
It's not really. What's the difference between an HTML5 video tag and a simple hyperlink to a video file, which has worked for as long as video files have been around?
The HTML5 video tag requires your browser to be a video player too, instead of just handing off the video to your systems video player. This increases bloat. What do we get in return? We get videos embedded in a web page, instead of in their own window. Why exactly do I want that? If I'm watching the video, I only want to see the video. If for some reason I want to watch a video and browse the web at the same time, I have to create a new browser window anyway. I am having trouble coming up with any use case where embedded browser video would be preferable to an external video player.
Give me Classic Slashdot or give me death!
No, no conversion needed - you'll just install a plugin.
The article is phrased in a very anti-MS way - IE9 will support any another codec via plugin, including the older WMV and other MS formats.
This is a very Apple-esque move on Microsoft's part.
Sure, it makes sense for them to favor h264 over anything else. There is really no good reason for them to pretend that other formats do not exist.
H*LL there could be legacy video files that people don't want to transcode. This isn't just about open systems zealots. Forcing one codec can be a nuissance in a number of ways.
A Pirate and a Puritan look the same on a balance sheet.
Uhhh...dude? You're just trading one butt banging for another. Hell if anything Adobe has been less douchebag about Flash than MPEG-LA, which has been "everybody owes us a check" if you actually do anything with it besides film grandma and never share. This will NOT wean anyone off of Flash, if anything it will make Flash even more powerful! Why? Simple, because MSFT and Apple refuse to support Theora, while FF and Opera refuse to support H.264. So what format can they all play? Hmmm...maybe, oh I don't know, Flash?
If they would have set a minimum of Theora support I'd be right there with you pal, but Ballmer and Jobs wouldn't have it, so what you have is another IE6 clusterfuck where you either design the website with two standards, or you just stick with Flash. It really sucks, but what do you expect when you get the big boys in on it? But if we are forced to go with Adobe or MPEG-LA, I would strongly recommend we stay with Adobe. Better the devil you know than the ticking patent troll timebomb that is H.264.
ACs don't waste your time replying, your posts are never seen by me.
Read the blog - Microsoft have *not* ruled out IE9 supporting other codecs via plugins and what not. Indeed there's a suggestion (though unclear) that IE9 may support whatever codecs are installed with WMP:
We’ve read some follow up discussion about support for more than the H.264 codec in IE9’s HTML5 video tag. To be clear, users can install other codecs for use in Windows Media Player and Windows Media Center.
Further, IE9 is not the only browser. Chromium supports a wealth of formats by dint of FFMpeg; WebKitGTK+ browsers support a wealth of formats thanks to GStreamer support (or will do soon); Firefox only supports Ogg/Theora at the moment - hopefully though it will gain access to system media APIs in time (gstreamer, etc).
I am baffled at how anyone can think that finally having an open delivery system, that can work with a range of formats, is *worse* than a proprietary system that only supports encumbered codecs (H.263+/VP3, VP6, H.264, MPEG-4p2), at least OOB and accelerated.
Again, I'm curious if you're using that proprietary video delivery plugin on your system?
I use Friend/Foe + mod-point modifiers as a karma/reputation system.
So because Apple and Microsoft refuse to support Ogg/Theora we should refuse to have /any/ video standard, and so ensure web video remains in the hands of proprietary blobs that can only usefully play patent encumbered video, thus ensuring Ogg/Theora can never see any significant use for web video?
That's snatching defeat from the jaws of partial victory, I have to say.
Further, the way I read the blog article, Microsoft most definitely do NOT rule out other codec support. Indeed, there's a suggestion that perhaps additional IE9 HTML5 video codec support is just a matter of installing WMP codecs...
I use Friend/Foe + mod-point modifiers as a karma/reputation system.
HTML5 specifies a model for applying controls and transformations on the video.
I use Friend/Foe + mod-point modifiers as a karma/reputation system.
HTML5 and WHATWG were a workaround to the W3C standards process because certain powerful interests didn't want to support the strictness of XHTML2.
Now that WHATWG's efforts have been accepted by W3C and the superior standard of XHTML2 has been shelved, what can we do to try and make the web work properly?
Sorry, but having floundered through a DECADE of XML and it's Bazillion offspring HTML5 was crying to be made.
If it were true that only the manufacturer had a license, you wouldn't have the right to create an H264 video at all. In theory every use of the patent; both manufacturing and actual video creation; requires an explicit license from the patent owner. In practice, normally, the manufacturer gets a license which covers all possible use of the equipment and covers you too.
However; at the present moment the MPEG-LA isn't really making much money out of H264. They are just growing the market. So they are giving out very cheap and very limited licenses for now and planning for worse later.
Think of this as being like GIF, where Unysis let the format become popular and then later started charging royalties. Except this time around, you don't get the chance to claim you didn't know about the patents because you've already accepted their free time limited license offer.
=~ s,(.*),<sarcasm>$1</sarcasm>,g if any_point_you_wish();
Yeah, but, lets face it - Apple and Microsoft have a shared vested interest in promoting H.264 and detracting Ogg/Theora - Apple has a patent in the H.264 pool (and a pretty major one), and Microsoft has 30 US patents alone in that pool (and many non-US patents, as well - reference). Steve Jobs has even stated that he intends to create a group to go after Ogg/Theora for patent violations, saying anything to do with video is patented, and has been one of the biggest Ogg/Theora opponents from the beginning.
Apple and Microsoft don't care about free and open standards in web browsers because it doesn't profit them - in fact, I imagine they'd like to cram as many proprietary patents in as possible so they can charge for tools to create them. With H.264 patented for at least the next 20 years, there is a lot of money to be had.
Stop spreading FUD, you have no clue what you're talking about as the h264 license doesn't do anything like what you describe.
Theora is arguable better/worse, and its an argument that is clearly not clear. There are no known patents and they've went out of their way to try and not be subject to any, thats good, but it doesn't change the fact that their still may be patents that effect it.
You have no proof of either one of your claims. The first (performance) is a highly contested debug and the second is for all practical purposes impossible to prove.
There is a lot of uncertainty and doubt involved ... unfortunately you're too blind to see where its at.
Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
Your external video player can scale videos anyway you want, or not at all. I'd also suggest that a one click "open with" dialog is a nicer interface than a web browser that starts a video as soon as you hit the page. Why is launching another app such a big deal?
An external video is still problematic, unless we can agree on a universal format that every external external player on every platform can handle.
There is one thing I'll say. It would be nice if there were a one click way to pass an URL to an external video player for streaming, instead of "open with" which downloads the file first and passes that file to the video player. This could easily be done with no changes to the protocol.
Yep, agree on this point.
Software should do one thing, and do it well.
It depends on how you defined "one thing". Wouldn't you define "displaying web-based content" as "one thing"? Shouldn't then, by your definition, everything be handled by the browswer? Why not launch images in a separate viewer? It completely depends on whether you interpret video as part of the web content, or something external and separate. Why the arbitrary distinction between still and moving images?
Irony: Agile development has too much intertia to be abandoned now.
I am baffled at how anyone can think that finally having an open delivery system, that can work with a range of formats, is *worse* than a proprietary system that only supports encumbered codecs (H.263+/VP3, VP6, H.264, MPEG-4p2), at least OOB and accelerated.
Because as it stands today if a user/company wants to use a browser under, say, Linux, today, they won't get sued. They can install the shitty Flash plugin which the majority of web video today uses and they'll be safe. No one will bother them for that. Yes, it's proprietary, but there are few royalties involved.
Under the new proposal, if the majority of web content moves to H.264, where does that leave the web content makers and the software writers? Steve Jobs has already hinted of potential impending lawsuits in this direction. If H.264 is patent-encumbered and lawsuits break out, it will have a far more negative effect than the current status quo does. Plus, a patent-encumbered codec cannot be Free Software, so I don't really see it as being a great leap forward.
Yes, you're right, point number 1 (in your earlier post) is definitely a step forward. However, if it's paired with codec that is two steps back, I have a hard time getting excited. And until very recently I was -very- excited about the possibility of HTML5 killing video-over-flash, something I've desired for a long time.
it's my understanding that the canvas is the primary drawing surface for the page
That depends entirely on the page. Canvas just defines a region that you can draw on. It might be the entire page, but then a Flash applet might be the entire page. Any web page not designed by a complete idiot (at least 1% of total web pages) will continue to use non-canvas elements except where drawing is needed.
The real problem with the canvas tag is that JavaScript does not have a sane concept of encapsulation. You can block all scripts for a page, which will stop drawing on canvas, but will break other interactive elements (e.g. posting comments on Slashdot). You can turn off the canvas, so the context object is null, but that will break the scripts that try to draw to it. The nice thing about Flash is that you can disable it without affecting anything else on the page.
I am TheRaven on Soylent News
See Chris Dibona's explanation.
I use Friend/Foe + mod-point modifiers as a karma/reputation system.
The fact that it's played within the page, and is part of the DOM, which means that you can do all sorts of stuff with the video which you can't with plugins. You can manipulate the video in all sorts of crazy ways.
Oh no! "The IMG tag requires your browser to be an image viewer too, instead of just handing off the video to your systems image viewer! This increases bloat!"
Clever signature text goes here.
The open source browsers will either have to get on board with h.264 or risk losing the majority of their users, and we'll see a return to the bad old days of IE dominating the web.
I think you missed my point. While I agree with your premise above I disagree with your conclusion. Yes the other browsers, including the open ones like Firefox and Chrome, will have to support h.264. But they'll also support the other free alternatives. New startups tend to operate on a shoe string budget until they get popular enough for funding. So they'll tend towards using free codecs. If one of these start to get popular even more people will be switching off IE. It's not like the bad old days where MS had the power to attempt to fragment the web into MS only or everyone else. MS doesn't control h.264 and can't keep it secret and change it at a whim so no one else can support it. That's what they attempted originally with IE. In this case any browser is free to implement the only standard MS is going to support but they can support other unencumbered standards that are much cheaper to use. It will just take one web site that uses ogg to get popular and IE's numbers start dropping faster. Once IE's numbers drop low enough Google can switch youtube to ogg and MS will have to adapt or die. Either way I only see this as a plus in that IE's numbers will drop.
Who is John Galt?