Hardware-Based Video Acceleration Coming To Linux

sammydee writes "Phoronix reports that GPU based video decoding acceleration will be implemented in Gallium3d sometime this year. Drivers currently using Gallium3d include the open source nouveau driver for NVIDIA cards and experimental Intel GMA drivers. This is definitely good news for anybody who has ever tried to play high-definition 1080p content on any CPU older than about a year."

Comments

Don't know what to say ...

[Swizec]

... you mean we can do all the fancy stuff windows can, and better. But playing videos efficiently was the one thing we couldn't do? We had fancy GUI effects long before windows, we had efficient RAM usage, great file systems, but we had trouble playing a fucking video?

Wow, wish I'd known.

Re:Don't know what to say ...

[Fweeky]

If it's any consolation, GPU accelerated playback on Windows doesn't work all that often, and open source codecs/players tend to be the better ones there speed and support wise, acceleration or no.

Re:Don't know what to say ...

[Anonymous Coward]

Playing a video is no problem.

The problem is that a high-bitrate 1080p video stream requires a lot of CPU time to decode, and then you have to transfer the whole uncompressed frame out to the video card.

Unless you have a really high-end CPU, there are no Windows-based video players capable of doing this with just software. They all require some kind of hardware acceleration. The specs for all this are nicely closed up, and are known only to Microsoft, video card manufacturers, and the few companies that implement video decoders (which is probably Microsoft again).

Video card manufacturers like nVidia have refused to implement any kind of video decoding in their Linux drivers until there's an appropriate spec. They won't tell anyone what they're hardware is actually capable of, so nobody else can write a spec. We can't even reference Microsoft's basic design, because it's all closed off and secret.

Oh, and most of it doesn't even work properly in Windows either. I've never managed to get it to work at all, and benchmarks I've seen seem to suggest that it's really only offloading 10% or so of the workload. Just enough to make the difference between working and not working, but not as much as it could be.

The Gallium guys are planning to implement the entire thing in their video drivers, using only the 3D capabilities that video cards are known to have. That neatly bypasses the whole thing, but required that we have a single base driver to work with (which Gallium provides), and one or more video drivers actually using it (which, again, Gallium provides).

I kind of hope that Gallium implements something similar to nVidia's CUDA - a programming model for running stuff on graphics cards that doesn't rely on graphics-related stuff like textures or polygons. That way, we'd have a way to implement different kinds of video decoders, encoders, or even things like physics simulations. Bonus points if it can be made compatible with something available on Windows...

That said... Linux video players tend to be a hell of a lot quicker than Windows video players. I've played videos in Linux that were impossible to play in Linux.

Re:Don't know what to say ...

[dotancohen]

I've played videos in Linux that were impossible to play in Linux.

You should try Linux next time.

Re:Don't know what to say ...

[nategoose]

That said... Linux video players tend to be a hell of a lot quicker than Windows video players. I've played videos in Linux that were impossible to play in Linux.

Quite an accomplishment!

Re:Don't know what to say ...

[hairyfeet]

Your post,with the allegedly,and supposed to,kinda makes me think of a good point: How are we supposed to know whether or not these things actually do what they say they do? What I mean is,tomorrow they could say this thing can decode format X,Y,Z,but when you actually TRY to find a way of getting to decode X-Z,you get this maze of "allegedly" and "supposed to" and this endless hunt through forums where we are told to buy this or that programs that "should" do it,maybe.

These things are such black box hardware that short of someone actually getting it to work through CUDA I have no way of knowing without shelling out a bunch of cash and hoping my configuration works with their voodoo that the thing actually works. They can claim it'll render every codec known to man but if the only way to do it is some special driver that they don't offer to the public,how can that count? We can test for framerate,render quality,etc,but how do we accurately test for this? All Nvidia offers is a single Mpeg 2 codec for $20. I could not find anywhere where they would sell me an .mp4 codec for the card. And why are they allowed to tout this "feature" if there is no way to actually get the feature without shelling out more money to some third party that they don't even guarantee will work?

Everyone else has to put disclaimers like "batteries not included",but while I can go to the corner store for batteries,I am supposed to...what.write my own driver? Shell out a bunch of cash playing "guess which codec might work"? It seems like a total scam to me,because they are touting a "feature" that 90% of their audience will never be able to use for lack of a freakin' driver.But as always this is my 02c,YMMV

Already there

[bconway]

nVidia's binary drivers and X.org's Intel drivers have had XvMC support for well over a year. I've been using both card successfully with Xine and accelerated 1080p video. I think the news here is that the nouveau project is catching up, but that's hardly clear from the article.

Re:Already there

[hummassa]

1080p with XvMC and which codec? I thought XvMC didn't do x264, for instance.

Google summer of code...

[MMC Monster]

This is apparently a google summer of code project.

While I am hopeful, let's not write this one on stone until it's released.

Not really

[JamesP]

This is definitely good news for anybody who has ever tried to play high definition 1080p content on any CPU older than about a year.

Actually, one of the most preeminent examples of HW decoding of video nowadays is the Intel Atom processor, not really old processors.

Video accel. is inside the chipset for this one.

And yes, it is available in Linux, you will probably be able to watch h264 movies in your new EEEPC

Re:Not really

[WaroDaBeast]

And yes, it is available in Linux, you will probably be able to watch h264 movies in your new EEEPC

Yay, 1080p movies on my seven inch screen! Plus I can even hook it up to my newly acquired 35:000 contrast ratio, 24p capable, 1080p fifty-two inch flat TV through a VGA connexion! HURRAY!


Relax, I'm just poking fun. ;)

Speaking of Xine

[DrYak]

Xine has supported hardware accelerated DVD video (MPEG1/2) decoding using EM8300 based cards like Sigma Design's Holywood+ and Creative's DXR3, since about 2000.
(But that was done using an ad-hoc module inside Xine, not using generic APIs like XvMC or the future Gallium3d video)

The Gallium3D Video API is a good news, because it'll probably be able to address shortcommings that XvMC has.

Re:Extremely stupid

[gEvil (beta)]

Basically history is repeating itself. When DVDs first came out, MPEG-2 decoding was done on the CPU. Then video cards started having hardware supported MPEG-2 decoding. Now that we have the HD video codecs (AVC, VC-1, hires MPEG-2), we went back to square one (especially with AVC and VC-1, which require some pretty heavy lifting). In the past couple of years, video cards have added hardware support for those tasks, which otherwise would max out a fairly decent processor (~2GHz dualcore) trying to decode a high bitrate 1080p stream.

Re:Extremely stupid

[somersault]

I think the point is that it is CPU dependent if you don't have any assistance from video hardware acceleration, as is the case if your video drivers are incomplete.

Re:Extremely stupid

[jonwil]

Part of the problem with hardware accelerated video decoding on Linux is that because Windows uses the accelerated video decoding to play back DRM protected media, the hardware companies cannot reveal how the video decoding part works (since it would presumably allow someone to grab the unencrypted-but-compressed video for various DRM protected video files by writing a windows driver or something)

Was there, nearly gone

[Jo Deisenhofer]

XvMC does only accelerate MPEG-2, and not many use it, because the de-interlacing you can get sucks. And for MPEG-2, you usually don't need hardware acceleration anyway.
nVidia, like ATI, are moving away from video overlays and have some pretty nice GPU-based video decoding built into their cards using the GPU (most of it probably implemented as shader programs).
But you can't use any of that with linux, you are basically down to hardware video scaling, which the newest cards no longer really support.
It is high time for a new, industry standard API for video. I hope that's what they are doing.

Re:Windows games

[WaroDaBeast]

I think you meant h.264 -- you were probably thinking about RS-232 for the number.

And yes, VLC Linux does support h.264 playback, but 1080p videos are likely to display stuttering if not GPU-accelerated: I tested it on my machine, CPU is an Athlon X2 5600+ and GPU is a Geforce 8800GTS; anything up to 720p was fine, but 1080p was unwatchable prior to installing nVidia Purevideo.


P.S.: Seems 1080i is fine too if not GPU-accelerated.

Re:1080p?

[Kugrian]

What does this message say? It doesn't display on my computer.

Re:Not 1 year

[sricetx]

If you are running Windows and using the manufacturer's drivers for a relatively recent (last few years) video card, then yeah, everything should be peachy. But if you are using open source video card drivers under Linux then good luck. Even with the proprietary Nvidia driver, highdef video playback can max out a fairly new CPU. http://www.mythtv.org/wiki/index.php/HD_Playback_Reports will give you an indication about the type of setup you need to get HD video playback to work.

Re:What about software?

[puto]

VLC works great for me on the windows boxes I use for my home media system. Plays HD contect fine.

The one in the living room is a Core2 1.8 with 1.5 of ram with an ATI 2400 HD card and no problems with HD acceleration in XP.

I do not game much, so this 59 dollar HD card has been great.

Workstation is same setup, with two gigs of ram and vista, no problems with HD video.

Server side is a linux box which runs headless. /all rooms have a pc attached to the tv /my guests can surf the web, watch movies, videos /or grab a wireless rumblepad and play any mame game of their choosing.

Re:Not 1 year

[neumayr]

Hm. My 2x2.6ghz AMD64 CPU can't do it. On Linux, with Nvidia's GPU driver.
Don't know if I've missed something, but it seems your video decoding is GPU accelerated.

Re:Not 1 year

[Hektor_Troy]

Uhm ... just read through that wiki entry a few times, and it gave me absolutely no information about the quality of the playback. Two of the comments in the "report" are usefull - the rest are quite literally useless when it comes to judging the playback ability. I.e

CPU: Intel Core2 Quad CPU Q6600 @ 2.40GHz
Speed: 2400.000 MHz
Memory total: 4050584kB
Kernel: 2.6.22-14-generic
Video codec/container: h264 / m2ts
Resolution: 1920x1080
Bit rate: 32469 kb/s
Comment: Blu-ray rip of "Casino Royale."
Media player: mplayer

Wauw. How about ... video frame rate vs playback frame rate? The above comment just tells me that the guy ripped Casino Royale. However, if the video frame rate is 29.97 fps, but only plays back at 19.87, the CPU isn't usefull for that particular application.

Re:Not 1 year

[DirkGently]

Dual-core 2.5Ghz AMD. In the same boat.

720p x264 works, though. I'm told there are MAJOR improvements in the new versions of ffmpeg that allow multi-threaded playback. I've been to chicken to upgrade my MythTV box to find out.

Gallium running out

[bugs2squash]

I though it was only a few days ago that /. reported that gallium is in short supply. Now we're blowing our precious reserves on frivolous video decoding.

Have some respect for Mother Earth...