Slashdot Mirror


Microsoft Patents GPU-Accelerated Video Encoding

An anonymous reader writes "Microsoft has just received a patent that grants the company the rights to GPU-accelerated video encoding, which may be the primary technology that takes advantage of the horsepower of the GPU in today's consumer applications. The broad patent covers tasks to perform motion estimation in videos, the use of the depth buffer of the GPU, to determine comprising, collocating video frames, mapping pixels to texels, frame processing using the GPU, and output of data to the CPU."

15 of 304 comments (clear)

  1. Extra Extra! by WrongSizeGlass · · Score: 4, Insightful

    A Graphics Processing Unit has been used to accelerate video!

    If this doesn't qualify as 'obvious' then we are all doomed.

    1. Re:Extra Extra! by autocracy · · Score: 4, Insightful

      It seems that the idea was apparent long before the patent came about. I think the underlying reason that we haven't seen it yet is that the tradeoff value wasn't present yet. The GPU must beat out the CPU by a sufficiently wide price and performance margin for the workload before anybody bothers with specialized code for it.

      In fact, this is a math coprocessor revisited. Remember those?

      --
      SIG: HUP
    2. Re:Extra Extra! by onionman · · Score: 4, Insightful

      Why would it be obvious that hardware designed to accelerate 3d rendering - transformation, lighting and rasterisation - can accelerate the compression of video frames?

      It seems that you are 'obviously' wrong.

      It's seems incredibly obvious to me. Of course, I've worked on FFT code for Cray vector units which were around a long time before 2004. If you can't see the relationship between vector processing, FFTs, and any form of video compression/display, then perhaps you shouldn't be in charge of determining what is "obvious" regarding this particular patent.

      I have long felt that our patent system is ridiculous because it allows such silly patents. If something is obvious to an expert in the field, then it shouldn't be patentable.

    3. Re:Extra Extra! by Jeremiah+Cornelius · · Score: 5, Informative

      We saw this at SIGGRAPH for YEARS before 2000.

      I think that Be Computer had colliding patents - not to mention SGI and nVidia.

      --
      "Flyin' in just a sweet place,
      Never been known to fail..."
    4. Re:Extra Extra! by dgatwood · · Score: 5, Insightful

      You're being sarcastic, right? Why would a glorified vector engine be useful for doing video compression, which is basically lots and lots of vector math? It's so obvious that anybody with even basic knowledge of video compression would immediately understand how the two problem spaces map onto one another with no instruction whatsoever.

      It's so obvious that ATI released software to do it within a year of when that patent was first filed, which means they were working on it at least a year before that, which means that multiple people independently came up with the idea at the same time, which means it is obvious.

      Heck, other companies had already been doing this, and even held patents on it five years earlier. Okay, so texture compression and video compression aren't quite the same thing. One deals with a single image, one deals with compressing a series of images.... Yeah, that's not obvious to anyone who has never seen someone make a flipbook during class in elementary school.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    5. Re:Extra Extra! by onionman · · Score: 4, Interesting

      No, but providing someone with a unit to calculate (for example) a transformation doesn't mean that you give them an efficient way of computing FFTs. Of course if you give them a general purpose matrix-vector multiplier then it does. In 2004 a graphics card used a fixed function unit, and today it uses a general purpose one. Assumptions about how obvious it is that other applications can be performed don't carry back to previous generations of the hardware.

      I do believe that you are arguing in good faith and that you are not a troll, and I understand your argument. Here are the things which I believe were obvious (to general practitioners in the field) in the 1990s:

      1. Video display and video (de)compression are essentially large linear algebra problems which lend themselves to vector processing.

      2. Video display hardware will continue to improve.

      3. Eventually video display hardware will become sufficiently powerful to perform video (de)compression.

      The reason I believe that those were all obvious to practitioners in the field in the 1990s is because they were obvious to me in the 1990s and I wasn't even a specialist in the field. (I was, however, working on large number-crunchy stuff). I would suspect that the true experts in those fields were well aware of all three of the above points even in the 1980s.

      I'll have to end my participation in this thread, now, and get back to real work...

    6. Re:Extra Extra! by jedidiah · · Score: 4, Informative

      > It may be obvious now, but Microsoft applied for this patent in 2004, well before stuff like OpenCL and CUDA came around.

      Nevermind OpenCL. How about things like PureVideo, VDPAU and xvmc?

      Accelerating video with the video card is about as obvious as it gets.

      This sounds like YOU patenting something: Visualize something that's obvious but hasn't quite gotten here to do hardware limitations and then rush off to the patent office.

      The only difference between you and Microsoft is that Microsoft has lawyers on retainer.

      --
      A Pirate and a Puritan look the same on a balance sheet.
  2. Patenting the mere use of a product? by EmagGeek · · Score: 5, Insightful

    Are they serious? This is virtually the same thing as someone inventing a car and me winning the patent on "driving cars."

  3. Nothing to see here, move along. by Anonymous Coward · · Score: 5, Insightful

    Oh look, another patent that shouldn't have been granted. The only thing the modern patent system is good for is buying new boats for patent lawyers. Does this still surprise anyone?

    1. Re:Nothing to see here, move along. by thePowerOfGrayskull · · Score: 4, Insightful

      I'm sort of afraid of the mayhem that will occur a bit before the current system will fall apart

      Non-indemnified hardware running rampant! Patents running naked in the streets!

  4. MS making their own thicket? by ciaran_o_riordan · · Score: 4, Insightful

    This patent mightn't change much, but it's the weight of the hundreds of patents that's spoiling the AV field.

    Microsoft is a member of MPEG-LA, but they pay more royalties than they make from the organisation, so they're probably eager to make their own AV thicket.

    * http://en.swpat.org/wiki/Microsoft
    * http://en.swpat.org/wiki/MPEG_LA
    * http://en.swpat.org/wiki/Audio-video_patents

  5. Enforceable? by airfoobar · · Score: 5, Interesting

    The patent was filed in 2004, and there must be loads of prior art. Companies such as Nvidia and ATI have had GPU-accelerated video encoders for years now.

    Regardless, this patent should never have been granted. It's all because of the patent office's massive backlog, and their decision to accept every random patent to reduce it.

  6. Re:2004 by samkass · · Score: 4, Informative

    Before we get a million "Adobe does this!" comments RTFA: "Microsoft applied for the patent titled "Accelerated video encoding using a graphics processing unit" in October 2004"

    Far as I know no one was doing this in 2004

    Still not enough information. Patent claims can change between the original filing and the version that gets granted by amending the patent application. It's done by trolls... get a patent application going and keep it in limbo. Someone else comes to market with something cool, and you add it to your patent application. If it gets approved, viola! You have a patent that is "back-dated" years before the invention hit the market.

    I'd be curious to see exactly what the patent said in 2004 and compare that to the then state-of-the-art.

    --
    E pluribus unum
  7. Re:Badaboom? by wagnerrp · · Score: 4, Informative

    This patent is specifically for running motion compensation calculations on the GPU, and everything else on the CPU. Badaboom runs everything on the GPU, so the patent does not apply.

  8. Re:Badaboom? by DrgnDancer · · Score: 5, Insightful

    What is confusing? Microsoft does something. Microsoft applies for a patent on that thing. A patent lawyer who knows very little about the tech in question, has about 600 applications he's currently supposed to be processing, has been instructed that he can't work overtime this week by his boss, but also that he is too far behind on his portfolio and needs to catch up, and who doesn't make near as much as his buddies from law school do to begin with, looks at it. He thinks "I don't even know what half of these words *mean*", then notices that Microsoft filed the patent. Through his haze of pain and frustration he dimly remembers that Microsoft is an "Innovative and economy driving company" and says "fuck it." He hits the "Approve" button.

    His boss is happy because his numbers are better this week, and there is no real penalty for approving patents that later get overturned. Even assuming that Microsoft ever attempts to defend the patent rather than just threatening small companies with it in hopes that they'll cave without a court battle.

    The things currently wrong with the patent system which this story demonstrates:

    1) Patent attorneys often don't understand the tech they are expected to review. This is less of a problem with "real" patents, since the device being patented is just that. A device. If it does what it says it does, in the way it says it does, understanding why isn't all that important. Software is essentially algorithms. If you don't understand them, then judging their uniqueness is difficult.

    2) The reviewers in the patent office are phenomenally overworked right now. There are literally tens of thousands of applications backed up. I saw some patent official guy at the end of the Bush administration say that if all applications stopped, right then, he could maybe catch up in a year or two. I don't imagine it's gotten better. Both Bush and Obama have authorized more reviewers, but it seems to be like filling the ocean with a teaspoon.

    3) Patent reviewers make a fraction of what patent attorneys in private practice make. This means that they're always looking to get out and get into private firms. Probably not all of them, but like any rational human, most want to make more money and get more respect.

    4) There is no real penalty for screwing up. Most patents never get defended in court, because the companies that own them mainly used them as bargaining chips, or to threaten smaller, defenseless, companies. Even if the patent does go to court, it'll take years to invalidate, and no repercussions fall on the approver.

    Eliminating software patents would, in one stroke, alleviate or eliminate two of these four problems. Probably the most serious two. It'd be awful nice if it happened. The alternative is probably the whole system collapsing under its own weight eventually.

       

    --
    I don't need a million points of light, just two points of multi-mode fiber and a 10 Gig-E router.