Slashdot Mirror


Apple Patent Blocking PNG Development

Daniel writes: "Apple has a patent (U.S. Patent No. 5,379,129) on compositing a source and destination image using a mask image. This patent appears to read on alpha channel transparency, which the PNG and MNG file formats use. APPLE has declared in their patent statement to the Scalable Vector Graphics Working Group that their patent is only available for RAND Licensing. Since this patent appears to read on the PNG file format, Apple is hampering work on the PNG and MNG file formats. Perhaps Apple would like to clarify this situation by explicitly stating that this patent does not cover the PNG and MNG file formats or by RF Licensing their patent to the PNG and MNG development groups. Alternatively, the PNG and MNG developers are asking people to submit prior art in order to invalidate Apple's patent. SGI in particular appears to have prior art with their 'blendfunction.' Make sure the prior art you submit is older than May 08, 1992, the filing date of Apple's patent."

20 of 357 comments (clear)

  1. You think THAT's bad... by Tsar · · Score: 5, Interesting

    You know how, when you type the last character that'll fit on the last line in a text window, the top line disappears, all the other lines move up one, and the cursor appears in the first position of a new blank line?

    IBM has a patent on that.

    1. Re:You think THAT's bad... by Tsar · · Score: 4, Offtopic

      However, [IBM] hasn't tried to *hamper development* of projects using this strange and unusual UI covention.

      No, but they've definitely used it to their advantage. I came across this information around a decade ago, so forgive me if I'm overly broad or forgotten some of the details, but this is how I understand IBM operated during the original Attack Of The Clones.

      Let's say you and I decided back in 1986 to start building IBM compatible PC's. Hey, everyone's doing it, we'll sell 'em cheaper than IBM and make a fortune. So we get the board and case suppliers online, license our own version of the Phoenix BIOS and negotiate bundling licenses for MS-DOS, and we're underway.

      Pretty soon after getting started, we get a nice little packet from IBM's legal department which contains photocopies of a few PC-technology-related patents held by IBM, and a polite letter wishing us success in our venture and inviting us to come on in to negotiate a patent-licensing agreement. You and I, being young turks who've never dealt with Big Blue, decide that IBM isn't going to bother with us over a few patents, and blithely continue our little operation.

      Some time later (reports vary), there's a knock on our door. Several suits enter, one of them carrying a largish briefcase. They introduce themselves as legal representatives of the IBM Corporation, and in the course of time reveal the contents of the case. In it are complete copies of over four hundred patents with direct application in the construction of a fully IBM-compatible PC, covering everything from the ISA bus to the way the cursor moves when you hit the Enter key. They explain the situation to us, and finally dawn breaks upon our fevered brows.

      We sign an agreement granting us permission to use any and all patents involved in PC construction, in return for a nice healthy royalty to IBM for every PC we make. We also sign a non-disclosure agreement which states that we will not only keep the agreement confidential, we will keep the existence of the agreement confidential.

      Thus, for several years, IBM made money from every PC ever made, whether it had IBM on the label or not. I assume the patents in question have expired by now, but IBM is a technology-creating machine even now, and a large chunk of their revenue still comes from royalties.

      Side note: I fully support this kind of use of intellectual property. If I create something and someone else is making money directly from my creation, I should profit as well. If someone is using my creation for free, however, that's another kettle of fish, and I lack room in these margins to deal with that issue fully.

  2. Re:Hmmm by melquiades · · Score: 5, Insightful
    Keep in mind:
    • They are a company; their business is making money, not being cool (except to the extend that being cool helps business).
    • They are publicly traded, so they have a legal obligation to their stockholders to do their best to make money, even at the expense of being cool.
    • Making money means pursuing every strategy available to them to its fullest extent, and taking advantage of whatever the law, the world, and circumstance gives them.
    • Sometimes this means doing cool things, like open-sourcing the core of their new OS.
    • Sometimes the means doing crappy things, like abusing an overinflated body of intellectual property law.
    Of course, if they really do put the brakes on PNG (and let's wait to hear all sides of the story), and if that hurts their business (e.g. it hurts their good standing with their customers and developers), they won't do it. So maybe sending them a polite but firm e-mail asking for an explanation isn't a bad idea.
  3. FUD? by crayz · · Score: 5, Insightful

    Has Apple actually made any threats on this, or did someone just find this statement and see it as a possible precursor to a threat?

    PNG has been around for a while now, and Apple has never(AFAIK) said anything about it in the past. I really don't see how this changes anything.

    Now we're gonna get all these slashbots telling us how Apple is evil and everyone should boycott OS X/Darwin because of this, when they really haven't done anything. Chicken Little ought not be the standard tone of every Slashdot story.

    1. Re:FUD? by mav[LAG] · · Score: 5, Informative

      There is nothing colossally more wrong with being able to patent software than there is with patenting hardware.

      There's a huge difference between software innovation and hardware innovation. Software innovation is sequential and complementary. Software development is not a zero sum game. Developers have always used the work of others to build, improve and enhance functionality. In the open source and Free Software worlds, this works through availability of source and the distribution licenses. In the commercial worlds, it works through user groups, conferences and special interest Web sites (like this one) where people can share ideas and code.

      If I make a living by it why should I spend time developing software if I can not protect my self from people ripping me off???

      Be my guest. Discover a new algorithm without any access to the work of others (I'd be impressed with that straight away) and then patent it. Oops. Is it too expensive? Darn. It seems only the big companies can afford to patent XORing a bitmap with the background to achieve transparency, something I thought up independently when I was 12. And are they protecting themselves from others ripping off this "innovation". Nope - they use patents for attack, not defence. So smaller developers can't write software even when protected by the patent system.

      If a commercial software developer comes up with a clever way of coding something he has a right to patent it like any other inventor.

      This is a great idea - in theory. The problem is that there are no "clever ways of coding something" which don't boil down to techniques which have been used for years: linked lists, hash tables, look up tables, mathematical operations, bitwise operations and basic algorithms used on basic data structures. It's easy to check this too - pick any software patent held by say IBM, get it translated into English or pseudocode and it will be a trivial operation. Guaranteed.

      Open source organizations will have to live with the fact that if some technology is patented by a commercial organization they can not use it free of charge and without permission.

      Do you mean technology or software specifically? If software, then commercial organisations should not be using free or open source software at all. Come to think of it, they shouldn't be using the Internet either.

      Pay up or bugger off that is the rule of the game. What Open source organizations can do is either come up with alternatives and/or they can stop whining about patents and try to beat Commercial organizations at their own game by patenting software them selves.

      Software innovation doesn't happen when development is hampered by a mass of patents. In the non-software worlds, the inventor needs to recoup his costs and thus I can see the need for a limited time of protection. But in software, all that happens is those that can afford to hold patents use them as a weapon against those that can't. And very few true innovations happen in large patent-holding companies. It's the garage operations, the one or two guys in their back rooms who come up with new stuff all the time.
      And why should non-US programmers pay license fees to someone like IBM in the US? What gives them the right to tell me whether I can or can't write software in a country 10 000 miles away?

      --
      --- Hot Shot City is particularly good.
  4. Prior art? Yeah, here's some prior art. by Ryu2 · · Score: 5, Informative

    Try Porter and Duff's paper published in 1984 introducing image composition that started it all!!!!

    --
    There's 10 types of people in this world, those who understand binary and those who don't.
  5. Obvious and WAY older than 1992 by spitzak · · Score: 5, Informative
    I have a book printed in 1990 (Foley & van Dam Computer Graphics Principles and Practice, first edition), the references papers that talk about it.

    Every program that combines images and works with true color uses this. It is impossible not to, the algorithim is totally obvious. True color images (ie where the numbers represent levels of red, green, blue, rather than be indexes into a color pallette) were in common use in advanced visualization and simulations in 1980, such as Evans & Sutherland flight simulators. I also saw photo touch-up software that could duplicate a portion of the image and put it somewhere else in 1979, and I believe it must have used this, as otherwise the edges of the cut piece would be visible.

    PORT84, Porter, T., and T.Duff, "Compositing Digital Images," SIGGRAPH 84, 253-259.

    This is the paper most-often cited, however I think it's main addition is the enumeration of compositing operators and the introduction of "premultiplied" images. Before that I believe non-premultiplied was used as that was the more obvious solution. Also PNG does not use premulitplication.

    Even if Apple is going to be a pita about this, it does not affect PNG, as the file format itself does not do any compositing, it just stores a 4th "color" called the alpha. So I would not worry about it there. However Photoshop and Gimp and the in-house program I write for Digital Domain uses this, and about six thousand other pieces of commercial and free software.

    1. Re:Obvious and WAY older than 1992 by KFury · · Score: 4, Informative

      "Even if Apple is going to be a pita about this, it does not affect PNG, as the file format itself does not do any compositing, it just stores a 4th "color" called the alpha. So I would not worry about it there."

      PNG isn't just a file format. It's an encoding and decoding mechanism. The encoding and decoding treat the alpha channel as an alpha channel, not a 'fourth color'.

  6. Outdated, irrelevant facts w/o more info by 90XDoubleSide · · Score: 5, Interesting
    The patent statement was last updated in July, and in October Apple made a public statement that they would no longer support any patent agreement for web standards except royalty-free. Does anyone else see problems in the reporting here?

    Who honestly believes Apple would try to milk this almost certainly invalid patent? What do they gain by going after PNG? I think everyone will agree that web standards help Apple, and they are not going to do something against their best interest.

    And what is up with /. posting stories about months-old facts with no new developments anyways? I think it is good for /. to bring this issue up and get Apple to clarify their position, but listen to the report: "APPLE has declared in their patent statement to the Scalable Vector Graphics Working Group that their patent is only available for RAND Licensing." They make it sound like it just happened! And while I'm complaining, why is "Apple" in all caps ;)

    --
    "Reality is just a convenient measure of complexity" -Alvy Ray Smith
    1. Re:Outdated, irrelevant facts w/o more info by Gogo+Dodo · · Score: 5, Funny
      You knew this story was going to get posted. It has all of the hallmarks of an automatic post: big, bad public company that doesn't do GPL very well (+2 for Apple, +5 for MS) sues (+1) GPL group (+1) over patent (+5). Ding! Ding! Ding! Automatic post...

      The only thing missing is the Linux reference.

  7. Obligatory link to the patent in question by bjk4 · · Score: 5, Informative
    Patent 5,379,129

    CLick the "Image" button to see the lovely diagrams. There are a few items this patent does NOT cover, as explicitely mentioned in the text. This patent does not cover additional channel information, like alpha channels. It only covers a seperate, full color, mask image that is used to mask off the source image.

    I have a few questions:
    • The patent mentions that a black pixel codes for source image. Does this mean that if I decide the opposite, I can avoid royalties?
    • The patent mentions it uses full color mask images. Is a greyscale or black + white image considered a full color image?


    If the patent does not cover greyscale images, then not all sanity is lost!

    -B
  8. Prior Art by corebreech · · Score: 5, Informative

    From the Second Edition of "Principles of Interactive Computer Graphics", by William M. Newman published by McGraw-Hill in 1979:

    We find on page 222 the pseudocode for the WriteColor procedure:

    procedure WriteColor(var ColorRaster: raster; x, y: integer);
    var i, j: integer;
    begin
    for j := ColorRaster.ymin to ColorRaster.ymax - 1 do
    for i := ColorRaster.xmin to ColorRaster.xmax - 1 do
    if GetPixel(ColorRaster, i, j) <> transparent then
    SetPixel(FrameBuffer, x+i, y+j, GetPixel(ColorRaster, i, j))
    end;

    And there was a First Edition published in 1973, for all I know it's in there too.

    BTW, there isn't anything Bill Atkinson did for Apple in QuickDraw that isn't spelled out in this book.

  9. Re:what if by Graff · · Score: 4, Insightful

    Have you read this linked page? Have you read any statements made by Apple that they are using this patent to prevent you from using the PNG format?

    If you look at that page, you will see that Apple does offer a license for the patent as part of the SVG 1.0 patent which is being put together. It looks like they are just being cautious in order to keep their rights to the patent intact, but still allow it to be used for PNG and SVG.There are plenty of greedy corporations out there and Apple may in fact be one, but don't assume they are without looking at all the facts. Take a look at the sites listed in this article, write to Apple and ask questions, express your thoughts to Apple. If you are not then satisfied with what you see then you can make as much noise about it as you want. Making a big deal about this just because someone has implied wrongdoing on Apple's part is just being a follower.

  10. Re:Time for an Apple boycot!? by sporty · · Score: 5, Informative
    Talk about FUD. Suing over interfaces has been known for a long time. I know 2 companies on the web battling it out right now just because they are competitors but one has a patent. Look at MS vs Apple, Apple vs Xerox (I swear there was a case). Don't make something so general so specific.


    Also think of the confussion it causes when two products look identical. It should let the opensource community do this and not allow companies to do it? What's the insentive?


    As for the one-click thing, please. They debuted one-click, so what. They are using, or at least were, using a technology. Don't pick on their website just 'cause they licensed a technology from another company that has a patent on it. What's cheaper, lisencing or going to court? Pick on Amazon for creating such a stupid patent.

    And as for the cube-NDA contract issue, please. Gimme a friggin' break. So what if Apple likes to hide their new products until they are ready to do it the way they want. The employee signed a contract that he won't leak information from Apple. What if a competitor such as Dell caught wind and released something just as cool, but earlier. Great, Apple would get shafted 'cause of some ass employee who can't play nice.


    As for the BSD crack you made, they are using opensource software and giving back the modified version, Darwin for free. Don't be an ingrate and say "Well, a patent (mind you invalid) exists, they get people to stop mimicing their interface verbatim, use OSS and recontribute while making their OS even more stable than before, so apple reeks." statement. Maybe we should step all over Apple and hack QuickTime, which uses a kick ass codec and try our best to drive the company into the ground.


    You've just spread extreemist FUD about a company protecting its rights. piss me off...

    --

    -
    ping -f 255.255.255.255 # if only

  11. Re:Prior art? Yeah, here's some prior art. by wray · · Score: 5, Insightful

    I posted this before as AC, but since it didn't get any points, I thought no one would see it, and I _do_ think it might help.

    Actually, Alvy Ray Smith with Ed Catmull created an alpha compositing system in 1978 while Ed Catmull was doing a paper for SIGGRAPH '78.

    He states this in his paper "Alpha and the History of Digital Compositing" in August 1995.

    He says that his earliest dated documentation he has for that code is dated January 13, 1978. He specifically showed compositing an alpha image on a background which should just be like another image. I hope this helps

    --
    Guess what? I got a fever! And the only prescription.. is more cowbell!
  12. Now this is just silly by Sycraft-fu · · Score: 5, Informative

    As other posters have mentioned:

    1) This is obvious.

    2) There is prior art.

    So even if Apple decided to try and enforce it, it'd get shot down however:

    3) Apple has already allowed royalty free use of this patent.

    Seriously folks, this story is just silly. Think for a moment how many things out there use multi level alpha transparency. All 3d cards from the Voodoo on do, Windows does in movie file formats and in the UI in XP, a bunch of X WMs do. If Apple tried to enforce this they'd have legal teams from all over after them, fact aside that they've already said they won't.

    Just because a company has a stupid patent doesn't mean they will try and enforce it.

  13. How soon we forget our history. by Per+Abrahamsen · · Score: 5, Insightful

    Have we already forgot the GIF fiasco?

    It was well known that de-facto standard for file compression in the net, "compress", was covered by the Unisys compression patent. However, showed no interest in enforcing the patent outside hardware (modems and the like), and would informally tell people who asked that.

    Nonetheless the FSF insisted on having a patent free compression format for use by GNU, and eventually settled on gzip. This made some people angry, it was annoying to have to deal with a new compression format, and they claimed the FSF was seeing ghosts and that Unisys would never change their policy.

    However, as we all know, Unisys *did* change their policy, allthough the target wasn't compress (which meanwhile had lost most of its markedshare to gzip), but GIF which used the same algorithm internally, and had become a big thing thanks to the WWW. Thankfully, at that time we had gzip, and could create PNG fast using the same code.

    The morale "they haven't enforced the patent yet" provide false security. Companies don't enforce software patents until it become economically profitable to do so, typically when the algorithm is in so common use that it will be expensive to switch to an alternative. What we need is a legally binding promise not to enforce the patent.

  14. Only applies to triple alpha channels by BitwizeGHC · · Score: 4, Informative

    The patent only applies to triple alpha channels, i.e., where the alpha channel is itself an RGB value, and the source and destination images are blended channel by channel according to the RGB values in the triple alpha channel.

    It seems like an obvious extension of alpha blending (which was around for a while and is referenced in the patent) but that didn't stop Apple. HURR! WE R SMRT!

    --
    N4st0r, trixx0r h0bb1tz0rz! Th3y st0l3 0ur pr3c10uzz!
  15. Re:1992? by hearingaid · · Score: 4, Interesting

    1992 is the filing date.

    It no longer matters under U.S. law when they claim invention, under the new patent regime, which is since 1987 IIRC. (The U.S. in the eighties amended its patent and copyright laws to make them conformant to international standards.)

    As another poster pointed out, they're allowed public disclosure of the content of the patent for a year before their filing date. Any earlier disclosure and they themselves are prior art.

    However, for prior art from other companies or from private individuals, the day before the patent is filed is early enough to qualify as valid prior art. There was an interesting case with the patent on the Magic: the Gathering collectible card game, as TSR released a competitor to Magic about four days before the patent was filed. Hasbro now owns both companies, but I believe Steve Jackson Games was still able to use the TSR game as prior art to knock down the collectible card game patent.

    Yes, the U.S. Patent Office lets you patent the rules to games. No other patent office in the world does. There are worse things than software patents out there.

    --

    my old sig used to be funny, but then slashcode ate it and now it's not funny anymore

  16. It is specifically not alpha blending. by Nindalf · · Score: 4, Informative
    From the patent:
    Compositing can also be used to "blend" two images by controlling the degree to which the two images are merged or averaged. This is often done by a method called "alpha channel blending" in which an 8 bit alpha channel controls the blending of two 32 bit RGB images.

    However, while these methods have been useful, they are quite rigid and inflexible in accommodating images of various colors and bit depths[...]


    Alpha blending is directly contrasted to their method in the patent itself. This is no threat to the patent-free status of PNG or MNG.