Slashdot Mirror


USPTO Grants Google a Patent On MapReduce

theodp writes "Two years ago, David DeWitt and Michael Stonebraker deemed MapReduce a major step backwards (here are the original paper and a defense of it) that 'represents a specific implementation of well known techniques developed nearly 25 years ago.' A year later, the pair teamed up with other academics and eBay to slam MapReduce again. But the very public complaints didn't stop Google from demanding a patent for MapReduce; nor did it stop the USPTO from granting Google's request (after four rejections). On Tuesday, the USPTO issued U.S. Patent No. 7,650,331 to Google for inventing Efficient Large-Scale Data Processing."

19 of 191 comments (clear)

  1. Re:!do no evil by sakdoctor · · Score: 4, Insightful

    They already burned their karma adding the "fade-in" menu bar.

  2. Re:!do no evil by astrashe · · Score: 3, Insightful

    This sounds more stupid than evil, which is interesting, because Google doesn't do obviously stupid things very often.

    The patent won't do them any good, because it won't stand up in court. They could use it to attack someone small -- an open source developer who would have to back down because they couldn't handle teh legal fees -- but they don't have much of a history of that sort of thing, and there's no reason to think they would in this case, either.

    It won't do them any good at all against someone big -- MS and Bing, for example -- because MS would have good lawyers who could demonstrate prior art to a court.

    So what's the point?

  3. will be interesting to see if they use it by Trepidity · · Score: 3, Insightful

    A somewhat optimistic guess is that they'll be restricted to using this defensively. Are they really going to sue Hadoop, the open-source implementation of MapReduce? Hadoop not only implements a version of MapReduce, it even uses its name, so is not at all coy about being a direct infringement of this patent. And yet, I would be surprised if Google sued them, or the many people using it. They certainly haven't said anything yet, as far as I can find--- when things like Amazon Elastic MapReduce were launched, I can't find record of Google saying, "hey, you're stealing our tech!"

  4. One of Many, Many Google Patents by Grond · · Score: 3, Informative

    Google has at least 173 issued patents as well as over two hundred pending applications. That doesn't include the various patents (such as the PageRank patent) that it is the exclusive licensee for but does not actually own (Stanford owns it). Google's software patent strategy dates back to at least 1997, when it filed this application, which actually predates the PageRank application.

  5. Re:!do no evil by astrashe · · Score: 5, Insightful

    Isn't that awful? I can't understand why they did it.

    Moving stuff on web pages sucks. Especially on that web page.

    The bad thing isn't the fade in itself. It's that Google used to be run by people who knew what sucked and what didn't. Now it seems like there are people who don't know in positions to call some shots. It's a bad omen.

    They're probably about 10 years away from their own version of Microsoft's "Bob".

  6. Meaning for Hadoop? by harmonica · · Score: 5, Funny

    Does this endanger the Hadoop project, or projects using Hadoop? Its MapReduce implementation is a rather crucial part.

  7. Re:google is getting evil by Dr.+Spork · · Score: 4, Funny

    Nah, they got this patent so that an evil company can't swoop in and patent the stuff, and prevent others from implementing it without charging crippling royalties. Right? Right??

  8. A quick idea for patent reform by Daniel+Dvorkin · · Score: 4, Interesting

    We're probably never going to get rid of software patents, odious as they are; at this point there are too many enormous players, of which Google is not at all the worst offender, with way too much invested in them. But it occurs to me that one change to patent law that might be politically feasible, and which would really help cut down on clearly frivolous patents like this one:

    If any claim in the patent is held to be invalid, the entire patent is invalid.

    Claim 1 of the patent is simply an arcane, legalistic description of the operation of pretty much every parallel processing algorithm ever. Some of the subsequent claims actually do describe novel, non-obvious, and useful ways of handling large data sets across multiple processors. If the patent were restricted to these claims, well, it would still be a software patent and therefore Evil, but it might at least have some claim to promoting "the progress of science and the useful arts."

    In general, it seems like this would make both patent trolling, and big companies like Google lawyering small independent developers to death, a little more difficult.

    --
    The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
  9. The usual /. patent question - by Janthkin · · Score: 4, Informative

    - did the submitter actually read the claims, before asserting that it was obvious and/or anticipated?
    Here's claim 1 (it's a monster): 1. A system for large-scale processing of data, comprising:
    a plurality of processes executing on a plurality of interconnected processors;
    the plurality of processes including a master process, for coordinating a data processing job for processing a set of input data, and worker processes;
    the master process, in response to a request to perform the data processing job, assigning input data blocks of the set of input data to respective ones of the worker processes;
    each of a first plurality of the worker processes including an application-independent map module for retrieving a respective input data block assigned to the worker process by the master process and applying an application-specific map operation to the respective input data block to produce intermediate data values, wherein at least a subset of the intermediate data values each comprises a key/value pair, and wherein at least two of the first plurality of the worker processes operate simultaneously so as to perform the application-specific map operation in parallel on distinct, respective input data blocks; a partition operator for processing the produced intermediate data values to produce a plurality of intermediate data sets, wherein each respective intermediate data set includes all key/value pairs for a distinct set of respective keys, and wherein at least one of the respective intermediate data sets includes respective ones of the key/value pairs produced by a plurality of the first plurality of the worker processes; and
    each of a second plurality of the worker processes including an application-independent reduce module for retrieving data, the retrieved data comprising at least a subset of the key/value pairs from a respective intermediate data set of the plurality of intermediate data sets and applying an application-specific reduce operation to the retrieved data to produce final output data corresponding to the distinct set of respective keys in the respective intermediate data set of the plurality of intermediate data sets, and wherein at least two of the second plurality of the worker processes operate simultaneously so as to perform the application-specific reduce operation in parallel on multiple respective subsets of the produced intermediate data values.

    That's one heck of a detailed claim. Infringement would require some effort; anticipation (every limitation appearing in a single document, arranged in the same manner as the claim) is unlikely.

  10. Re:Defensive patent by blee37 · · Score: 4, Insightful

    It is not true that if Google doesn't patent it, a troll will. A technique that is well known, such as MapReduce, is the property of the general public and is unpatentable. Any technology that has been sold or in use for over a year is unpatentable.

  11. Re:google is getting evil by wizardforce · · Score: 4, Insightful

    Behold: the one true undeniable positive trait of the current broken patent system. Keeping horrible ideas expensive.

    --
    Sigs are too short to say anything truly profound so read the above post instead.
  12. Re:Awarded? by blee37 · · Score: 3, Informative

    All documents at http://patft.uspto.gov/ are issued patents.

  13. Re:!do no evil by m.ducharme · · Score: 3, Insightful

    The point is probably to create and keep a nice big portfolio of patents to be used the next time Google gets sued for patent infringement. It's common practice for big tech firms (and others, of course) to hold a reserve of patents at the ready in the event that they need to defend against a patent suit. The aggressor company sues for infringement, the defender digs up a few patents that the aggressor is violating, and they settle out of court for a mutual licensing agreement.

    Of course it's ridiculous, and sounds stupid, but it's a symptom of the broken patent system, not a peculiarity of Google.

    --
    Rule of Slashdot #0: You and people like you are not representative of the larger population. - A.C.
  14. US patent office workers should be ashamed... by BuddaLicious · · Score: 3, Interesting

    how do you get a patent awarded on something that has already been released as "open source" (Hadoop)

    This does not add up, either Hadoop is not really open source, or US patent office are as FCKING stupid as EVERYONE seems to think they are.

    Come on people, don't you get tired of the shame of working for such an organization....don't you want to see freedom and democracy restored to the world..?>?>

  15. Re:Defensive patent by Target+Practice · · Score: 5, Insightful

    "A technique that is well known, such as MapReduce, is the property of the general public and is unpatentable."

    Someone should really let the patent clerks in on that secret...

    --
    There's a 68.71% chance you're right.
  16. Re:!do no evil by Animaether · · Score: 4, Insightful

    The fade-in is nice. Not so much because it's a fade-in (which is just visually more pleasant than an instant-display), but because you can visit www.google.com and get a very clean page (google logo, search field, and currently a Haiti relief notice), and just type away (as focus is set to the search field) and be done with it. This is very much like how google.com -was- in the very early days.

    If you want to access any of the other services that google have started to offer since then, you can move your mouse anywhere within the screen and hey presto those options become available to you. If you don't need them - why clutter up the screen with them?

    You can always customize your own google page and set that as your bookmark/start page/whatever and display exact what you want to have displayed from the get-go.

    If anything, the change from direct URLs to google redirects at some point is what I find most annoying. I guess it's what enables them to track clicks better / present "We believe this page is dangerous for your health"-warnings, etc. and I can see how that can be good for them as a business, and for users who go clickhappy on fluffy little bunnies promising them cash. But it annoys me that I can't just 1. google for something, 2. recognize the right place, 3. right-click the result and get the basic URL out of it anymore. Now, I just get this (for slashdot):
    http://www.google.com/url?sa=t&source=web&ct=res&cd=1&ved=0CBgQFkAA&url=http%3A%2F%2Fslashdot.org%2F&rct=j&q=slashdot&ei=KAtXS8CCLeLMQAeSx8CbDg&usg=AFQjClHLEL_tF-6ZxylM44KJH54-gaJRnQ&s1g2=U223qDAEXHFbHyOw_p2PzQ

    wtf.

    I'd much prefer they put the actual URL in the link, and let their redirect flow through an onClick.. yeah, they'd lose the javascript-disabled lot.. tough.

  17. Re:!do no evil by kripkenstein · · Score: 3, Interesting

    Why do you think the recent Google-China issue is either all about Google having a conscience or all about Google acting in their own self interest? It's both, and it's complicated.

    For one thing, having a conscience is in Google's best self interest. Public image is crucial for a company like that.

    For another, companies Google's size (or any size, if they are competent) don't make decisions based on 1 factor. They take into account many, many factors, including conflicting ones, and they arrive at a decision. In this case, clearly both the conscience issue was a factor as well as the self interest factor.

  18. Re:!do no evil by MechaStreisand · · Score: 3, Informative

    I've noticed that when you do a google search and mouseover the links, it shows the direct link in the status bar, but that is a lie. If you look at the actual URL in the link properties, you'll see that it redirects through google. Sneaky.

    --
    Disclaimer: IANAL. This post is, however, legal advice, and creates an attorney-client relationship.
  19. Defensive Patent Portfolio? by shentino · · Score: 3, Insightful

    I'll reserve judgement until this patent is involved, offensively, defensively or otherwise, in litigation.

    Google has got a good reputation so I'm not as quick to condemn them as I am to condemn Microsoft which has a PROVEN track record of evil.

    It's entirely plausible that this patent is part of a defensive patent portfolio whose sole purpose is to protect Google.

    And considering the zany IP landscape, if anyone's going to have a patent on this, I'd rather it be Google than anyone else. If Microsoft had this club in their arsenal you can bet your bottom dollar they'd make their assault on Tom-Tom look like a puny peashooter.