Slashdot Mirror


Khan Academy Seeks Patent On Education A/B Testing

theodp writes: The Education Revolution will be patented. USPTO records show that Khan Academy is seeking a patent for Systems and Methods for Split Testing Educational Videos. From the patent application: "Systems and methods are provided for comparing different videos pertaining to a topic. Two different versions of an educational video may be compared using split comparison testing. A set of questions may be provided along with each video about the topic taught in the video. Users may view one of the videos and answer the questions. Data about the user responses may be aggregated and used to determine which video more effectively conveys information to the viewer based on the question responses." Now it's up to the USPTO to decide if something like the test and control studies conducted 40+ years ago (pdf) by the PLATO system to measure the effectiveness of different teaching methods would count as prior art. In response to an earlier post on Khan Academy's pending patents on learning computer programming and 'social programming,' Slashdot user Khan Academy said that the nonprofit is using patents for good, so not to worry.

49 comments

  1. Uh huh... by waspleg · · Score: 4, Insightful

    Gandalf: Don't... tempt me Frodo! I dare not take it. Not even to keep it safe. Understand, Frodo. I would use this ring from a desire to do good... But through me, it would wield a power too great and terrible to imagine.

    Some how I think Sal Khan is less high minded than Gandalf...

    1. Re:Uh huh... by TWX · · Score: 2

      Yeah, I can only think of a couple of instances when patents were essentially opened to everyone, both of them automotive. The first was when Volvo invented the three-point seatbelt, patented it, and then declared that everyone could use it because they felt it was a moral obligation to reduce automobile crash deaths. The second more recent example was when Tesla announced that its patents would be free to use. I'm mildly on the fence if that will hold out or not. The seatbelt was a fairly simple device compared to the large numbers of devices covered in Tesla's patents.

      If Khan Academy is seeking this patent in order to prevent someone else from patenting it, they need to do something to release the patent as something like the public domain or else a license along the lines of GPL. Otherwise everyone would need to individually strike agreements with Khan Academy to ensure that they're not later going to be sued.

      --
      Do not look into laser with remaining eye.
    2. Re: Uh huh... by martin-boundary · · Score: 3, Funny

      Patents should be granted and immediately sold exclusively to the government, who can then open them up for everyone to use. A good example of how this works is the photography patent which was sold by Louis Daguerre to the French government, who opened the technology to the world. In this way we fix all the greatest problems with patents in one swoop. No more patent portfolios that create barriers to entry for innovative new startups, no more frivolous patent lawsuits about square looking smartphones, no more chilling effects based on the threat of being sued, no more protection money (aka licensing/royalties) rackets, and if the government must buy all potential patents then there is a balance between income (from patent examination fees) and expenditure (from buying the granted patents) so that the worst excesses of the current system are automatically held in check.

    3. Re:Uh huh... by NormalVisual · · Score: 2

      Yeah, I can only think of a couple of instances when patents were essentially opened to everyone, both of them automotive.

      Another one is the QR Code patent, yet another automotive-related one.

      --
      Please stand clear of the doors, por favor mantenganse alejado de las puertas
    4. Re: Uh huh... by Anonymous Coward · · Score: 0

      You can patent toasting bread in a conventional toaster. You can't change the law of how patents work without first fixing what is defined as patentable.

    5. Re: Uh huh... by Crowd+Computing · · Score: 1

      Patents should be granted and immediately sold exclusively to the government, who can then open them up for everyone to use.

      Wouldn't not granting the patents in the first place be more efficient? Patents are an artificial monopoly, protected by the government, so the government has the power not to honor patents that don't benefit the public. There's no natural analog to patents and other so-called "intellectual" property, unlike real property, which can be found in the territorial instincts of many animals.

    6. Re:Uh huh... by TWX · · Score: 1

      I do think it's kind of funny that the automotive industry seems to have a better altruism record on intellectual property than the IT industry. It's also interesting that the auto companies, at least the historically-American ones, have been more apt to selling or spinning-off their non-automotive components when times get tough, even if those units are profitable or show a degree of potential for it. The financing banks come to mind.

      It's like they actually want to make cars and trucks instead of diversifying.

      --
      Do not look into laser with remaining eye.
    7. Re: Uh huh... by Anonymous Coward · · Score: 0

      "Wouldn't not granting the patents in the first place be more efficient? Patents are an artificial monopoly, protected by the government, "

      You're under the dangerous idea that governments purpose is to create efficient markets, you need to bone up on the real history of capitalism. Government was created by the rich for the rich, the free market is a myth for the masses. Power does what is expedient for itself and everyone else has to be subject to the one sided rules the wealthy have put into place since the beginning of time.

    8. Re: Uh huh... by Aristos+Mazer · · Score: 1

      Do the sellers get to determine the price of the sale? Who computes the market value for something that has only one seller and only one buyer? The amount of R&D that went into an idea, the potential revenue from the item's sale, and the startup capital needed to start production ... these are hard things to compute, and I doubt they could be fairly computed.

  2. Killing a patent at this stage is easy by Anonymous Coward · · Score: 0

    New rules implementing third-party (preissuance) submissions of art in pending patent applications under the America Invents Act took effect Sept. 16, 2012.

    http://www.law360.com/articles/588491/7-things-to-know-about-3rd-party-submissions-of-art

  3. Open Source by Anonymous Coward · · Score: 0

    If this is purely a defensive patent, as the summary implies, then will they open source the patent if granted?

    1. Re:Open Source by Anonymous Coward · · Score: 4, Insightful

      Caldera was once a very pro-open source company. Then they morphed into The SCO Group. Top executives come and go.

  4. This is like "Alice" by Anonymous Coward · · Score: 0

    Online A/B testing is used ubiquitously by Internet companies, businesses, non-profits, political campaigns, etc as a way to evaluate the effectiveness of content served to the masses.

    1. Re: This is like "Alice" by paleosonic · · Score: 2, Interesting

      Most education majors are aware of that despite the fact that A/B testing is ubiquitous, it lacks serious reliability and/or validity as a serious methodology for evaluating teaching techniques or evaluation models for those techniques. It's a sad comment on the state of online training that most methodologies end up being evaluated in this fashion. Teachers use A/B testing because it's quick and easy as a way of putting some kind of data point in a teaching or evaluation process; it's time for online training to understand this and work to rise above such primitively approaches in creating new teaching techniques involving the increasing use of technology. It's only in this way that online education can truly compete with conventional education practices.

  5. Twitter pledge is too weak by Eloquence · · Score: 4, Insightful

    As the summary states, Khan follows Twitter's patent pledge. This is a good first step as far as it goes, but it still explicitly allows for offensive litigation if the "inventor" agrees. That's not sufficient. At the very minimum, Khan should adopt a clear, irrevocable policy never to enforce patents against open source projects, like many Patent Commons participants. Ideally it should partner with Creative Commons to work out an even stronger patent license, consistent with its mission. CC has previously developed model patent licenses and I'm sure they'd be happy to help.

    If the Khan Academy user who originally posted in Slashdot in response is reading this -- please bring these resources to the attention of management.

    1. Re:Twitter pledge is too weak by Anonymous Coward · · Score: 0

      Nathan Myhrvold could buy Khan Academy's patent portfolio and sue everyone who wasn't FOSS.

    2. Re: Twitter pledge is too weak by martin-boundary · · Score: 4, Informative

      That doesn't work. What if Khan gets a new management and/or new owners? They can change the rules and repudiate all those promises, no matter what. For example, Google used to be trustworthy in the early days, now they are an evil spying organisation who takes so much heat that even the founders are distancing themselves with a nondescript holding company called alphabet. If it can happen to Google, who had so much promise in 1999, then you betcha it will happen to Khan once the pressure of economics start to bite them. Trusting the intentions of companies is simply a woeful approach to economic decision making.

    3. Re: Twitter pledge is too weak by Eloquence · · Score: 1

      An irrevocable patent pledge is intended to be precisely that; it's a legal document that is written to carry weight regardless of changes of ownership or management. Whether it will stand in court when tested remains to be seen, but that problem applies also to free content and open source licenses and other legal tools for sharing of information and ideas. KA can be expected to at least do one thing, which is to use the best available legal tools to create a broader framework of reuse consistent with its mission. It should reach out to experts, such as Creative Commons, to determine which tools to use, rather than relying on a weak implementation drafted by Twitter.

      KA can also reject the idea of patents entirely. It has enough goodwill globally that any patent lawsuit against it, aside perhaps from highly protected areas such as video codecs, would likely to be suicidal for the entity bringing it, and a fundraising boon for KA.

    4. Re: Twitter pledge is too weak by martin-boundary · · Score: 1

      An irrevocable patent pledge is intended to be precisely that; it's a legal document that is written to carry weight regardless of changes of ownership or management. Whether it will stand in court when tested remains to be seen, but that problem applies also to free content and open source licenses and other legal tools for sharing of information and ideas.

      Such a patent pledge document is pure theatre, and should not be confused with open source licenses. The former relies on *the* issuing company behaving in a certain way, whereas the latter relies on *some* licensees behaving in a certain way.

      Taking as a given that people change, their motivations, circumstances, relationships change over time, you can and should expect that both KA and open source licensees will change their minds and act contrary to the legal documents they agreed to initially. When that happens, the difference is stark: in the case of the patent pledge, everyone who built their products using said patent becomes an infringer, and the potential for damage and misuse is huge and worldwide (eg SCO). In the case of the open source license, those who misuse the code according to the license are merely stealing code that doesn't belong to them, and this has no effect on the other open source recipients, it's on a case by case basis.

      In other words, a patent pledge breaks if one entity changes its mind, whereas an open source license doesn't break if one entity changes its mind. And expecting one entity to change their mind is a very low bar.

      What KA should be doing is creating a document, similar to the BSD license, which automatically licenses their patents to anyone for free and forever. That will not happen, because the true motivation of buying dubious patents is to build a war chest that can be used to threaten others, and there would be absolutely no point in paying for a patent if it had no threat value.

    5. Re: Twitter pledge is too weak by Hognoxious · · Score: 1

      Pledge schmedge already. Privacy policies certainly aren't enforcable when a business is taken over, so why would these be?

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  6. I read the patent application. Need prior art by raymorris · · Score: 4, Informative

    I actually read the patent application and it is bullshit; the summary isn't misleading. Normally when a Slashdot headline says "Company X trying to patent Y", that really means Company X is trying to patent some specific invention RELATED to Y. Not this time. They're actually trying to patent A/B testing of videos.

    To prevent this patent from being issued, someone needs to send USPTO -printed- prior art such as a magazine or journal article describing A/B testing of educational videos. Along with the printed prior art, they need to include a "301" letter. The letter and prior art will become part of the patent file which should be examined before any patent is issued.

    1. Re:I read the patent application. Need prior art by gnupun · · Score: 1

      someone needs to send USPTO -printed- prior art such as a magazine or journal article describing A/B testing of educational videos

      Why videos, let alone educational? It can be any content, like pictures or ads. Just because you change the content or data structure does not mean it's novel -- a requirement for patents.

    2. Re:I read the patent application. Need prior art by stephanruby · · Score: 1

      Khan Academy needs to stop this. I have never donated to Khan Academy, but I hope that anyone who has will stop donating. We don't need more bullshit patents, even for "good". If every good cause and non-profit starts to patent bullshit ideas, things are only going to get worse for everyone.

    3. Re:I read the patent application. Need prior art by Anonymous Coward · · Score: 0

      I.A REFERENCE IS A “PRINTED PUBLICATION” IF IT IS ACCESSIBLE TO THE PUBLIC
      A reference is proven to be a “printed publication” “upon a satisfactory showing that such document has been disseminated or otherwise made available to the extent that persons interested and ordinarily skilled in the subject matter or art, exercising reasonable diligence, can locate it.” In re Wyer, 655 F.2d 221, 210 USPQ 790 (CCPA 1981) (quoting I.C.E. Corp. v. Armco Steel Corp., 250 F. Supp. 738, 743, 148 USPQ 537, 540 (SDNY 1966)) (

      (http://www.uspto.gov/web/offices/pac/mpep/s2128.html)

    4. Re:I read the patent application. Need prior art by Anonymous Coward · · Score: 0

      Well, actually, no. A patent should be novel and *non-obvious*. Applying a known technique to a new domain *is* novel by definition. It might still not be patentable even without prior art applying it to that particular domain if the application is also *obvious*. For example, someone can't patent using a seatbelt on some fancy new type of vehicle, even if that type of vehicle never had a seatbelt before, because it's obvious to everyone that a seatbelt can be installed in any vehicle (plane, boat, car, etc).

    5. Re:I read the patent application. Need prior art by Anonymous Coward · · Score: 0

      This just confirms my bias that Khan Academy is innovative only in the sense of "we're so ignorant we don't even know that others have done it earlier, better, decades ago".

    6. Re:I read the patent application. Need prior art by arth1 · · Score: 1

      For example, someone can't patent using a seatbelt on some fancy new type of vehicle, even if that type of vehicle never had a seatbelt before, because it's obvious to everyone that a seatbelt can be installed in any vehicle (plane, boat, car, etc).

      I do not think that is entirely true. If someone came up with a seatbelt for a motorcycle, it would likely not be seen as obvious.

    7. Re:I read the patent application. Need prior art by TechyImmigrant · · Score: 1

      The bar for novelty is really low and the bar for obvious is simply not there.

      Arguing a patent is not novel involves showing it hasn't been done before.
      Arguing a patent is not obvious involves showing no one thought of it before.

      It amounts to the same thing. Yet as a designer I see the genesis of a patent is coming up with the problem. Once you have the problem you can solve it. Pretty much anyone skilled in the art of what I can do can solve same problems the same way when presented with them. The solutions are obvious. But if you come up with the problem first you can be the first to come up with the obvious solution to the problem and then patent it.

      --
      I should use this sig to advertise my book ISBN-13 : 978-1501515132.
    8. Re:I read the patent application. Need prior art by Anonymous Coward · · Score: 0

      https://scholar.google.co.jp/citations?view_op=view_citation&hl=en&user=sqUQqvsAAAAJ&citation_for_view=sqUQqvsAAAAJ:eQOLeE2rZwMC

      a friend of mine wrote this one. but it's not educational videos, just online homework problems.

  7. Either-Or by Anonymous Coward · · Score: 0

    Companies such as Blackboard (AKA Microsoft) may be competitors in this arena. So I have a suggestion:

    Either convey the patent to the Open Invention Network.

    Or create some videos that demonstrate the absurdity of patents such as "Systems and Methods for Split Testing Educational Videos". Something that even octogenarian, computer illiterate, Supreme Court Justices can understand.

    1. Re:Either-Or by Eloquence · · Score: 1

      Although Blackboard has filed patent lawsuits against competitors (and was briefly boycotted for it), it at least has issued an irrevocable patent pledge not to sue open source projects. I suspect ignorance, not foul play, on the part of Khan Academy is the cause.

      Ironically, nonprofit Khan Academy's Twitter pledge is less permissive than that of the corporate behemoth, since it reserves the right to sue anyone, for any reason, provided company and "inventor" agree. Not sure OIN is a good fit for its needs given its close tie to usage of patents within "Linux systems". Something like CC's model patent license or a simple, broad pledge never to use patents offensively against anyone may be a better fit.

      KA's policy error here is likely the result of swimming in the Silicon Valley ideological soup, where Twitter's pledge is considered remarkable. KA has never been an especially awesome organization when it comes to open source citizenry. For example, it uses the "non-commercial use" restriction for its materials, which is widely rejected within open source and free culture circles like Wikimedia, Linux, etc. Hopefully this will change over time as the organization becomes more aware of the policy discussions around these issues, since a lot of its work is otherwise excellent and world-changing.

    2. Re:Either-Or by Half-pint+HAL · · Score: 1

      KA has never been an especially awesome organization when it comes to open source citizenry. For example, it uses the "non-commercial use" restriction for its materials, which is widely rejected within open source and free culture circles like Wikimedia, Linux, etc. Hopefully this will change over time as the organization becomes more aware of the policy discussions around these issues, since a lot of its work is otherwise excellent and world-changing.

      Non-commercial is particularly insidious in the education system. When I was teaching English overseas, it was in commercial night-schools. A great many teachers started publishing their materials on a free "non-commercial" license, completely oblivious to the fact that they were technically blocking their colleagues from using it. Many schools are private entities, even some that are considered independent but still funded by the public purse, so that means KA doesn't get used there. Schools tend to buy in to textbook-led courses, all of which assume a certain ordering of materials; trying to integrate outside materials with a structured course is a very demanding task for a teacher, so most don't do it, and the teachers are locked out of materials unless the textbook authors have specifically integrated it, which they can't, because that would be "commercial use".

      Very, very few schools can therefore make use of KA materials. Who does that leave? Not private tutors, certainly, because they are all clearly commercial entities.

      --
      Got them moderator blues I blieve I walk out the do', With these mod-points I been gettin', I 'most never post no mo'
  8. An old adage applies here. by stevez67 · · Score: 2

    There's no need to patent the incredibly obvious when patenting the merely obvious will do!

  9. Oblig by cyber-vandal · · Score: 3, Funny

    khaaaaaan!

  10. So it other words.... by BlueCoder · · Score: 3, Insightful

    They are creating a patent portfolio so they can counter-sue other companies that may sue them. Doesn't matter if the patents are bogus.. it takes time and lawyers fees to go through the federal courts. And the patent system isn't broken?

    We need a patent system with more critical examiners. But the examiners are understaffed and only seem to rubber stamp patents anyway so lets create a separate court system for just patents; with an overstaffed public defenders office whose job it is to strike down patents. All patent must go before a judge before they are officially approved. Furthermore anyone in the public can sue to challenge the patent to augment the public defenders. And the judge must have the special responsibility to not approve a patent if he has any doubt. Meaning it's up to whomever submitted the patent to prove their case and that all issues have been brought up. Make it mandatory that the patent has to serve the public's interest; and in conjunction with that judgement make the term length of the patent variable. Furthermore the court should have the ability to set the valuation of a patent and to forcibly grant licenses to others.

    1. Re:So it other words.... by Anonymous Coward · · Score: 0

      They are creating a patent portfolio so they can counter-sue other companies that may sue them. Doesn't matter if the patents are bogus.. it takes time and lawyers fees to go through the federal courts. And the patent system isn't broken?

      Hey, it worked for guns, rights?

      A patented society is a polite society. Or something.

  11. Who, or what, is being tested? by Panoptes · · Score: 1

    I call absolute bullshit on this one. Language testing is about measuring a student's performance against one or more criteria. What Khan is apparently hoping to patent is a method for measuring the effectiveness of a piece of media, in this case video.

    In the realm of text readability analysis this has a long history, perhaps the best-known technique being the Gunnar Fog Index, invented in 1952. The ubiquitous Cloze test, invented in the early fifties, was originally intended to measure and grade the reading difficulty of a piece of text.

    So prior art aside, as far as I can make out Khan's product has nothing to do with the measurement of language skills.

  12. Sesame Street by Etherwalk · · Score: 1

    But didn't Sesame street basically do this? They weren't giving an explicit B, but if the kids became less engaged than some metric suggested they should be then a B was created.

  13. More proof of the uselessness of patents by Teancum · · Score: 1

    I have long stated that I feel like the entire patent system is just a useless waste of time and needs to be simply removed from the legal code of the USA in its entirety. The professed reason for why patents exist is to help small time inventors to be able to profit from their engineering efforts and to ensure that their ideas are protected for a limited time, as per the U.S. Constitution:

    Article I, Section 8
    Congress shall have power....

    To promote the Progress of Science and useful Arts, by securing for limited Times to Authors and Inventors the exclusive Right to their respective Writings and Discoveries

    Kahn Academy is not even trying to accomplish this goal themselves. It is merely a defensive patent to ensure they don't get screwed by a patent troll.

    I have yet to see anybody I personally know that has earned a dime from a patent. I know a few people who are professional engineers who have had patents filed from work they've done professionally.... where the patent filing fees were paid by their employers and were also largely defensive patents as well. I also know several people who have indeed gone through the effort to file a patent and go through the legal hassle of trying to get a cool idea patented, only to have the fancy patent grant letter from the USPTO being the only real thing they ever got from all of that money and effort.

    I contrast that to at least copyright, where I do know of a few authors who have written books and through copyright have been able to earn some money from their writings, software, or artwork of various kinds. Copyright at least sort of works as intended to protect authors to have an exclusive right to their work for a limited time (that is now perpetual.... but a separate legal issue not relevant to this point).

    Patents simply don't work. Even famous inventors like Philo Farnsworth and the Wright Brothers, people who clearly invented incredibly novel ideas after spending substantial amounts of money perfecting the concepts they are associated with, basically got taken for a ride by the patent system and ended up with only a small pittance from all of the legal efforts they expended.... and still didn't stop others from developing products and making huge amounts of money from their supposedly patented ideas.

  14. Wicat System has prior art. by tlambert · · Score: 1

    Wicat System has prior art. Massive, government military contracted, prior art.

  15. What a joke by Anonymous Coward · · Score: 0

    There's only one rea$on to make $omething like thi$ proprietary. Who do they think they're kidding?

  16. Boycott Khan! by Anonymous Coward · · Score: 0

    EVERY company patenting obvious applications of tech should be easily found in a list so informed people boycott them in every way they can

    1. Re:Boycott Khan! by c4757p · · Score: 1

      That should be a fairly easy list to compile, just list every company that has filed a patent in the last twenty years.

  17. On a computer by Anonymous Coward · · Score: 0

    ... Khan Academy's pending patents on learning computer programming and 'social programming' ...

    Prior art aside, I don't have much of a problem with them building a war chest, at least, while it's not used against open source software. I'm much more worried the next patent will be this sort of thing 'on a computer'. I know where that behaviour is heading: A monopoly selling computer-based training to schools.

  18. I didn't know what A/B testing is' but... by Hognoxious · · Score: 1

    It looks like they're trying to patent experiments.

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  19. not that simple by laurencetux · · Score: 1

    but instead of rehashing a chunk of Groklaw i ask you this question

    What is The SCO Group doing these days??

  20. Re:Completely true by tandavanadesan · · Score: 1

    I withdrew my kids from the Khan academy when I read some samples questions.

    "A Muslim died killing an infidel and gains 72 virgins. Demonstrate that even if he only has sex with one each day, that in eternity he will have more sex than all the infidels combined during the life of the universe".

    " Hamid has 10kg of explosives. If 1kg has a 90% chance of killing an armoured car driver, and 500g a 40% chance which size bomb should he make in order to kill most people? For extra points why any this not be the best tactic in the real world?"

    Is this true? Why do we put up with this, when there would be complaints if atextbook had even a slight religious bias?