Slashdot Mirror


Attorney Sues Website Over His Online Rating

An anonymous reader writes "The Seattle Post-Intelligencer is reporting that a local attorney is suing legal startup Avvo over a rating that was algorithmically assigned. The story covers the controversy of computers grading humans. 'Browne, who has participated in a number of high-profile cases in the state, including the defense of arsonist Martin Pang, said in an interview that Avvo is being irresponsible with the ratings and called them a fraud. And he questioned why Supreme Court justices and prominent lawyers score so low. Three other attorneys interviewed by the P-I also expressed doubts about the rating system, while News.com reported that the site "seemed to be riddled with bizarre errors."' Such practices are not new: the New York Times earlier this year reported on Google using algorithms to determine applicant suitability. But what happens when you don't like the result? Can a computer program be considered defamatory?"

14 of 207 comments (clear)

  1. Just another tool. by Harmonious+Botch · · Score: 5, Insightful
    From TFA:

    Can a computer program be considered defamatory?" Programs can not be defamatory. Their output may be.

    If I use a hand-held calculator to get a result, and then publish it and that publication defames someone, I can't blame it on the calculator.
    In this case, a computer is just another tool used to calculate something - perhaps a tool that many people don't understand as well as they should - but a tool nonetheless.
    You use it, you take responsibility for the results. You don't understand how it works? Hire a consultant. The fact that it is a complex tool does not excuse you if you libel someone.

    ( NB: The above paragraphs presume that there is indeed libel, a fact not yet proven.)
    1. Re:Just another tool. by pimpimpim · · Score: 4, Insightful
      As far as I understood it, a person is rated by a website with some rating procedure the website worked out. So your example doesn't really hold. Someone else used a method on the calculator to calculate the result, and he complains about the method.

      I don't know what to think of this. As a restaurant, you can earn michelin stars based on the grades you get from probably several testers. Did you ever hear of a restaurant that sued michelin for loosing a star? It doesn't seem to make sense.

      Rmember, any person, magazine, or website can grade services, but they will only be taken seriously when they have a decent method. Systems like this work when not only the public has faith in the method, but also the people involved (e.g. the chefs), respect the way the testing was done. If restaurants would think that the michelin system is fake, they wouldn't be proud of their stars in the first place.

      Since there seems to be quite a group of people that do not agree with the method used by that website, they can of course try to sue them, but I figure that the website will be rendered useless within the trade fast enough that they might as well just ignore the score of the website all together. Sueing might even be counterproductive, I didn't know before that the website existed in the first place. And I think he has very much the right to do so. He never asked to be rated, but at the same time the rating will be of high economic importance to him (getting more high-profile jobs, etc.). Now you could compare this with a restaurant getting the famous michelin stars, it can make or brake the restaurant. Now In cases like that, you need to be able to ask for a second opinion.

      --
      molmod.com - computing tips from a molecular modeling
    2. Re:Just another tool. by Harmonious+Botch · · Score: 3, Insightful

      As far as I understood it, a person is rated by a website with some rating procedure the website worked out. All by itself? Just a website doing things on its own?
      Some human made a decision somewhere.
    3. Re:Just another tool. by Sancho · · Score: 4, Insightful

      I'm thinking of a number between 1 and 100. Can you guess what it is? Give up? It's my Pagerank score, and mine happens to be 86.

      That's what this situation reminds me of. Credit scores (which is what the above lines reference) are calculated by an algorithm, and they can be wrong. If they are, you can get the company to adjust them, provided that you can provide evidence that their input is faulty. I see no reason that this case should be any different, provided the inputs (reasons for the ranking) are well known.

      In the case of Google, however, they are providing a ranking rather than a rating. It is much, much harder to objectively rank webpage relevance based on search terms, and even harder to know whether a given ranking is justified when you don't even know the algorithm used.

    4. Re:Just another tool. by QuietLagoon · · Score: 4, Insightful
      Programs can not be defamatory. Their output may be.

      I disagree. Programs are merely an extension of the human(s) who designed them, the program does what the human(s) told them to do. Therefore what a program does is the full responsibility of the human who designed it.

      I always laugh when a programmer tells me, "there's a bug in my program." My first questions is always, "well, who put that bug there?" Programmers talk of bugs as if they just magically appear, and are not the result of the programmer's error(s).

      The comment that programs cannot be defamatory smacks as specious at best. Of course, programs can be defamatory. Programs are written by humans, programs are computerized extensions of humans.

    5. Re:Just another tool. by SnowZero · · Score: 4, Insightful

      Agreed. You can encode whatever you want into an algorithm, and it can certainly be biased and even illegal. For example, in some applicant rating system for a hiring "screen" program, if you have:

      if(applicant.sex == female) rating = 0.0;

      That would certainly violate equal opportunity laws, unless the company could prove that the output of said program was not used at all.

    6. Re:Just another tool. by Firethorn · · Score: 3, Insightful

      The fact that it is a complex tool does not excuse you if you libel someone.

      But is it libel? I see very little difference between this and consumer reports - Both take data and attempt to draw a simple rating/conclusion from it. If the lawer wins his case it undermines the whole independent review and ratings system - because anybody giving a negative rating would be open to a lawsuit.

      How they weigh their ratings is up to them, just as it's my choice as to how heavily I weigh their ratings (anywhere from not bothering to read them to simply attempting to get the highest rated).

      Errors in the data is one thing - for it to be true libel it would probably have to be deliberate. As they get more data into the system, improve accuracy, etc... The ratings should become more accurate.

      --
      I don't read AC A human right
    7. Re:Just another tool. by timeOday · · Score: 3, Insightful

      Credit scores (which is what the above lines reference) are calculated by an algorithm, and they can be wrong. If they are, you can get the company to adjust them, provided that you can provide evidence that their input is faulty.
      If, on the other hand, the credit rating company has all its facts right, but you don't like their algorithm and think you're still credit-worthy even though they don't? Well you're screwed. How to combine numbers is their prerogative. Think about how that applies to this case.
  2. Ugh... by rakslice · · Score: 3, Insightful

    Is it just me, or does it seem like there are a lot of legal professionals who normally have no problem applying existing law to novel situations but who turn into drooling idiots as soon as a computer program or computer network becomes involved?

  3. "Can a computer program be considered derogatory?" by jfclavette · · Score: 3, Insightful

    Uh....

    switch (person.getSkinColor()) { ... } ?

  4. Defamatory? by piojo · · Score: 5, Insightful

    Well, if they made it clear to viewers how their ratings are calculated, they should not be responsible for harm done. In that case they would just be stating facts (e.g., rating = this lawyer wins X% of his cases - this lawyer charges %Y percent over the industry average for their type of cases...) But if they don't tell people where the ratings come from, then I wonder: how is writing a shitty algorithm that says defamatory stuff about people any better than just saying defamatory stuff about people. People are responsible for the computer programs that they knowingly use.

    --
    A cat can't teach a dog to bark.
  5. Re:Sympathy for the Devil? by WilliamSChips · · Score: 3, Insightful

    Yeah, because nobody is ever falsely accused of rape and therefore anybody accused but not convicted is a rapist walking the streets...

    --
    Please, for the good of Humanity, vote Obama.
  6. Attorney's solution. Litigate. by kinglink · · Score: 3, Insightful

    Seriously, can an algorithm be biased? YES! Very much so. Imagine if we had an algorithm that rated people on a 100 point scale. If your skin color is white you get 100 points to start with, black people get 0 points. That's biased.

    Does that mean the company behind the algorithm is biased? Yeah again. In this case (not necessarily Avvo's case) this algorithm is blatantly biased, trying to rate people on their skin color.

    Does this mean it's illegal? Not unless the law has changed. If he wants to litigate then he needs to prove the algorithm is biased (and a few anomalies doesn't mean it's biased, it means it has a flaw) Avvo has to be biased in such a way they are making a profit over the difference. Avvo has to be deliberating trying to damage someone's career for it to even be illegal.

    If the algorithm is running correctly and there's no X factor (meaningless stastical values, such as the color of the skin) then there's no crime here. They might not have a perfect algorithm but they arn't claiming it.

    If the lawyer in question wanted to fix this correctly, he should bring this to the attention of the site, point out numerous cases of people being graded too harshly and then publicize the data to the public if need be. From the sound of it, there's little to no proof except some lawyers feeling they are being treated unfairly. From the sound of it, that's sour grapes, there's no defamation.

    Just because an algorithm is poorly designed it doesn't mean it's crap, errors happen even with great algorithm's first iterations. There's still a burden of proof on the lawyer and I'm not hearing any real proof yet.

  7. Re:My Opinion? by fyngyrz · · Score: 4, Insightful

    I suspect that you mean to say 'justices,' not 'judges.'

    Yep, that'd be close, all right. Perhaps I meant injustices.

    Which would be, what? The negative commerce clause?

    That would be the feds marching into California and swooping down on medical marijuana users based on a commerce clause argument that 100% intrastate commerce "could be" or "could have been" interstate commerce, and so the feds claim to have jurisdiction to screw with California law, legislators, and citizens. Which they do not. The ruling and the reasoning is sophist nonsense. The constitution says in sec 8, para 1 through para 3, that The Congress shall have Power To... regulate Commerce... among the several States. That's it. No more than that. It's an enumerated power, and there is no authority implied or specified that allows mucking about with commerce internal to a state. Furthermore, the 10th amendment makes the limit explicit: The powers not delegated to the United States by the Constitution, nor prohibited by it to the States, are reserved to the States respectively, or to the people. So there you have it. They have the authority to regulate intrastate commerce, but not interstate commerce. The court is out of line, and so are the feds.

    [taking property by force and coercion] Which is not a bad idea, actually; that is how governments builds roads, among other things.

    That observation in no way precludes the fact that there are other ways to build roads, including ways that don't screw with people's properties at all. You can go under them; you can go around them; worst case, you can even go over them, though you certainly ought to pay for that privilege. It is wrong to steal, and it is no less wrong when the government does it.

    The idea of "fair compensation" is intellectually bankrupt. If I own a piece of land, and I want to sell it, that is where it can be determined that it has a specific monetary value. The way that is done is that when you offer enough money to satisfy me, I'll let you have it.

    If you don't, I won't. But if I own that property and for whatever reason, I do not want to sell it, then you cannot put a value on it that equates to "reasonable compensation." How do you compensate for my ancestors having raised generations there? How do you compensate for the view, or the fishing in my lake? How do you compensate for the fact that my brother died in that house, or that I was married there? Or that I built it by hand? Or that I lost my virginity on the living room couch?

    The answer, of course, is that you can't, not that it is fair to use some number a bunch of people I didn't delegate my feelings and associations to invented based on their feelings. I'll tell you how it actually works: force and threat of force. Coercion. There isn't a reasonable step in the entire process.

    So you're saying that the Constitution imposes limits on the federal government spending its money which would prohibit this? Please feel free to point them out

    Sure, I'll point the problem out. It is what we call blackmail, where one party is forced to do something it does not believe is legal, ethical or otherwise proper, by another party that wields a coercive force. I'll point something else out, too: the trust the people put in the government to build and maintain a general infrastructure doesn't include the presumption that said power will be used as a weapon, nor does it include the presumption that the feds won't build roads in some states, while building in others. The collection of taxes is (barely) tolerated with the idea that said collection is done for the common good, not in order to wield a coercive force on the states. The fact that the feds do wield such coercive forces is contrary to article 1, section 8 of the

    --
    I've fallen off your lawn, and I can't get up.