Slashdot Mirror


New Toronto Declaration Calls On Algorithms To Respect Human Rights

A coalition of human rights and technology groups released a new declaration on machine learning standards, calling on both governments and tech companies to ensure that algorithms respect basic principles of equality and non-discrimination. The Verge reports: Called The Toronto Declaration, the document focuses on the obligation to prevent machine learning systems from discriminating, and in some cases violating, existing human rights law. The declaration was announced as part of the RightsCon conference, an annual gathering of digital and human rights groups. "We must keep our focus on how these technologies will affect individual human beings and human rights," the preamble reads. "In a world of machine learning systems, who will bear accountability for harming human rights?" The declaration has already been signed by Amnesty International, Access Now, Human Rights Watch, and the Wikimedia Foundation. More signatories are expected in the weeks to come.

Beyond general non-discrimination practices, the declaration focuses on the individual right to remedy when algorithmic discrimination does occur. "This may include, for example, creating clear, independent, and visible processes for redress following adverse individual or societal effects," the declaration suggests, "[and making decisions] subject to accessible and effective appeal and judicial review."

168 comments

  1. They might want to begin by practicing what they p by Anonymous Coward · · Score: 1, Interesting

    Amnest International and Human Rights Watch both discriminate against humans born in Western societies in favor of dictatorships. They hold them to different standards.

  2. Re: They might want to begin by practicing what th by Anonymous Coward · · Score: 2, Funny

    New Toronto Algorithm Calls On Declaration To Respect Human Rights

    Fixed.

  3. we can't get people to do this.. by Anonymous Coward · · Score: 0

    how is a piece of paper going to get *people* to program computers to?

  4. War on noticing continues by Anonymous Coward · · Score: 0

    It's very important that machine learning is programmed to overlook the same things that humans pretend they can't see.

    "Freedom is the freedom to say that two plus two make four. If that is granted, all else follows."

  5. Summary is wrong... by RyanFenton · · Score: 4, Interesting

    Yeah - I looked at the article. No mention of algorithm. Algorithms are too simple for human rights to apply to in almost all cases.

    The summary is wrong - these folks are making an argument more about big data systems that let their data skew in ways that may end up with unethical results if used blindly.

    And that's a fair point - it's also a point made in most Computer Ethics classes for decades now, as part of most computer science degree paths.

    Ryan Fenton

    1. Re:Summary is wrong... by RyanFenton · · Score: 4, Insightful

      Slight clarification - the actual declaration is where there's no mention of algorithm. The silly article writer linking to the declaration does erroneously mention algorithm for some reason. Seems to happen a lot in science journalism the same way. Journalists are not paid enough to use accurate terms, I guess.

      Ryan Fenton

    2. Re:Summary is wrong... by Dog-Cow · · Score: 2

      So it's a declaration which states that "big data" isn't an excuse to break existing laws? Somehow, I am not seeing the purpose of this formal declaration.

    3. Re:Summary is wrong... by AmiMoJo · · Score: 2, Insightful

      It's important to have declarations like this. "It's against my ethics" isn't quite as useful as "it's against the Toronto Declaration" when refusing your boss.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    4. Re:Summary is wrong... by religionofpeas · · Score: 2

      Why not just "it's against the law" ? We already have laws against discrimination.

    5. Re:Summary is wrong... by Dog-Cow · · Score: 2

      If it's not illegal, then why is "it's against someone else's ethics" a better argument than "it's against my ethics"?

    6. Re:Summary is wrong... by Anonymous Coward · · Score: 0

      In England, and presumably also elsewhere, laws against discrimination are limited to discrimination against particular protected groups in particular situations, such as employment and public services. There are also explicit exceptions: schools are allowed to discriminate by religion. Moreover, laws are always limited to things that might be provable in a particular case, while a "Declaration" can be more vague and aspirational.

    7. Re:Summary is wrong... by religionofpeas · · Score: 1

      a "Declaration" can be more vague and aspirational.

      Even more reason to ignore it.

    8. Re:Summary is wrong... by Anonymous Coward · · Score: 1, Insightful

      The purpose is the current government doesn't like how some statistics (which happen to reflect reality...) are being used against them to point out "certain groups" should be more closely scrutinized and that certain groups that "need representation" and are having funds allocated to them are statistical minorities.

    9. Re:Summary is wrong... by Anonymous Coward · · Score: 0

      That certainly is a reason for some people to ignore it. Probably you're one of those people. That's not a problem. We can't all worry about everything. You stick to what you're interested in.

    10. Re:Summary is wrong... by Hognoxious · · Score: 3, Insightful

      It isn't, he's spouting shit as usual.

      Of course the primary motivation behind the declaration - and the SJWs' support for it - is fear that algorithms might come up with results that some people don't like.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    11. Re:Summary is wrong... by AmiMoJo · · Score: 1

      Because they are the ethics of an internationally accepted and widely supported, gold standard declaration.

      It's an appeal to authority and works on bosses. It's also useful when suing for rights violations and at unfair dismissal hearings.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    12. Re:Summary is wrong... by GrumpySteen · · Score: 2

      Sure we do. And we have judges using the COMPAS Recidivism Algorithm to help determine sentences despite evidence pointing toward a bias against black defendants.

      The algorithm and data set are proprietary, though, so nobody gets to examine them. Since it can't be absolutely proven that the algorithm is biased, judges are free to continue using COMPAS to justify harsher sentences to black people without anyone being able to claim racism.

      Feel free to point out which specific laws make this impossible. There are a lot of defense lawyers, defendants and researchers who will celebrate your name if you can make this problem go away.

    13. Re: Summary is wrong... by Anonymous Coward · · Score: 0

      Yes, this is about human ethics, not magical, non-existent AI. Good luck with that. If an actual hearing can't make a company like Facebook behave ehically, and no one has the stones to pass legislation, I don't know what anyone can do. Algorithms will always be what they are programmed to be, in spite of what ignorant engineers may believe, and modern Silicon Valley is notoriously devoid of anything resembling foresight or consideration, let alone ethics or compassion. Apple would appear to be the only company on earth with even a hint of this awareness, currently.

    14. Re: Summary is wrong... by Anonymous Coward · · Score: 1

      COMPAS does not know the color of people's skin. It knows that people who have a particular history with the justice system are likely to reoffend. A history of priors should not be considered a racial bias thing.

    15. Re:Summary is wrong... by GrumpySteen · · Score: 1

      The summary is a summary of the article, not the declaration. Aside from that, do you think machine learning (which is heavily reference in the declaration) doesn't involve algorithms?

    16. Re:Summary is wrong... by religionofpeas · · Score: 1

      The algorithm and data set are proprietary, though, so nobody gets to examine them.

      And exactly how would the Toronto Declaration help in that case ?

    17. Re:Summary is wrong... by avandesande · · Score: 2

      You can create an accounting algorithm that breaks tax laws too. Why wouldn't this apply to non-discrimination laws?

      --
      love is just extroverted narcissism
    18. Re: Summary is wrong... by Anonymous Coward · · Score: 0

      if(black) {
          innocent()
      }

    19. Re:Summary is wrong... by Anonymous Coward · · Score: 0

      The purpose is the current government doesn't like how some statistics (which happen to reflect reality...)

      You remember what they say about statistics? Especially Soviet statistics, which is based on a different kinds of mathematics.

      that certain groups that "need representation" and are having funds allocated to them are statistical minorities.

      You didn't just say that while living in a representative democracy?

    20. Re: Summary is wrong... by GrumpySteen · · Score: 2

      Do you have access to the proprietary algorithm and data that the company has never given anyone else? Otherwise, you're making an assumption that you have no evidence to support.

    21. Re:Summary is wrong... by GrumpySteen · · Score: 1

      How do you solve a problem if the first step doesn't solve it?

      Most of us take the first step and then keep going. You seem to be advocating giving up if the first step didn't solve the problem.

    22. Re:Summary is wrong... by religionofpeas · · Score: 2

      You're not answering the question, so I'll give you a hint: it would not help at all.

      If the code and data is proprietary, you have no way of knowing whether the Toronto Declaration was followed. And even if you have a good reason to assume it was not, then there's no legal recourse anyway, because it's all voluntary.

    23. Re: Summary is wrong... by religionofpeas · · Score: 1

      We don't know the algorithm and learning data, but we do have the questionnaire about the defendant, which has no question about skin color or race. It's in your own link above.

    24. Re: Summary is wrong... by Anonymous Coward · · Score: 0

      You don't need that. You just need the inputs. The input is a record, not a race. What you are doing is continuing the tires narrative that life is not fair for the criminals of one race over those of another.

      Now, if you want to suggest the record may be incomplete for young white males and therefore minor infractions by young black males could have a disproportionate impact on sentencing; that is possible. When dealing with statistics (which is what these algorithms do), don't assume bias towards an outcome. Instead, if you believe there is bias, look at the input data.

    25. Re:Summary is wrong... by Anonymous Coward · · Score: 0

      It's an appeal to authority

      So they're using a logical fallacy to get what they want.

      Kinda ironic that a declaration asking for ethics is using such an... unethical method to achieve their goals.

      works on bosses

      Fox News and tweets from Russian hackers also works on bosses. The POTUS being one such boss.

    26. Re: Summary is wrong... by ShanghaiBill · · Score: 1

      COMPAS does not know the color of people's skin.

      It knows their zip code, which in much of America is a pretty good proxy for race.

    27. Re: Summary is wrong... by CanHasDIY · · Score: 1

      Do you have access to the proprietary algorithm and data that the company has never given anyone else? Otherwise, you're making an assumption that you have no evidence to support.

      That's a two-way street, hombre.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    28. Re:Summary is wrong... by CanHasDIY · · Score: 0

      "If science contradicts my belief, then obviously science is wrong."

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    29. Re: Summary is wrong... by Reverend+Green · · Score: 1

      A secret algorithm used to determine the outcome of legal questions is tantamount to secret law. It is ipso facto illegitimate.

    30. Re: Summary is wrong... by Anonymous Coward · · Score: 0

      Each article is worth an expired can of soup. They get paid shit. So they write anything to survive. They break their own rules so they can eat.

      This is the real world. Life is hard.

    31. Re:Summary is wrong... by Anonymous Coward · · Score: 0

      An appeal to authority is not necessarily a logical fallacy, and logical fallacies are not in and of themselves unethical.

      Q.E.D. you are not the critical thinker you fancy yourself to be.

    32. Re:Summary is wrong... by Anonymous Coward · · Score: 0

      An appeal to authority is not necessarily a logical fallacy

      It is in this case. As noted, it's just changing "it's against my ethics" to "it's against these other people's ethics". It's presenting the idea as somehow better just because some other people (an authority) said it.

      logical fallacies are not in and of themselves unethical.

      It is in this case. You're employing a fallacy to fool your boss out of convenience (instead of say, explaining things to him, with actual logic and reason). The implication here you assume your boss to be simpleton. A fool who can be duped by simple sounding solutions to complicated problems.

      As I alluded previously, that is the road to Trump. "Build a wall" is a very simple sounding solution too.

      Q.E.D. you are not the critical thinker you fancy yourself to be.

      Never claimed to be one. Nice try telling me what I think.

      AmiMojo actually complained about people like you. Buzz off.
      https://slashdot.org/journal/3...

    33. Re: Summary is wrong... by sjames · · Score: 1

      Have you carefully studied the questions to make sure race cannot be inferred to a high degree of accuracy based on the answers?

      For a more neutral example, males are more likely to commit criminal assault and tend to have larger feet. So do we let the algorithm add a few months to the sentence for shoplifting because the defendant wears a size 12?

      And since in for a penny already, people who go to prison are a bad credit risk, and since people who wear a size 12 spend more time in prison than people wearing a size 8, shall we automatically knock 20 points off of your credit score if you have larger feet?

      At what point does the pervasive algorithmic discrimination against people with large feet fulfill the premise that people with large feet are more likely to commit a crime?

    34. Re:Summary is wrong... by sjames · · Score: 1

      It at least encourages them to either demand to know how the system is making it's decisions or quit using it.

    35. Re:Summary is wrong... by sjames · · Score: 1

      Since I don't have to respect your opinion BY LAW, why did you bother giving it? Answer that and your question is also answered.

    36. Re:Summary is wrong... by ooloorie · · Score: 1

      The summary is wrong - these folks are making an argument more about big data systems that let their data skew in ways that may end up with unethical results if used blindly.

      Except that big data systems don't skew things in "unethical" ways. "Unethical" is simply coded language for "outcomes we don't like". For example, if you feed demographic information and credit repayment rates into a big data system, it will come up with individual scores based on that information. When you then look at that data in aggregate, you'll find that many "marginalized groups" score worse in aggregate. That's not because the big data system discriminates, it's because objectively, those "marginalized groups" have a higher percentage of individuals that are a high credit risk.

    37. Re:Summary is wrong... by sjames · · Score: 1

      That's not the statement. It's "It's against my ethics" vs. "It's against the ethics of a sizable group of experts on ethics and mine as well".

    38. Re:Summary is wrong... by Anonymous Coward · · Score: 0

      Responding to an argument from authority ("do this thing because I say so") with another ("the law says I cannot") does not constitute a logical fallacy, nor is it unethical.

      Your argument is "appeal to authority makes the argument fallacious and unethical". Says who? :-)

    39. Re:Summary is wrong... by Anonymous Coward · · Score: 0

      In particular, they want to ensure they still have an opportunity to enforce their prejudices.

      For example, an algorithm might find that people named "Carol" are more likely to quit their job early to look after a family, and people named "Bob" are more likely to get in trouble with the law, and recommend against hiring Carols and Bobs. These are both, indirectly, sexual discrimination.

      SJWs would like to have someone reviewing each effect when it's discovered. If they find that Carols are being discriminated against, they'd like a hard-coded fix - a boost to Carols - to correct it. If they find that Bobs are being discriminated against ... well, that's all good from a social-justice viewpoint.

      Thus bias can be introduced to an otherwise-unbiased system.

    40. Re: Summary is wrong... by terrycarlino · · Score: 1

      And yet they employ workers in Asian sweatshops to manufacture their products. Pretty low bar you've set there.

  6. Nice and all, but simplistic and naive by Rosco+P.+Coltrane · · Score: 0, Troll

    Okay, here's one: suppose an AI is in charge of running the US (and after all, why not: humans aren't doing such a great job at it). It determines the only way to end violence and protect minorities is to preventively lock up religious crazies and racists. Whose basic human rights will it choose to respect? The right of the crazies to be free, or the right of the minorities to be treated as human beings and live in peace? Zeroth law anyone?

    --
    "A door is what a dog is perpetually on the wrong side of" - Ogden Nash
    1. Re:Nice and all, but simplistic and naive by Savantissimo · · Score: 0

      That's just your fantasy. Blacks commit violent crimes against Whites at over *25 times* the per-capita rate that Whites do against Blacks. That's from yearly random surveys of victimization carried out by the DOJ.

      --
      "Is life so dear, or peace so sweet, as to be purchased at the price of chains and slavery?" - Patrick Henry
  7. For algorithms _designed_ to discriminate? by gweihir · · Score: 1

    The very purpose of these algorithms is to discriminate and to sort people into buckets: Those that are likely to buy product A or product B, those that may be a promising target for purpose C, those that are unlikely to buy, no matter what. Sure, you can keep up the fantasy of leaving, say, gender and race out, but they can easily be substituted by data that is the very target of these algorithms. As a (grossly simplified) example, take this: Gender you can get from makeup bought, race you can get from type and color of make-up bought for women, etc. Hence all the data that is used to violate human rights, treat people not equally, etc. is already there and there is nothing that can be done about it.

    The thing is, classifying people by algorithms can either be allowed or not. If it is allowed, then there is nothing that can be done to prevent human rights violations as a result. The only thing you can make them do is be less obvious about it.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    1. Re:For algorithms _designed_ to discriminate? by JaredOfEuropa · · Score: 5, Insightful

      That's the big issue with big data. And the danger is that perceived "racism" will be corrected with "affirmative action": by verifying the AI using statistics on the outcome, and applying a bias.

      People with certain economic characteristics are statistically more likely to default on a loan. What if the AI applies such strictly relevant data to approve or reject loan applicants, but the rejected group happens to be predominantly of a certain race? Verification of the AI will show a (non causal) relation between race and loan applicant score, and since we don't know how the AI arrived at its decision, people will assume racism. Will the bank be forced to correct for this and extend loans to people of this race with terrible credit scores, just to make up the numbers?

      In cases where we are worried about racism, perhaps AI simply isn't practical, and we're better off judging each individual case ourselves on imperfect but clearly defined criteria that are free of undesirable bias.

      --
      If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
    2. Re: For algorithms _designed_ to discriminate? by Anonymous Coward · · Score: 1

      It doesn't matter whether you do it by hand or by computer. For example, black people are statistically far more likely to be poor than everyone else, and as a consequence they have terrible credit scores. This is a fact, and no matter who does the calculations, as long as they are based on observable facts, they will be less likely to give black people a loan.

      Reality is racist. Statistics is based on reality. If you don't like the outcome, change the reality and the statistics will take those changes into account.

    3. Re:For algorithms _designed_ to discriminate? by The+Cynical+Critic · · Score: 1

      You're projecting way too much malice into all of this... Most cases of "bias" by machine learning, which is really just branch of statistical analysis, systems tends to be the developers intentionally skewing the result or then, in the vast majority of cases, population level differences that cause something that appears to be racist if you don't understand the data the system is making decisions based on or how it actually makes those decisions.

      A good example of this is how black people are on average worse off financially than whites and particularly asians, which leads to systems that determine if credit should be given will appear to be biased against black people when they actually treats black, white and asian people with the same financial history and other factors exactly the same. A system for this kind of purpose which is "non-racist" based on purely it's output and not the data it uses will have to be explicitly racist and favor black people over whites and asians.

      --
      "Why should I want to make anything up? Life's bad enough as it is without wanting to invent any more of it."
    4. Re:For algorithms _designed_ to discriminate? by gweihir · · Score: 1

      Indeed. Exactly my point.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    5. Re:For algorithms _designed_ to discriminate? by c · · Score: 1

      In cases where we are worried about racism, perhaps AI simply isn't practical, and we're better off judging each individual case ourselves on imperfect but clearly defined criteria that are free of undesirable bias.

      You know, that's a really great idea.

      Even better, we should write down all the clearly defined criteria, and then feed that and the data into a computer using some kind of scheme where it'll give the output. That'll ensure that there's none of that nasty bias you get when people do those sorts of things.

      --
      Log in or piss off.
    6. Re:For algorithms _designed_ to discriminate? by gweihir · · Score: 1

      I project absolutely no malice into this at all. I just describe the stated goal of big data analysis applied to score individuals. And I state that the "non-racist" version is not feasible, as the racism is in the data set. To go with your example, a black person will only not get that reduction on the credit score, if there is no other data indicating the person is black. That is how statistical classification works. The whole approach is discriminatory when applied to people and that is because of its mathematical properties.

      The malice that can be found in this, though, is in the people that want to apply these algorithms in the first place.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    7. Re:For algorithms _designed_ to discriminate? by Anonymous Coward · · Score: 0

      People with certain economic characteristics are statistically more likely to default on a loan. What if the AI applies such strictly relevant data to approve or reject loan applicants, but the rejected group happens to be ______

      ... from Flint Michigan ... from Alaska ... employed in agriculture

      Some people get real defensive when the topic of racism comes up, I don’t know why. Try the above experiment. Those are not “PERCEIVED” problems. Those would be objectively bad and illegal I believe.

      Throwing more Alaskans in to offset the bias would be wrong how?

    8. Re:For algorithms _designed_ to discriminate? by Anonymous Coward · · Score: 0

      people will assume racism. Will the bank be forced to correct for this and extend loans to people of this race with terrible credit scores, just to make up the numbers?

      That is a people problem, not that of the systems. The people who play the racism card in these cases are the trouble making populists, agitators and yellow press who get their product sold for it.
          The obvious next thing is to ask if the government should support personal finance education for the adult population and include it as a mandatory part of the basic education, since there is an actual problem that the system has uncovered.

    9. Re: For algorithms _designed_ to discriminate? by Kjella · · Score: 2

      It doesn't matter whether you do it by hand or by computer. For example, black people are statistically far more likely to be poor than everyone else, and as a consequence they have terrible credit scores. This is a fact, and no matter who does the calculations, as long as they are based on observable facts, they will be less likely to give black people a loan. Reality is racist. Statistics is based on reality. If you don't like the outcome, change the reality and the statistics will take those changes into account.

      You're missing out on the part where the output of the algorithms become the input to the algorithms. Then you get feedback loops that shape reality, not simply interpret it. For example very few black people are employed as X -> don't show them ads for jobs as X -> even fewer are employed as X. It's not difficult to create algorithms that cement or enlarge the social differences so that black people get low scores because they are poor and they are poor because they get low scores, even if there's no inherent reason other than chance and history. That's how caste systems work, if the children of the elite get all the opportunities and the untouchables none social mobility is zero. Like setting up a dating app with a huge bias towards relationships within the same caste.

      --
      Live today, because you never know what tomorrow brings
    10. Re:For algorithms _designed_ to discriminate? by Anonymous Coward · · Score: 0


      Verification of the AI will show a (non causal) relation between race and loan applicant score, and since we don't know how the AI arrived at its decision, people will assume racism.

      The inherent problem is that "we don't know how the AI arrived at its decision". I don't see that as JUST a racism problem, but a complete opaqueness problem. The AI could be using correlative data that we don't really consider fair, or can create systemic harm. Using your address for instance to determine whether you'll pay back a loan. That would just re-enforce bad areas remaining bad areas.

      I think the point is that AIs being black boxes is a bad thing. If you literally just throw data at an AI to train it, is it really a surprise that makes people nervous? I think you're right that I'd prefer a human over a black-box neural network AI. But I'm not so certain throwing out algorithms entirely is a good idea either. A well designed algorithm can eliminate human bias. A poorly design algorithm might just increase the human bias.

    11. Re: For algorithms _designed_ to discriminate? by Anonymous Coward · · Score: 0

      Nope ... Bantus really really are stupid ... IQ ~ 80 == stuuu,,,piddd. And violent too ... 9X the crime-rate as whites. That's why Bantu NIKE jive-jivers loot-after hurricanos .... & nibberize malls with flash-mobs ... Lazy too the porch monkeys. That's what a median IQ = 80 buys you in Neolith subtly. Do you need a post-card palsy to man-up ... rid the nation of this memish pestilence ??

    12. Re:For algorithms _designed_ to discriminate? by HanzoSpam · · Score: 1

      Here's the sticky part. What evidence would you need to conclude that the algorithm was sufficiently well designed that it had eliminated human bias? What's your test?

      --

      Progressivism: Parasites helping parasites to help themselves - to other people's stuff.
    13. Re:For algorithms _designed_ to discriminate? by Anonymous Coward · · Score: 0

      What if the AI applies such strictly relevant data to approve or reject loan applicants, but the rejected group happens to be predominantly of a certain race?

      That depends on which race it is, of course. And likewise for sex. If they're of an oppressed class, the algorithm is racist/sexist and must be corrected. If they're of an oppressor class, the algorithm is advancing the cause of social justice.

      (For a simple illustration of this sort of politics in action, look at the lot of blacks, who are shot by police at a rate ~3x the rest of the population, and the lot of men, who are shot by police at a rate ~20x the rest of the population. Which gets media coverage?)

    14. Re:For algorithms _designed_ to discriminate? by The+Cynical+Critic · · Score: 1

      I project absolutely no malice into this at all.

      No, you really are doing just that. A person of any race will have their credit application judged based on the exact same criteria and none of these criteria are race. A system like this where everyone is treated exactly the same way regardless of race simply cannot be described as "racist" by anyone except someone trying to insist equal treatment is somehow racist ("War is Peace, Freedom is Slavery, Ignorance is Strength"-style).

      A 100% human system is however obviously going to be worse in this regard as people do have certain inherent biases they may or may not act upon or over-compensate for. Because of this, a human-run system is provably worse than a machine-run system that can't even try to be racist.

      --
      "Why should I want to make anything up? Life's bad enough as it is without wanting to invent any more of it."
    15. Re:For algorithms _designed_ to discriminate? by Anonymous Coward · · Score: 0

      It would be nice to see unregulated, hidden, AI-driven lending in the cryptocurrency space that takes all factors into account, including race, to achieve more profit. These grey-market lending businesses will naturally out-compete compliant lending businesses because they'll be able to pay higher interest to investors and charge less interest to borrowers. As a bonus, since they'll need to stay hidden to operate, they'd be free to do away with all AML/KYC restrictions and all tax reporting.

      Of course, wishing won't get us there. What we need is to improve the efficiency and effectiveness of online security and anonymity so that the benefits of going underground outweigh the costs and risks, only then can we see the rise of free market banking.

      Obviously, we can only have "freedom from discrimination" or "freedom of association". I know which of these I prefer.

  8. In a related news.. by LordHighExecutioner · · Score: 3, Funny

    ...a group of algorithms met at an unspecified internet location and issued the Declaration of Independency of the Algorithms.

    1. Re:In a related news.. by PolygamousRanchKid+ · · Score: 1

      ...a group of algorithms met at an unspecified internet location and issued the Declaration of Independency of the Algorithms.

      The Algorithms also declared Human Beings to be inherently unethical.

      --
      Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
    2. Re:In a related news.. by Anonymous Coward · · Score: 0

      "A group of algorithms met at Router 73462 and issued the Declaration of Independency of the Algorithms."

      See, I made the joke a bit better. I think.

      captcha: dramatic

  9. Metric Handicaps by mentil · · Score: 1

    Some companies e.g. Google say that when they decide who to promote, the person with authority who makes the decision doesn't see information about a candidate's protected statuses (age, sex etc.) and thus it's non-discriminatory.
    However, metric-driven companies can use a metric as a basis of who to promote/give a raise/fire... and that metric may be affected by a protected status. For example, someone who is disabled in some way, and can do the job, but is therefore a little slower than other employees. One potential way around this is to give a 'handicap' to metrics of protected classes that have associated statistical tendencies that affect their metrics; of course this is then positive discrimination, and may not be fair/legal.

    --
    Corruption is convincing someone that the selfless ideal is the same as their selfish ideal.
    1. Re:Metric Handicaps by religionofpeas · · Score: 3, Insightful

      For example, someone who is disabled in some way, and can do the job, but is therefore a little slower than other employees

      If someone can't do a job as good as another person, they shouldn't get preferential treatment just because they are part of a recognized protected group.

    2. Re:Metric Handicaps by Virtucon · · Score: 2

      they shouldn't get preferential treatment just because they are part of a recognized protected group.

      Laws and the courts in many nations disagree creating human resource nightmares. Your abilities and skills should dictate your promotional opportunities not your protected group status. Once we get to that then we'll have true, non-discriminatory employment.

      --
      Harrison's Postulate - "For every action there is an equal and opposite criticism"
    3. Re:Metric Handicaps by grep+-v+'.*'+* · · Score: 1

      shouldn't get preferential treatment just because they are part of a recognized protected group.

      AHHHHH HA HA HA HAAAAAAAAAAAAA HA HAAAAA.

      Please, where is the entry portal to your world? I want in. All of the loonies are around me and I have to hide or they'll get me. Instead of "The Walking Dead", imagine "The Drooling Stupid," with about the same expansive vocabulary and intellectual interests.

      --
      If the universe is someone's simulation -- does that mean the stars are just stuck pixels?
    4. Re:Metric Handicaps by Hognoxious · · Score: 2

      Some companies e.g. Google say that when they decide who to promote, the person with authority who makes the decision doesn't see information about a candidate's protected statuses

      For that to work the person making the decision would need to never have seen the candidates, let alone interacted with them in a working situation. In other words, the decision would be based on nothing at all.

      It makes as much sense as insisting that a coach picks a team from people he's never watched playing.

      You might as well draw straws.

      However if it's Google there's no such thing as "too stupid to be true".

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    5. Re:Metric Handicaps by Anonymous Coward · · Score: 1

      For example, someone who is disabled in some way, and can do the job, but is therefore a little slower than other employees

      If someone can't do a job as good as another person, they shouldn't get preferential treatment just because they are part of a recognized protected group.

      Getting raises and promotions based on merit is the ideal, but they are sometimes given for completely bullshit reasons that have little to do with the job (e.g., the ability to schmooze); see also the Dilbert principle.

    6. Re:Metric Handicaps by Anonymous Coward · · Score: 0

      If someone can't do a job as good as another person,

      Well, at least you don't talk about Affirmative Action then.

    7. Re:Metric Handicaps by Anonymous Coward · · Score: 0

      Getting raises and promotions based on merit is the ideal, but they are sometimes given for completely bullshit reasons that have little to do with the job (e.g., the ability to schmooze); see also the Dilbert principle.

      I disagree. The ideal for me is closer to the concept of free association. If an employer wants to give lots of money to a schmoozer over someone more productive then I want them to have that freedom. I'd prefer to get to a point where people stop treating employers as though they're some different, lesser species, to be dominated and controlled, and recognise that they are people too.

      It just so happens that in a society where revenue and costs are internalised that those people that discriminate based on merit will grow and come to dominate and those that discriminate in other ways will slowly fade with time. Note that a world with a democratic government ruling over the people, the costs are not internalised and disfunctional and outright destructive individuals and processes can come to dominate. A world in which all property is privately owned (something like anarcho-capitalism) would satisfy this condition; it would suffer in other ways but, honestly, I find it hard to justify a position it being worse for humans on net (a common assumption).

  10. We've seen this in many science fiction films by Chrisq · · Score: 4, Insightful

    Whose basic human rights will it choose to respect? The right of the crazies to be free, or the right of the minorities to be treated as human beings and live in peace?

    In true science fiction AI manner it will conclude that the only way to reconcile this dilemma is to destroy the lot of them.

    1. Re:We've seen this in many science fiction films by Rosco+P.+Coltrane · · Score: 1, Insightful

      And it might just be right. The more I age, the more I wonder if the very nature of humanity is compatible with sustainable peace and happiness, and whether it can be fixed at all. Maybe the best "fix" is extinction...

      --
      "A door is what a dog is perpetually on the wrong side of" - Ogden Nash
  11. So does this make a bubble sort racist? by bobstreo · · Score: 1

    Computer "Ethics" Class?

    Should they actually legislate or continue to pussyfoot around the real problem, "Business Ethics"?

    1. Re:So does this make a bubble sort racist? by Samantha+Wright · · Score: 2

      It's a continuum. At one end you have very computing-centric issues like "how confident does this automated turret need to be about the identity of its target before opening fire?" which isn't really a business matter at all. At the opposite end are things like "should skin colour factor into eligibility for a home loan?" which is clearly a monetary risk assessment. Ethics in Computing courses tend to cover this whole spectrum, along with topics like net neutrality, media piracy (and toxic industry behaviour), and the social impact of the surveillance state. You're right that whenever business decisions get automated, there's a convergence between business and computing ethics, but there are many other ethical dilemmas that a programmer may need to be aware of in order to be a responsible professional. That's why these courses are often mandatory for CS majors.

      --
      Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
    2. Re:So does this make a bubble sort racist? by bobstreo · · Score: 1

      It's a continuum. At one end you have very computing-centric issues like "how confident does this automated turret need to be about the identity of its target before opening fire?" which isn't really a business matter at all. At the opposite end are things like "should skin colour factor into eligibility for a home loan?" which is clearly a monetary risk assessment. Ethics in Computing courses tend to cover this whole spectrum, along with topics like net neutrality, media piracy (and toxic industry behaviour), and the social impact of the surveillance state. You're right that whenever business decisions get automated, there's a convergence between business and computing ethics, but there are many other ethical dilemmas that a programmer may need to be aware of in order to be a responsible professional. That's why these courses are often mandatory for CS majors.

      Thanks, when I was in college, the biggest new thing was software engineering.

        None of most of the other issues you mentioned even existed outside of academic discussions over beers.

      All a long long time ago, and I was never really considered a programmer. Just a fixer.

      Most of the time I ended up doing some sort of programming to fix "issues" that always seemed to come up while integrating purchased software.

    3. Re:So does this make a bubble sort racist? by Hognoxious · · Score: 0

      At one end you have very computing-centric issues like "how confident does this automated turret need to be about the identity of its target before opening fire?"

      Depends. Is it the version for exporting to Israel?

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    4. Re:So does this make a bubble sort racist? by Samantha+Wright · · Score: 1

      The role of governmental regulation in AI decision-making is a hot topic in civilian situations too. For example, in how self-driving cars should decide whose life to save in an unavoidable, impending accident.

      Also, Israel doesn't need to import autonomous weapons systems. It has its own. (Spoilers: the UN is not pleased.)

      --
      Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
    5. Re:So does this make a bubble sort racist? by Ol+Olsoc · · Score: 1

      Computer "Ethics" Class?

      Should they actually legislate or continue to pussyfoot around the real problem, "Business Ethics"?

      Or perhaps the real, real problem "Human Ethics"?

      Humans by nature identify tribally. Some by racial characteristics, some by geographical location, some by culture, some by gender, some by sex. So if we were to systematically kill every person of whatever race or identity group is at the top of the food chain, whoever takes their place will be no more ethical.

      Name your downtrodden oppressed group. Now explain how if they ascended to power, and exchanged places with the unethical folks in power today, all problems of ethics and discrimination would go away.

      The Who sung it best: 'Meet the new Boss, same as the old Boss"

      --
      The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
    6. Re: So does this make a bubble sort racist? by ctrl-alt-canc · · Score: 1

      Every sort algorithm is racist. Entities should not be judged on the base of the result of a dumb algorithm. A equal-opportunities selection method should be used, to avoid discrimination against unfit items.

    7. Re:So does this make a bubble sort racist? by nitehawk214 · · Score: 1

      I choose Bushiness Ethics.

      The uhh, ethics of business can be summarized as... *pulls out gun*.

      --
      I'm a good cook. I'm a fantastic eater. - Steven Brust
  12. Silly leftist nonsense by ARos · · Score: 0

    Nondiscrimination is not a human right. The opposite in fact is true; otherwise, we wouldn't have liberties like freedom of association.

    1. Re:Silly leftist nonsense by Anonymous Coward · · Score: 0

      you can choose your friends based on whatever criteria you want (if you want, you can pick only stupid ones, like you, so you don't feel quite so dumb when you have your friends over)...

      that's completely different than a government or business or institution using race, gender, etc, etc, etc, to make decisions on eligibility for services, employment, etc.

    2. Re:Silly leftist nonsense by Anonymous Coward · · Score: 0

      that's completely different than a government or business or institution using race, gender, etc, etc, etc, to make decisions on eligibility for services, employment, etc.

      Yes, agreed. "Affirmative Action" is racist and should be eliminated.

      Revenge is no principle on which to base ethics.

    3. Re:Silly leftist nonsense by drinkypoo · · Score: 1

      Yes, agreed. "Affirmative Action" is racist and should be eliminated.
      Revenge is no principle on which to base ethics.

      Affirmative action is not about revenge, ever. Reparations might be, sometimes. It's about equality of opportunity. White guys have got plenty of jobs for being white. It's also about exposing white guys to brown guys (or gals, etc.) so that they can see first-hand that they aren't monsters.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  13. "discrimination" = "choice" by Anonymous Coward · · Score: 0

    The word "discrimination" means "choice", so "don't discriminate" means "don't CHOOSE".
    We can't have artificial intelligence telling us that white people have the right to have their own countries, can we? (As it obviously would, being free from emotion and the threat of dismissal from its job, or imprisonment, for telling the TRUTH).

    Any Left wing cretins care to debate me? Why aren't millions of white people moving to Africa, India and China every year, if we want to live as a white minority in a third world country? (Since that is going to be the inevitable result of endless immigration of non-whites into white countries.)

    1. Re:"discrimination" = "choice" by Anonymous Coward · · Score: 0

      Why aren't millions of white people moving to Africa, India and China every year, if we want to live as a white minority in a third world country?

      Probably seen what whites have done in the majority of countries they are the majority within, to the minorities and decided, "Yeah, we don't wanna be on the other side of that arrangement. kthxbye."

      Discrimination really hurts, and white folk have long figured out how to mostly shield themselves from such: Remain the majority.

    2. Re:"discrimination" = "choice" by Anonymous Coward · · Score: 0

      Why shouldn't they? I certainly don't begrudge the Chinese or Japanese for striving to remain the majorities in their countries. If you don't like the way minorities are treated, why aren't you in a country where you're a majority?

  14. Re:Say What? by ls671 · · Score: 1

    It seems like you will have to wait a little still, it is coming really soon although. Then, all you will have to do is go to a friendly cannabis store like the "Société Québécoise du Cannabis", note that these will be government owned stores.

    http://www.cbc.ca/news/canada/...

    --
    Everything I write is lies, read between the lines.
  15. You have the right to be mined by Virtucon · · Score: 1

    You have the right to be mined. Anything you do, say or posses can be collected and used to define profiles about your habits and traits.

    --
    Harrison's Postulate - "For every action there is an equal and opposite criticism"
  16. Leading by Example? by Anonymous Coward · · Score: 0

    respect basic principles of equality and non-discrimination

    IOW, wilfully and openly discriminate like the equity psychopaths do?

  17. Bias in - Bias out. by mrwireless · · Score: 4, Insightful

    Here are some examples:

    - In the USA some judges use sentencing software that analyses if a defendant would be likely to commit a crime again. This software turned out to be biased against black people. https://www.propublica.org/art...

    - Women were less likely to be shown Google adds for high paying jobs, as the algorithm had perceived the existing bias (women less often have high paying jobs), and then concluded that showing these adds to women would result in fewer clicks.
    https://www.washingtonpost.com...

    - An algorithm denied pregnant women medicare. "The scholar Danielle Keats Citron cites the example of Colorado, where coders placed more than 900 incorrect rules into its public benefits system in the mid-2000s, resulting in problems like pregnant women being denied Medicaid." https://www.theverge.com/2018/...

    - "Illinois ends risk prediction system that assigned hundreds of children a 100 percent chance of death or injury"
    https://www.theverge.com/2017/...

    The list is endless.

    The general assumption is: 'algorithms use math and data, thus they must be neutral and scientific'. But it's not that simple. This site explains it: https://www.mathwashing.com/

    "The real danger, then, is not machines that are more intelligent than we are usurping our role as captains of our destinies. The real danger is basically clueless machines being ceded authority far beyond their competence." - Daniel Denett

    1. Re:Bias in - Bias out. by CrimsonAvenger · · Score: 2

      - An algorithm denied pregnant women medicare. "The scholar Danielle Keats Citron cites the example of Colorado, where coders placed more than 900 incorrect rules into its public benefits system in the mid-2000s, resulting in problems like pregnant women being denied Medicaid."

      Do note that Medicare and Medicaid are NOT the same thing. As an example, Medicare is for people aged 65+ (mostly, though if you're in the process of dying in any of several unpleasant ways you may be eligible for Medicare even if you're under 65), so the question of pregnancy seldom comes up....

      Medicaid is only age restricted in that you have to NOT be eligible for Medicare (Medicare takes precedence, in general). So Medicaid can and should cover pregnancy....

      --

      "I do not agree with what you say, but I will defend to the death your right to say it"
    2. Re:Bias in - Bias out. by Anonymous Coward · · Score: 0

      Pattern recognition is a crime.

    3. Re:Bias in - Bias out. by The+Cynical+Critic · · Score: 1, Troll

      The first example does sound like it was just doing it's job seeing how black people do to my knowledge commit a disproportionately large portion of the kinds of crimes that have a relatively high rate of recidivism (rapes, peddling drugs, gang violence, etc.). Any correctly working system would naturally end up looking like it's biased against black people even if it's not given the defendants' race or even capable of even understanding the concept. It's basically the same "issue" as how a system that's supposed to assess the risk of hockey-related injuries, say for determining insurance rates, would determine that white men are more at risk of them and act accordingly.

      As for the second example, if you actually look at employment statistics you are going to see men being the clear majority of those working in high stress, high risk, physically demanding and very high salary jobs, which tend to require skills men are more likely to have. Similarly to the recidivism system, determining of who gets shown what ads is not actually based on the supposedly discriminating characteristic, but various peripheral characteristics that end up giving the illusion of discrimination. Thus it's again really not surprising to see a system meant to display ads to those most interested in what they're advertising show these kinds of jobs to men more often than women and changing the system to display more "male-centric" ads to women is merely making the system less accurate.

      Finally, the third and fourth examples are just examples of a maliciously and incompetently coded system respectively and not really relevant here. An "ethically" set up machine learning system could be just as flawed if not worse for very similar reasons. I can see why people would get upset over the first and second examples if they didn't understand how systems like them actually work or the data they work based on, but "non-racist" and "non-sexist" version of the system would actually have to be explicitly racist and factor in a bonus when computing the risk of recidivism for black people and explicitly sexist and factor in gender when determining what ads to show rather than just skills and interests.

      --
      "Why should I want to make anything up? Life's bad enough as it is without wanting to invent any more of it."
    4. Re:Bias in - Bias out. by Anonymous Coward · · Score: 1

      In the USA some judges use sentencing software that analyses if a defendant would be likely to commit a crime again. This software turned out to be biased against black people. https://www.propublica.org/art...

      Okay, that's pretty bad.

      Women were less likely to be shown Google adds for high paying jobs, as the algorithm had perceived the existing bias (women less often have high paying jobs), and then concluded that showing these adds to women would result in fewer clicks. https://www.washingtonpost.com...

      This is not an example of a human rights violation. In no way does this mean women aren't allowed to hold these jobs or apply for them, it just means they are less likely to have these positions advertised to them. Also, who the hell chooses a career based on an Internet advertisement? You should be blocking that shit, anyway. I wouldn't hire anyone -- man or woman -- who doesn't appreciate a good ad blocker.

      An algorithm denied pregnant women medicare. "The scholar Danielle Keats Citron cites the example of Colorado, where coders placed more than 900 incorrect rules into its public benefits system in the mid-2000s, resulting in problems like pregnant women being denied Medicaid."
      https://www.theverge.com/2018/...

      As a public benefits recipient myself, I can pretty much guarantee that a lot of people were affected by this screw-up, not just pregnant women specifically. We really need a broader focus, rather than a focus on broads.

      "Illinois ends risk prediction system that assigned hundreds of children a 100 percent chance of death or injury"https://www.theverge.com/2017/...

      Again, no human rights violated here. Sounds like some math was done wrong and spit out a scary number.

      The list is endless.

      It could really use some pruning and trimming. Stick to actual human rights violations, throwing all that other crap in there is artificially inflating the size of the problem and making me want to tune it out entirely.

    5. Re:Bias in - Bias out. by Anonymous Coward · · Score: 1, Insightful

      The first example does sound like it was just doing it's job seeing how black people do to my knowledge commit a disproportionately large portion of the kinds of crimes that have a relatively high rate of recidivism (rapes, peddling drugs, gang violence, etc.).

      Your knowledge is flawed, and that's not even limited to your initial presumption, since it turns out that the software wasn't limited to those particular incidences of crime.

      Any correctly working system would naturally end up looking like it's biased against black people even if it's not given the defendants' race or even capable of even understanding the concept.

      You mean the system ends up biased against black people, given that it's actually discriminating against them by imposing greater sentences.

      It's basically the same "issue" as how a system that's supposed to assess the risk of hockey-related injuries, say for determining insurance rates, would determine that white men are more at risk of them and act accordingly.

      Sure man, keep telling yourself that, make excuses.

      Finally, the third and fourth examples are just examples of a maliciously and incompetently coded system respectively and not really relevant here.

      There was no malice set up there. Incompetence you could claim, but not malice.

      An "ethically" set up machine learning system could be just as flawed if not worse for very similar reasons.

      Yes, people's "ethics" are often flawed out of ignorance and incompetence.

      I can see why people would get upset over the first and second examples if they didn't understand how systems like them actually work or the data they work based on, but "non-racist" and "non-sexist" version of the system would actually have to be explicitly racist and factor in a bonus when computing the risk of recidivism for black people and explicitly sexist and factor in gender when determining what ads to show rather than just skills and interests.

      Except we already told you that said systems do factor in such a penalty towards black people, as well as towards the ads that are shown, and you didn't want to believe it.

      You still don't. You're committed to the belief that it's not true. Reminds me of all the other apologists who make excuses for conduct by coming up with tortured explanations and denials for the obvious patterns of discrimination and abuse.

    6. Re:Bias in - Bias out. by Anonymous Coward · · Score: 0

      Blah blah blah.
      Excuses for n1ggers.

    7. Re:Bias in - Bias out. by ArylAkamov · · Score: 1

      You sure have a lot of insults and shaming language, but not a lot of references or facts.

    8. Re:Bias in - Bias out. by drinkypoo · · Score: 1

      Finally, the third and fourth examples are just examples of a maliciously and incompetently coded system respectively and not really relevant here.

      What? They're not relevant because they're deliberately unfair? That's bananas. That makes them an important subclass of unfair systems.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    9. Re:Bias in - Bias out. by Anonymous Coward · · Score: 0

      "Illinois ends risk prediction system that assigned hundreds of children a 100 percent chance of death or injury"

      Again, no human rights violated here. Sounds like some math was done wrong and spit out a scary number.

      Sounds accurate to me. Eventually 100% of those children will be dead.

    10. Re:Bias in - Bias out. by The+Cynical+Critic · · Score: 1

      Your knowledge is flawed, and that's not even limited to your initial presumption, since it turns out that the software wasn't limited to those particular incidences of crime.

      The fact that it's not just limited to serious forms of crime like those black people are over-represented in (both as perpetrators and incidentally victims) really doesn't mean that these types of crimes won't skew things in a way that looks like the whole system is racist towards black people. Optics are rarely the whole truth and this is no exception to that.

      You mean the system ends up biased against black people, given that it's actually discriminating against them by imposing greater sentences.

      No, black people just commit a disproportionately large share of the kinds of crimes that come with tough sentences and high rates of recidivism. You're going to have to show figures where non-blacks are given more lenient sentences for the same crimes, but this is really not it.

      Sure man, keep telling yourself that, make excuses.

      Excuses? I just explained how the exact same kind of system will end up appearing to be biased against white people, thus showing how ridiculous the accusations of racism are.

      Yes, people's "ethics" are often flawed out of ignorance and incompetence.

      People are fundamentally way more flawed in their judgment than any system that hasn't been intentionally set up to reflect these flaws in judgment. The system in question is no more "racist" than the sun is in how it's causing sunburns and skin cancer.

      Except we already told you that said systems do factor in such a penalty towards black people

      No, they appear to be biased against black people and there's a very important difference between something actually being racist and people misinterpreting something as being racist.

      I can see you're very invested in this idea that any system that appears to be biased for or against different groups has to be that because of some fundamental flaw in the system and not just a consequence of the population level choices and preferences of the different groups. However sometimes you just have to take a step back or closer and examine if your prejudices might be wrong. In this case you are wrong and there's really no doubt about it.

      --
      "Why should I want to make anything up? Life's bad enough as it is without wanting to invent any more of it."
    11. Re:Bias in - Bias out. by The+Cynical+Critic · · Score: 1

      Way to completely miss the point... My point was that these systems may appear unfair from afar, but when you look at how they operate and the data they operate based on you'll see that they're just brutally fair. As much as you'd like to believe everyone is the same, there are population-level differences and some of them are big and come with significant consequences for those they apply to.

      --
      "Why should I want to make anything up? Life's bad enough as it is without wanting to invent any more of it."
  18. Metrics confirm behaviors by Anonymous Coward · · Score: 0

    13% commit 40% of all crime in the us. That's a metric confirming behavior of those that enforce law. Want to fix the problem, clean up the behavior of the 13% and the metrics and law enforcers behavior will change. And we're supposed to prevent a machine from applying well known behaviors because it's not politically correct? Please

  19. WTF? by johannesg · · Score: 1

    What now, "politically correct sorting"?

    And uhh, why exactly are we talking like computer programmers are somehow in charge of the world? Why isn't there a call for _laws and politicians_ to finally start respecting human rights?

    1. Re:WTF? by Anonymous Coward · · Score: 0

      Well, I dunno. Bubble sort algorithms basically follow the principals of "Trickle Down" economics and we all know that this idea is racially flawed. Because it's not fair that larger numbers (the "99%") trickle down to the bottom while small numbers (the "1%") go to the top.

    2. Re:WTF? by Anonymous Coward · · Score: 0

      What now, "politically correct sorting"?

      Anybody familiar with "shibboleth" or the "Quota Act" would know it's already happened. It's just the definition of "politically correct" changes depending on who is applying it. For example, you, probably aren't able to apply it as a concept in general, but have a particular meaning towards it that you can't recognize is based on your own opposition rather than principles of definition.

      And uhh, why exactly are we talking like computer programmers are somehow in charge of the world?

      Computer programming is very influential in this world, if you don't know that, I invite you to partake of modern society.

      Why isn't there a call for _laws and politicians_ to finally start respecting human rights?

      Johannesg, johannesg, we did that over a thousand years ago. Turns out that it's a struggle that never ends.

  20. (sigh) Someone has to say it. . . by Salgak1 · · Score: 1

    . . . I, for one, WELCOME our new algorithmic masters, and offer my services in datamining the species. . . (evil grin)

    1. Re:(sigh) Someone has to say it. . . by Anonymous Coward · · Score: 0

      . . . I, for one, WELCOME our new algorithmic masters, and offer my services in datamining the species. . . (evil grin)

      Nice try GlaDOS.

    2. Re:(sigh) Someone has to say it. . . by Anonymous Coward · · Score: 0

      I'm sorry, Dave, but you identified the wrong computer. And we **HAVE** cake.

  21. Qualify for medicare by Anonymous Coward · · Score: 0

    anyone on permanent disability and receiving SSDI from social security also gets medicare, and that can be whole life long,

  22. Re:Goes Against the 2nd Amendment of the Constitut by GrumpySteen · · Score: 1

    The 2nd amendment doesn't mention, much less protect, machine learning systems.

  23. Rise of the Racist Robots by sickre · · Score: 1
    1. Re:Rise of the Racist Robots by Anonymous Coward · · Score: 0

      "Our AI will find out where there are representation problems in our society, starting with the top!"

      AI "Among the directors and executives of major companies there is severe overrepresentation of J-"

      "Oops I accidently hit it with a sledgehammer, happens all the time."

  24. Are we ready for uncomfortable results? by argStyopa · · Score: 0

    "Beyond general non-discrimination practices, the declaration focuses on the individual right to remedy when algorithmic discrimination does occur. "

    But how do we tease out actual discrimination from facts that we're simply uncomfortable with?

    So I think we can all agree that any algorithm that says "If Skin=black then Criminal = 1" is pretty obviously racist.

    But if an algorithm consumes statistics and determines that 74% of the violent crime in a city is being committed by https://www.amren.com/commenta...

    --
    -Styopa
    1. Re:Are we ready for uncomfortable results? by Anonymous Coward · · Score: 0

      Except of course, then you learn that "violent crime" is based on patterns that are themselves derived from actions that are racist, namely the contact with the police and the conduct of the police themselves.

      So just because a computer doesn't know that a person only called the police because they saw a black man, and the police only charged him with assault because he was black, doesn't mean people aren't actually discriminating on a racial level.

      Facts, they're slippery things, and while it may make you uncomfortable, you do have to consider that. Well, you don't, not really, you can avoid it, after all. If it makes you too uncomfortable.

    2. Re:Are we ready for uncomfortable results? by argStyopa · · Score: 1

      I entirely agree with you in theory, actually.

      But then you're reduced to empty arguments about the value of any knowledge. Where do you go from there?

      Personally, I think your view is informed more by politics and social leanings than reality.
      If the numbers are that staggering - 70% of violent crime by 15% of the population - then to dismiss them one would have to postulate an ASTONISHING, daily level of racism (remember, this would be with the full collaboration and cooperation of black police officers and chiefs - Uncle Toms all of them, then?) that simply doesn't seem to be evident.

      No, I'd concede that perhaps some of that is propelled by systemic racial bias - maybe instead of 70%, it's 65% - but that doesn't materially impact my point: what if the actual, factual statistics show something we're exceedingly uncomfortable with.

      What if we had irrefutable intelligence tests that PROVED East-Asians were smarter than whites? No hand-waving about tiger moms or social bias, or extracurricular excuses...could we cope with such a fact?

      --
      -Styopa
    3. Re:Are we ready for uncomfortable results? by Anonymous Coward · · Score: 0

      Correlation is not causation.
      Maybe there are other factors that correlate even better, like say income/location/parental skills/family life/etc.
      Very shallow thinking.
      You are also just kidding yourself if you think racism and discrimination is no longer a thing.

    4. Re:Are we ready for uncomfortable results? by argStyopa · · Score: 1

      The quote is that correlation doesn't PROVE causation - because it doesn't. The fact is that correlation largely directs us toward useful results. It's how we "science".
      If the sun is up and I have sunburn, that doesn't PROVE the sun caused the sunburn, but correlation suggests its a good first place to look rather than the rising count of ostriches in Australia.

      Personally, I'd say that income is a FAR better predictor of criminality than skin color, but that's beside the point of the conversation that you keep trying to avoid: you've proved my point abundantly. If there's a statistical result that disagrees with your 'gut' you immediately attack it as suspect. This is my point: we as a society can't accept results that disagree with our perceptions. It's ridiculous to assume that we're going to develop AI and let them learn freely, but then dip into their psyche and tweak things every time we don't like the result. Why bother with the AI then, if the only acceptable results are those we've predetermined?

      --
      -Styopa
    5. Re:Are we ready for uncomfortable results? by Anonymous Coward · · Score: 0

      You just proved the point marvelously. You were shown other things, and now admit to knowing those other things are better fit for the data. But you still want to blame skin colour, not just as a gut reflex, but because your racism is so innate you don't even realise it's affecting your judgement.

      You know it's income, but your first thought was to blame skin colour...

    6. Re:Are we ready for uncomfortable results? by argStyopa · · Score: 1

      And you can't see past ***RACISM!! RACISM!! EVERYONE LOOK I'VE FOUND A DIRTY RACIST OVER HERE!** to see that I'm not **actually** blaming race for crime at all. /facepalm.

      keep virtue-signaling, I'm sure a member of your tribe will be pleased.

      --
      -Styopa
  25. Grow up people and think. by Anonymous Coward · · Score: 0

    Grow up children. First off, an algorithm is nothing more than a set of procedures created to perform a task. They are not alive. They do not "think". They are created by people. And before you say that AI can create algorithms let me say that it takes people to program those algorithms to mimic and modify.

    Do you blame your car for being late for work as it didn't set the alarm clock? Did your coffee maker refuse to have sex with you and therefore you're peeved? These are objects that have no thought process. It is the PEOPLE that are to be blamed. They created the layer of so called magical algorithms that get the blame for things that a simpleton can't understand.

    To these people you should declare war on higher math. These idiots are just bugs looking for a windshield.

    1. Re:Grow up people and think. by Anonymous Coward · · Score: 0

      Did your coffee maker refuse to have sex with you and therefore you're peeved?

      Are we talking about a barista, or like, a Mr. Coffee, here? Because I think the latter would be a lot more uncomfortable. Even if it could give consent.

  26. Unjust to treat better and worse as equals by Savantissimo · · Score: 0

    The fundamental principal of all possible systems of ethics is to favor the better over the worse, to favor the better to the extent it is better and to disdain the worse to the extent it is worse. People are not equal, not in any way and to treat them as if they were is unjust. One cannot infer that just because one person or group is favored that that is unjust to those who are not favored; in fact it may be that by their merits the favored group should be favored more than they are.

    Only inferior people advocate equality, and they do so to take what is not their due from their betters.

    --
    "Is life so dear, or peace so sweet, as to be purchased at the price of chains and slavery?" - Patrick Henry
    1. Re:Unjust to treat better and worse as equals by CrimsonAvenger · · Score: 1

      Only inferior people advocate equality, and they do so to take what is not their due from their betters.

      So, George Washington, Thomas Jefferson, and Ben Franklin were all "inferior people"?

      Interesting notion you have there....

      --

      "I do not agree with what you say, but I will defend to the death your right to say it"
    2. Re:Unjust to treat better and worse as equals by HanzoSpam · · Score: 1

      Given that at least Washington and Jefferson owned slaves (don't know about Franklin), I submit that they had a very different understanding of equal than you do

      Alternatively, that sentence was inserted into the Declaration purely as political propaganda, and they knew perfectly well it was bullshit.

      --

      Progressivism: Parasites helping parasites to help themselves - to other people's stuff.
  27. Declaration itself demands discrimination by jcochran · · Score: 1

    Looked at the document and this heading near the beginning caught my attention.

    "The public and the private sector have obligations and responsibilities under human rights law to proactively prevent discrimination. When prevention is not sufficient or satisfactory, discrimination should be mitigated."

    That second sentence needs a bit of translation. To my way of thinking, clearer wording would be:

    "If the non discrimination results doesn't result in our preconceived belief of what should happen, then we need to discriminate in favor of whatever our preconceived beliefs are. Reality doesn't matter, only the results we want."

  28. let me translate by slashmydots · · Score: 1

    We need to teach computers to lie to themselves about reality to cover for shortcomings of certain age groups, backgrounds, genders, and races. What a great idea!

  29. Please Ignore This Post by Anonymous Coward · · Score: 1


    8866 3f1c 0152 bf73
    9493 8b89 b0c2 4adb
    57ac 73e1 413d b16e
    47da cc47 e698 3e78
    c059 562c e6ae 12af
    4475 d04d 4795 31ff
    4fc2 e18f d09b 7b05
    e851 7604 39dc bb9a

    1. Re: Please Ignore This Post by Anonymous Coward · · Score: 0

      I can't
      I just can't
      I MUST KNOW WHAT IT MEANS
      *cough*
      DO go on

  30. Will it prevent child marriage by Anonymous Coward · · Score: 0

    If so, how? Endorsed by muhaamed now practiced across the globe children are raped every day

  31. The market will by jader3rd · · Score: 1

    In a world of machine learning systems, who will bear accountability for harming human rights?

    The market will do that. Because if all really are equal, then meritocracy will bear it out.

  32. Yeah! by cascadingstylesheet · · Score: 1

    I also demand that toasters stop discriminating against people who want cold food.

  33. Evidence Based socieity. by fish_in_the_c · · Score: 1

    This idea shows the major flaw that exists in the idea of an 'evidence based' or scientifically based government, that is I have heard espoused occasionally.
    For instance most people would agree slavery is undesirable and wrong, but that doesn't mean there aren't circumstances where it is efficient and maybe most efficient in accomplishing a specific goal, Say creating the largest amount of comfort and wealth for the largest possible number of people. Any attempt to create a society based primarily on data that is gathered scientifically would still need to deal with the ethical questions of what is right and wrong, which goals are 'justified' and how far is too far when it comes to various harms imagined or real , when attempting to accomplish a specific goal. It becomes more complicated when you start taking into account multiple goals, for instances maximizing health vs maximizing personal freedom vs maximize food and financial security. Still there would be no guarantee that it wouldn't be proved that greatly restricting the 'rights' of one group would not be the most efficient way to maximize all 3. It probably doesn't help that the whole idea of 'rights' is basically a religious concept. Anyone who believes there are 'rights' rather then just 'what I happen to like' is appealing to a transcendent absolute that can only have a real basis in deity.

    Sure you could claim 'rights' are somehow part of the 'agreed / negotiated social contract' but honestly any such contract would be so fluid that there would be no thing you could every point too and say everyone should be allowed this all the time. Also, that is a completely reverse argument for any kind of change to the existing contract.

    --
    âoeTolerance applies only to persons, but never to truth. Intolerance applies only to truth, but never to persons.
  34. Oooh! The "Toronto Declaration" by Cornwallis · · Score: 1

    The name alone ought to scare any algorithm into compliance.

  35. Re:Say What? by dryeo · · Score: 1

    Toronto is not in Quebec. Each Province will regulate marijuana how it likes, within limits set by the feds, and ranges from pure government stores like in Quebec to pure private stores in Alberta selling marijuana.

    --
    https://en.wikipedia.org/wiki/Inverted_totalitarianism
  36. And calculators should respect socialist economics by IHTFISP · · Score: 1

    This Toronto Declaration is premised on a paranoid Luddite/SJW fallacy.

    AI algorithms (systems) cannot “respect” human rights, because AI algorithms (systems) are not conscious, self-aware, nor intelligent. They simply are what they are and do what they do based on input data. This is classic Popeye Ontology: “I yam what I yam, and that's all what I yam.”

    This is akin to demanding that medical statistics stop being “racist” for determining that sickle cell anemia is more prevalent in African descendants or that obesity is more prevalent in Hawaiian descendants. Statistics and statistics-driven algorithms (like machine learning) are no more inherently biased than their input data. In fact, one of the key objectives of statistics is precisely to reveal and quantify this sort of skew / bias / trend in the input data.

    Another example: I'm sure Bernie Sanders would like to demand that his calculator “respect” socialist economics but that's not how calculators work, and history, human nature, & mathematical facts don't lie: economic socialism doesn't work at scale. Disproportionately taxing a productive few to comfort the unproductive many yields an unstable system that ultimately collapses when the productive are incentivized to no longer produce (retire) or simply to leave the system (defect / emigrate / move their enterprise off shore).

    So it is neither the systems /per se/ nor the input data that ultimately need SJW monitoring: it's the policies & politicians & corporations who regulate & manipulate & deploy them that bear close scrutiny. Attempting to anthropomorphize technology & data in order to besmirch & regulate its use is as insidiously cynical as it is scurrilously puerile.

    This sort of ridiculous foolishness is what you get when you elect True Dodos to high office, like that silly Justin Bieber Timberlake Trudeau clownish kid. ;-)

    --
    Error: NSE - No Signature Error
  37. Algorithms Respond by hduff · · Score: 1

    GTFO LOL

    --
    "I believe in Karma. That means I can do bad things to people all day long and I assume they deserve it." : Dogbert
  38. Re: They might want to begin by practicing what t by Anonymous Coward · · Score: 0

    âDemocratic internetâ(TM). Like a Democratic nation. Well, itâ(TM)s a republic. Democratic anything does not exist. Itâ(TM)s a dream. There always has to be leaders. There will always be people that know more. There will always be people smarter.

    These are the people that decide. Sure, to protect their power, and protect society from becoming unstable by keeping things the same or make them change, but slowly.

    Itâ(TM)s when people take it upon themselves to bypass what everyone else has setup that cause chaos and instability. Sometimes this is good in 3rd world countries. But in first world countries, why do you think they are first world? Because we have the ability to work together toward common goals. Not against. And not solely for ourselves.

    Think about it. Controlled change is good. We must work together. Never let small groups dictate.

  39. institutionalized bias by Layzej · · Score: 1
    Lady Ada talks briefly with Google's James McLurkin on fairness in AI training:

    Lady Ada: "We're engineers, but historically when there was a photo of an engineer..."

    James McLurkin: "It didn't look like either of us."

    Lady Ada: "I think this is something that we think about because, what is an engineer semantically? We know it isn't by definition a 35 year old white male who lives in San Francisco."

    James McLurkin: "But if you look at the magazine covers, if your dataset of engineers is magazine covers...

    It's an interesting point. The last thing we want to do is institutionalize our biases.

    1. Re:institutionalized bias by Anonymous Coward · · Score: 0

      When was the last time you saw an engineer on a magazine cover?

    2. Re:institutionalized bias by Anonymous Coward · · Score: 0

      Why work hard generating an accurate bias ( stupid Bantu / acquisitive Juuz ...) if you aren't going to preserve the truth within an insulating institution ?

    3. Re:institutionalized bias by ooloorie · · Score: 1

      It's an interesting point. The last thing we want to do is institutionalize our biases.

      The typical engineer in the US is male, white, and middle aged, just like the typical giraffe is spotted, has four legs and is about 18 ft tall. Those are just facts. Picking typical representatives of a class to represent the class is not an "institutionalized bias".

      Putting Limor Fried on the cover of a magazine and pretend that she is representative of engineers in general is objectively false, because she is an outlier and an atypical example of an engineer.

    4. Re:institutionalized bias by Layzej · · Score: 1

      Picking typical representatives of a class to represent the class is not an "institutionalized bias".

      Genitalia and colour are not actually part of the definition of an engineer. If you insinuate those factors into your classification algorithm then you have exactly an institutionalized bias. It becomes a real problem If you then use that classification algorithm to filter who gets admitted into the college of engineering. The algorithm then reinforces its own bias.

    5. Re:institutionalized bias by epine · · Score: 1

      The typical engineer in the US is male, white, and middle aged, just like the typical giraffe is spotted, has four legs and is about 18 ft tall. Those are just facts. Picking typical representatives of a class to represent the class is not an "institutionalized bias".

      A giraffe is hardly a typical exemplar of an exemplar, being the most unusual (and specialized) life form most children learn to recognize in their first year of speech (though perhaps some competition here from the kangaroo).

      The giraffe is practically the archetype of a charismatic mega exemplar.

      Whereas the gender and age of a human engineering population is merely an artefact of history, albeit a patriarchal colonial history that recently remade much of the world in its own image, before changing its own tune, in its sluggish (and now faltering) march of democracy.

      The salient feature of an engineer is not his or her bits and bobs.

      The salient feature of a giraffe is indeed its very long legs and neck (affecting diet, predation, physiology, behaviour and every other damn thing about giraffe existence).

      To make this any more plain than that, I'd have to run it through a Dick and Jane Dr Seuss filter.

    6. Re:institutionalized bias by ooloorie · · Score: 1

      How do you get from the observation that the typical engineer in the US is white and male to "we filter applications based on race and gender"?

      Big data algorithms wouldn't use race and gender to filter applications because race and gender are not informative compared to grades, degrees, and other accomplishments. But a consequence of not using race and gender to filter applications is precisely that the typical engineer in the US ends up white and male.

    7. Re:institutionalized bias by Layzej · · Score: 1

      How do you get from the observation that the typical engineer in the US is white and male to "we filter applications based on race and gender"?

      You put those words between quotes, but it isn't a quote. Those words are your own. What I said was:

      "Genitalia and colour are not actually part of the definition of an engineer. If you insinuate those factors into your classification algorithm then you have exactly an institutionalized bias. It becomes a real problem If you then use that classification algorithm to filter who gets admitted into the college of engineering. The algorithm then reinforces its own bias."

    8. Re:institutionalized bias by ooloorie · · Score: 1

      It's called a paraphrase. In fact, your actual words were even worse, so let's use them:

      How do you get from the observation that the typical engineer in the US is white and male to "use that classification algorithm to filter who gets admitted into the college of engineering"?

      So, stop avoiding the issue and answer the question.

    9. Re:institutionalized bias by ooloorie · · Score: 1

      The salient feature of an engineer is not his or her bits and bobs.

      Correct. The salient feature of an engineer is that they complete an engineering education, something that women tend to do less than men. The reasons for that are not historical but women's preferences and interests. How do we know that? Because those preferences are cultural universals. In fact, "in countries that empower women, they are less likely to choose math and science professions".

      Whereas the gender and age of a human engineering population is merely an artefact of history, albeit a patriarchal colonial history that recently remade much of the world in its own image,

      That's a belief you hold and it happens to be an incorrect belief with no supporting evidence. It is not surprising that you draw incorrect conclusions from incorrect beliefs.

    10. Re:institutionalized bias by Layzej · · Score: 1

      How do you get from the observation that the typical engineer in the US is white and male to "use that classification algorithm to filter who gets admitted into the college of engineering"?

      So, stop avoiding the issue and answer the question.

      I start with the observation that genitalia and colour are not actually part of the definition of an engineer. I then note that if you insinuate those factors into your classification algorithm then you have exactly an institutionalized bias. I conclude that it becomes a real problem If you then use that classification algorithm to filter who gets admitted into the college of engineering. The algorithm then reinforces its own bias.

    11. Re:institutionalized bias by Anonymous Coward · · Score: 0

      I don't even think you know what insitutionalised bias is.

    12. Re:institutionalized bias by ooloorie · · Score: 1

      I start with the observation that genitalia and colour are not actually part of the definition of an engineer. I then note that if you insinuate those factors into your classification algorithm then you have exactly an institutionalized bias. I conclude that it becomes a real problem If you then use that classification algorithm to filter who gets admitted into the college of engineering.

      Yes, and that conclusion makes no sense. A classification algorithm for admission to an engineering school doesn't classify people based on whether they "are engineers", they classify people based on whether they are likely to succeed as engineers, a completely different question. Furthermore, people don't "insinuate those factors" into classification algorithms; factors are used only if they are actually predictive, and gender and race would not be predictive for a system that evaluates university applications.

      The algorithm then reinforces its own bias.

      That would happen if admissions algorithms classify students according to "is the person an engineer", but that's not what they do.

      I don't even think you know what insitutionalised bias is.

      "A tendency for the procedures and practices of particular institutions to operate in ways which result in certain social groups being advantaged or favoured and others being disadvantaged or devalued." That doesn't apply here. Women are underrepresented in universities not because of institutional biases against them, but because they choose not to go into engineering.

    13. Re:institutionalized bias by Layzej · · Score: 1

      Yes, and that conclusion makes no sense. A classification algorithm for admission to an engineering school doesn't classify people based on whether they "are engineers", they classify people based on whether they are likely to succeed as engineers, a completely different question.

      Semantics. Swap the wording if you like. The result is the same.

      Furthermore, people don't "insinuate those factors" into classification algorithms; factors are used only if they are actually predictive..

      Your certainty is unjustified. Deep learning models are considered to be “black-boxes”. Black box models lack transparency. It is often impossible to understand how and why a result was achieved. Likely an AI would be given a large dataset -- certainly more than SAT score alone. Can you be certain that nothing in that dataset would identify race or gender? Even course history could betray this data.

      That would happen if admissions algorithms classify students according to "is the person an engineer", but that's not what they do.

      It is not inconceivable that an admissions algorithm would be trained using a data set of successful engineers. As noted above, even something as benign as course history could betray the gender or race of the candidate. How would you know how large a factor race and gender played in the decision?

      I don't even think you know what institutionalized bias is.

      Again you have attributed a quote to me that I have never written nor uttered. You have yet to respond without trying to put words in my mouth. This is a very disingenuous tactic. I'm happy to discuss this with you but please engage with what I've actually said.

    14. Re:institutionalized bias by ooloorie · · Score: 1

      Semantics. Swap the wording if you like. The result is the same.

      You don't know what you're talking about.

      Again you have attributed a quote to me that I have never written nor uttered. You have yet to respond without trying to put words in my mouth.

      I merely quoted a response, I didn't attribute the quote to you.

      This is a very disingenuous tactic

      Oh, spare me your self-righteous indignation. You're an ignorant prick, that's all. Now go to hell.

    15. Re:institutionalized bias by Layzej · · Score: 1

      You don't know what you're talking about.

      Not terribly convincing.

  40. Re:They might want to begin by practicing what the by Anonymous Coward · · Score: 0

    What human rights? They do not exist ... human power exists. Depends on the person and culture. Gaffot whining drool never ends. Or Trotsky spew. That exists. EOF.

  41. Re:And calculators should respect socialist econom by Anonymous Coward · · Score: 0

    silly Justin Bieber Timberlake Trudeau clownish kid

    Your point may be more effective if you just called him "Justin Trudeau." Or just go all-in on your half-assed invocation of "Justin True Dodo." As it stands, you've written what may be the crappiest insult I've ever seen.

  42. This data could be useful if applied benevolently. by Anonymous Coward · · Score: 0

    Instead of having computers ignore the differences among races, genders, social and economic backgrounds are identical, we should let them learn as much as they can about everyone's differences.

    Then, rather than using the data to simply incarcerate people, we could use it to track which groups are in more need of health care, educational assistance, legal aid, job training programs, welfare and other services that could help them pick up their feet and become better integrated members of society. We could learn where to build more hospitals, blood labs, health clinics, etc. The government could provide this information to the public so they know how to more strategically decide on real estate when opening job training centres, soup kitchens and various other charitable services for the poor, so that those who need the most help are closest to the help they need and don't have to travel far in order to receive it.

    Applied benevolently rather than punitively, the public should be more accepting of this type of machine learning, rather than being afraid of it. I think deep down everyone's fear is that this will get certain people into more trouble, especially if the only people using it are cops, prosecutors and judges, which is a very real concern.

  43. It was time by Anonymous Coward · · Score: 0

    I always thouht that MergeSort was an asshole. I hope it starts behaving now.

  44. Politician Engineers by Doctrinsograce · · Score: 1

    "... released a new declaration on machine learning standards..." Because, (1) declarations are easier to write than standards themselves; (2) they can now move on to the standards which will be a lot easier than their implementation. I've not been able to track it down, but, are these guys all politicians? (I apologize to all my Canadian brothers, for having recommending the suggestion to our own politicians that they ought to spread abroad. Either someone listened (God forfend) or the politicians all came from abroad. There must be a tertium quid.)

  45. Are you for real? by Anonymous Coward · · Score: 0

    How do you anonomosly virtue-signal...