Slashdot Mirror


Safe AI Requires Cultural Intelligence (techcrunch.com)

An anonymous reader shares an excerpt from a report written by Gillian Hadfield via TechCrunch. Hadfield is a professor of law and strategic management at the the University of Toronto; a faculty affiliate at the Vector Institute for AI; and a senior policy advisor at OpenAI. From the report: Building machines that can perform any cognitive task means figuring out how to build AI that can not only learn about things like the biology of tomatoes but also about our highly variable and changing systems of norms about things like what we do with tomatoes. [...] For AI to be truly powerful will require machines to comprehend that norms can vary tremendously from group to group, making them seem unnecessary, yet it can be critical to follow them in a given community. [...] Norms concern things not only as apparently minor as what foods to combine but also things that communities consider tremendously consequential: who can marry whom, how children are to be treated, who is entitled to hold power, how businesses make and price their goods and services, when and how criticism can be shared publicly. Successful and safe AI that achieves our goals within the limits of socially accepted norms requires an understanding of not only how our physical systems behave, but also how human normative systems behave.

Norms are not just fixed features of the environment, like the biology of a plant. They are dynamic and responsive structures that we make and remake on a daily basis, as we decide whether or when to let someone know that "this" is the way "we" do things around here. These normative systems are the systems on which we rely to solve the challenge of ensuring that people behave the way we want them to in our communities, workplaces and social environments. Only with confidence about how everyone around us is likely to behave are we all willing to trust and live and invest with one another. Ensuring that powerful AIs behave the way we want them to will not be so terribly different. Just as we need to raise our children to be competent participants in our systems of norms, we will need to train our machines to be similarly competent. It is not enough to be extremely knowledgeable about the facts of the universe; extreme competence also requires wisdom enough to know that there may be a rule here, in this group but not in that group. And that ignoring that rule may not just annoy the group; it may lead them to fear or reject the machine in their midst.

5 of 79 comments (clear)

  1. In other words... by devslash0 · · Score: 4, Insightful

    ...forget we'll ever have safe AI.

  2. Avoiding naming the problem by MikeRT · · Score: 3, Insightful

    For AI to be truly powerful will require machines to comprehend that norms can vary tremendously from group to group, making them seem unnecessary, yet it can be critical to follow them in a given community.

    Sounds to me like they're dancing around the real issue: they know that "diversity" leads to problems. The more diverse society becomes, the more difficult the "social algorithms" for humans become. If humans often get it wrong (by the standards of those who push diversity), then AI is hopelessly screwed for a century or more.

    The solution, of course, is a cultural and political. That is to impose a restoration of E Pluribus Unum in those areas fetishizing diversity. You scared that "white nationalism" is on the rise? Embrace the old motto and make it clear that there will no longer be hyphenated Americans. You are either an "American" regardless of race and ancestry or you are not. If you choose the latter, you will not share in the political economy of the Americans.

  3. we need real AI first before we worry about this. by Wycliffe · · Score: 3, Insightful

    Some cultural intelligence will naturally follow after we have real intelligence but we are no where close to real intelligence. Real intelligence that can use context to figure things out should also be able to figure out cultural cues just like a normal person does. Current AI doesn't have any cultural knowledge because it really doesn't have any prior knowledge at all. Practically every animal on earth has the ability to use past experiences and past knowledge to help it make decisions. What we call AI can't really do that at all. AI for the most part has no context so it has no ability to decipher situations at all. It can't detect the difference between an erotic picture and a medical picture or anything else that has to take context and external cues into account to decide whether it is acceptable in the current situation.

  4. we don't have ai.. by gl4ss · · Score: 4, Insightful

    this .. this discussion about how should you teach or control or whatever ai is like two parents discussion what rules should they give their kid, before they even know how to fuck.

    look, this stupid fucking discussion has been going in CIRCLES FOR FUCKING FIFTY YEARS - "researchers" and "experts" like to do this discussion because it's about 12312 times easier than actually trying to create an actual AI.

    the institutions for this are also fabricated - and you know what they're fabricated for? FUCKING SWINDLING MONEY. these issues have been BEATEN TO FUCKING DEATH IN SPECULATIVE FICTION FOR FIFTY YEARS so much that NOBODY FUCKING CARES ABOUT STORIES ABOUT THEM.

    what do you think 90% of the 2001 space odyssey is? it's the same fucking discussion - safety is in the eye of the guy giving the objectives to.

    meanwhile "ai" is getting up, but it's really always just a complicated pattern matching algorithm. but they call it ai, because that sells.

    ai is just the fuzzy logic of 2010's. it's gone as far that people are hyping up decision algorithms modeled in excel as artificial intelligence. the fuck does an excel sheet need cultural context for? it doesn't.

    what pisses me off is all these people profiting/fleecing people way ahead of time. they won't have actual ai during their lifetime yet they feel like they should market themselves as true experts - on something they have no idea how it would even work, so they just equalize it with something like a wunderkin. it makes as much practical sense as debabating what would be the best daily routines for an angel in heaven so that earth would stay a happy place.

    --
    world was created 5 seconds before this post as it is.
  5. Silly Hayumans... by Hylandr · · Score: 3, Insightful

    The problem is who will be teaching the AI 'culture' when certain segments of adult humanity are completely unable to determine their own sex.

    The apex predators, the most intelligent life on this earth still cannot accurately identify and categorize human personality types with any accuracy. And now these same flawed hayumans want to 'teach' an entity utterly devoid of emotion how to 'safely handle humans'?

    What the actual hell??

    --
    ~ People that think they are better than anyone else for any reason are the cause of all the strife in the world.