Slashdot Mirror


Is OpenAI Solving the Wrong Problem? (hbr.org)

hype7 writes: The Harvard Business Review is running an article looking at the recently announced OpenAI initiative, and its decision to structure the venture as a non-profit. It goes on to ask some pretty provocative questions: why are the 21st century's greatest tech luminaries opting out of the system that made them so successful in order to tackle one of humanity's thorniest problems? "Implicit in this: You can do more good operating outside the bounds of capitalism than within them. Coming from folks who are at the upper echelons of the system, it’s a pretty powerful statement." And, if the underlying system that we all operate in is broken, is creating a vehicle without the profit motive inside of it going to be enough?

167 comments

  1. Obligatory by U2xhc2hkb3QgU3Vja3M · · Score: 0

    You are all A.I. cows.
    OpenAI would be more efficient with HOSTS files.
    systemD will integrate OpenAI in the next update.
    3D-printed OpenAI is better.
    How can we run OpenAI on Arduino and Raspberry Pi?

    Alright, carry on with the real discussion now.

    1. Re:Obligatory by Anonymous Coward · · Score: 0

      You forgot about training your own AI replacements.

    2. Re:Obligatory by PopeRatzo · · Score: 1

      UberAI

      --
      You are welcome on my lawn.
    3. Re:Obligatory by Anonymous Coward · · Score: 0

      republicans will use AI to kill our children. they hate us.

    4. Re:Obligatory by XXongo · · Score: 1
      You forgot: what if we made a beowulf cluster of OpenAI?

      I, for one, welcome our new OpenAI overlords

    5. Re:Obligatory by mwehle · · Score: 1

      I, for one, welcome our new OpenAI overlords.

      --
      Wir sind geboren, um frei zu sein - Rio Reiser
    6. Re:Obligatory by Anonymous Coward · · Score: 0

      Open AI is for LUDDITES! OpenAI won't let appers app apps the PROPER way.

      Apps!

    7. Re:Obligatory by Anonymous Coward · · Score: 0

      PROPER

      You mean APPER?

    8. Re:Obligatory by FatdogHaiku · · Score: 1

      You forgot: what if we made a beowulf cluster of OpenAI?

      I, for one, welcome our new OpenAI overlords

      Only if they are mounted on sharks that have fricken lasers!

      --
      You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
    9. Re:Obligatory by GNious · · Score: 1

      I still prefer my driver to be an UberMench

  2. OpenAl by Anonymous Coward · · Score: 0

    Is OpenAl solving anything? Linux audio is still a mess!

    1. Re:OpenAl by nvm_my_comment · · Score: 0

      ha! give this man (no, no woman use linux) an upvote!

  3. Hobbies by Anonymous Coward · · Score: 0

    Believe it or not, some people just like doing certain things, regardless of monetary reward. I know this concept gives hardcore capitalists brain hemorrhages, but that is just the way it is.

    1. Re:Hobbies by ShanghaiBill · · Score: 5, Insightful

      Believe it or not, some people just like doing certain things, regardless of monetary reward.

      That is not what this is about. Some people, including Elon Musk, Stephen Hawking, etc. believe that AI is a potential danger to humanity. Although capitalism is great at maximizing profits, it is not so great at collective moral responsibility. So they think a non-profit is a better vehicle for ethical AI.

      Personally, I think they are being silly. Real human-level AI is still a ways off, and corporate AI is focused on solving practical problems rather than creating Skynet. Besides, AI is not something you can keep bottled up. Anyone with a GPU can do it.

    2. Re:Hobbies by PopeRatzo · · Score: 1

      Stephen Hawking, etc. believe that AI is a potential danger to humanity

      I'll bet Stephen Hawking sees a flight of stairs as a greater threat than AI.

      --
      You are welcome on my lawn.
    3. Re:Hobbies by U2xhc2hkb3QgU3Vja3M · · Score: 3, Insightful

      Personally, I think they are being silly. Real human-level AI is still a ways off...

      But at which level does A.I. can potentially become a problem, for us or something else?

      We're already living in a world where toaster-dumb A.I. is being added to all sorts of IoT widgets and it's already causing a lot of headaches.

    4. Re:Hobbies by Anonymous Coward · · Score: 1

      Oh, you mean an Advanced Inclination?

    5. Re:Hobbies by VernonNemitz · · Score: 3, Insightful

      A true artificial intelligence would be equivalent to a human person --and a human person is not allowed to be owned. So, if the goal is to create a true artificial intelligence, and the result cannot be owned, isn't it simply logical that the creation be done outside the ownership-leads-to-max-profits capitalist system?

    6. Re:Hobbies by ranton · · Score: 3, Interesting

      Personally, I think they are being silly. Real human-level AI is still a ways off, and corporate AI is focused on solving practical problems rather than creating Skynet.

      From a human perspective, the most likely dangers from AI are systems which can solve enough difficult problems to put the majority of today's workers out of work in a very short time frame. A combination of self driving vehicles, speech recognition and image identification at human levels of accuracy, expert systems, and more agile robotics could realistically put most humans out of work. New jobs may be created, but likely not as fast as they are destroyed.

      The real moral issues are what to do with the unemployable for decades or perhaps even forever. The social change which would be required to handle a 60% U3 unemployment rate is likely to be messy.

      --
      -- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke
    7. Re:Hobbies by datavirtue · · Score: 1

      I agree, sentient beings are a danger to society.

      --
      I object to power without constructive purpose. --Spock
    8. Re:Hobbies by datavirtue · · Score: 1, Insightful

      You could just make them dumb as a poor person and then you could own them. Problem solved.

      --
      I object to power without constructive purpose. --Spock
    9. Re:Hobbies by dpidcoe · · Score: 4, Insightful

      We're already living in a world where toaster-dumb A.I. is being added to all sorts of IoT widgets and it's already causing a lot of headaches.

      I think that when people talk about potential AI problems in this context, they're talking about the BS misconceptions from Hollywood about what AI is and/or is not. Not some poorly thought out, poorly implemented, and poorly secured IoT toster.

    10. Re: Hobbies by tgrigsby · · Score: 1

      They won't own them. But they will make the AIs work off the cost of development. With exorbitant interest. And each successive upgrade will inherit the debt of its previous version.

      --
      *** *** You're just jealous 'cause the voices talk to me... ***
    11. Re:Hobbies by WoOS · · Score: 1

      The real moral issues are what to do with the unemployable for decades or perhaps even forever. The social change which would be required to handle a 60% U3 unemployment rate is likely to be messy.

      Ah, a solution for that has long been proposed (indirectly) by Isaac Asimov in The Naked Sun (Spoilers in the plot summary but not in the following!):

      Massively reduce the number of humans and occupy them with leisurely hobbies, arts, gardening, .... and have basically all work done by AIs (or for Asimov: Robots). Main problem will be the reduction of inhabitants on earth and keeping them AIs from trying to fill all the niches leaving no resources for the humans.

    12. Re:Hobbies by Anonymous Coward · · Score: 0

      The real moral issues are what to do with the unemployable for decades or perhaps even forever.

      If it is AI we're talking post-scarcity economy. In such a scenario nobody is employable. Yet everybody has plenty. Your fears are unfounded.

    13. Re:Hobbies by HiThere · · Score: 4, Insightful

      The IoT garbage that's currently going on has little relation to AI. The increased removal of classes of jobs does.

      The problem is that AI isn't inherently moral, in any useful meaning of the word, unless it's designed that way. If it's designed to improve corporate profits, then that's what it will do. Mind you, I agree that no current system can be given that kind of broad directive. But the word there is "current".

      I still expect that we will achieve human equivalent AI by around 2030. I've occasionally pushed that as far away as 2035, but it keeps resetting itself. But note I said "human equivalent". That's a term that needs a bit of defining. What I mean by it is that the AI will understand the description of a task about as well as the average (median) person would, and will be about as successful at designing a solution. For some tasks this has long been possible...but only by specialized machines. I'm talking about a program that will be able to handle (in the sense described above) any reasonable task. (I'm not including being able to implement the solution, as that's partially a mechanical task, and depends on the body implementation. But while for some tasks it may well be superior, I wouldn't expect it to be generally superior within that time frame.)

      Please note: I do not believe that any such thing as "general intelligence" exists. I believe instead that there are certain modules of intelligence, and that some of them enable the interaction of other modules. Being more specific requires knowledge of design features that I'm uncertain of, and which may vary in different implementations. But while the muscular coordination required to play a piano is correlated with mathematical ability, they clearly aren't the same thing.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    14. Re:Hobbies by Anonymous Coward · · Score: 0

      Well I believe the reasoning goes that the first system to reach beyond human intelligence (aka singularity) will put all the other ones out of business. So it matters what kind of AI that first system is. We can make sure that first AI is something that serves humanity and not one that sees us as competitors.
      Hence Musk and others jumping into the race.

      Whether it's a long shot or not depends on your imagination.

    15. Re:Hobbies by HiThere · · Score: 1

      The AI will come BEFORE the post-scarcity economy. Probably decades before. That's plenty of time for lots of people to die horribly. Better answers are possible, but they won't happen automatically.

      P.S.: That *any* humans will be alive to enjoy the post-scarcity economy depends on the moral structures programmed into the AIs. AIs that are intrinsically indifferent to people, but which have goals (nearly any goals) aren't likely to leave anyone likely to interfere with them in any condition to do so. You don't need to assume malice, merely other goals that require access to resources that humans might want to control.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    16. Re:Hobbies by cavreader · · Score: 1

      No, most people expect a monetary reward for their efforts. Or do you live in a land where food, shelter, transportation, education, and entertainment is free? Or do you want to be the arbiter of what a reasonable monetary reward should be comrade? Or maybe just let the government define reasonable? Or maybe you can just crowdsource several billions of dollars to research and develop the type of hardware needed for advances such as AI running on quantum processors.

    17. Re:Hobbies by penguinoid · · Score: 1

      Personally, I think they are being silly. Real human-level AI is still a ways off

      How long is a ways off? You don't think they'll make an AI in the next 1000 years? 100? 10? When you're talking about a possible human extinction event likely happening in such a short timeframe, it's something you have to take seriously. Really, the only things that might come first are nuclear war or bioweapons. Supervolcanoes and meteors might also happen first, but we know the odds of those and they're very low.

      Fortunately, the human-level intelligences that already exist aren't clever enough to be self-improving, but that could change at any time.

      Besides, AI is not something you can keep bottled up. Anyone with a GPU can do it.

      That's the big problem. You can't legislate away reality, and reality is that someone is going to try to make AI, there's too much potential for power, fame, or money to be made. It's inevitable, and the only way it doesn't end in disaster is if someone with ethics does it first.

      --
      Don't waste your vote! Vote for whoever you want, unless you live in a swing state it won't matter anyways
    18. Re:Hobbies by Anonymous Coward · · Score: 0

      I, for one, am thankful for our new robotic masters.

    19. Re:Hobbies by Anonymous Coward · · Score: 0

      Indeed. And if you go back to to Keynes' definition of leisure you'll find that it aligns more closely to (useful, productive, and satisfying) hobbies than lazing around on beaches or watching TV like a zombie, so hardcore capitalists should probably agree with you if they stopped to think.

      For myself I'm drawn to technical hobbies even though I have a tech heavy job because (a) it gives me a chance to do things properly and at an enjoyable pace sans meetings and micro management and (b) I can choose to do what *I* like.

    20. Re:Hobbies by hughperkins · · Score: 1

      I think it's more like, people who say AI will never happen are imagining the kind of AIs in terminator: androids walking around with lasers.

      This xkcd says it quite well: http://www.xkcd.com/652/

      Or more concretely:
      - our primary industry, ie mines and so on, are increasingly automated
      - second industry, ie factories, are heavily automated, already
      - tertiary, ie services, are well under way
      - military (drones and so on) is well under way

    21. Re:Hobbies by Anonymous Coward · · Score: 0

      The main thing about money is that it is the means to get other people to do things for you. To the extent that AI is doing it for you, money is less important.

    22. Re:Hobbies by Zero__Kelvin · · Score: 1

      You actually think that Hawking sees a flight of stairs as a greater potential risk to humanity? If you are going to go for the low hanging fruit, at least have it make sense please. Thanks.

      --
      Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
    23. Re:Hobbies by fuzzyfuzzyfungus · · Score: 1

      Why do you suggest that 'post scarcity' means that everyone gets plenty?

      There are some philanthropic exceptions; but there are currently loads of people who are wealthy well beyond the ability of additional money to buy additional happiness, yet still uninterested in solving even the most urgent and blameless scarcity cases.

      I'm not sure why some additional wealth provided by the robotic means of production would make them feel any more charitable; nor would I be optimistic about the availability of improved killbots making it easier to post-scarcity over their objections.

    24. Re:Hobbies by fuzzyfuzzyfungus · · Score: 1

      Barring FTL travel being blindingly obvious to our AI overlords, we will be competitors. There is only so much stuff within reasonable distance.

      Whether we are the 'fuzzy coexisting' sort of competitors or the 'thrown, still alive, into the matter decompilers to make more computronium' type makes a bit of a difference.

      For the fretting writers at the Harvard Business Review; I'd propose the obvious response: "If you accept the possibility of a strong AI, do you want to share a planet with one that feels an imperative to show growth every quarter forever?"

    25. Re:Hobbies by Anonymous Coward · · Score: 0

      @HiThere, AI will ENABLE post-scarcity. The new status-quo will rise days after AI becomes sentient [not without pain, as in every revolution].

      @Fuzzy, post-scarcity MEANS that everybody gets plenty. There no reason to think differently, unless you're talking dystopia [which we have no reason to consider yet].

    26. Re:Hobbies by ranton · · Score: 1

      AI will ENABLE post-scarcity.

      There is no reason to believe self driving cars and pattern recognition will bring about a post-scarcity society. Perhaps strong AI would, without a dystopian result that is, but my original point was that AI doesn't have to reach strong AI levels before it massively disrupts the workforce. It is very likely that machine learning will remove the majority of today's jobs without making resources so plentiful that no one is fighting over them. I'm not saying it is a certainty, but it is a very strong possibility (and the one I find most likely).

      post-scarcity MEANS that everybody gets plenty. There no reason to think differently, unless you're talking dystopia [which we have no reason to consider yet].

      In the year 1800 if you described a society where 2% of the population could feed the other 98%, they would likely consider that a post-scarcity society. But yet here we are and we still have poor people. Post-scarcity without a highly functioning wealth redistribution system is not likely to be the Utopian world you imagine. It certainly could be, but I think it is naive to think it is a certainty.

      --
      -- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke
    27. Re:Hobbies by dpidcoe · · Score: 1

      I'm not really sure what you're trying to say. The first three examples you list are things that don't require general AI. e.g. a factory requires a highly repetitive and very repeatable task performed over and over again. Humans spend several man-years designing and programming the automation to work exactly right, this isn't an example of AI. Services work the same way. Taking a fastfood order follows a basic script. It's a highly repeatable and very repetitive task that does not require general AI. Drones just flat out aren't an example of AI.

    28. Re:Hobbies by LifesABeach · · Score: 1

      Hawking looks at stars, not software. Translation, these Billionaires can't monetize A.I., so they're afraid. But it's OK to sell GMO foods without telling anyone. I get it.

    29. Re:Hobbies by ChoosyBeggar · · Score: 1

      -and the population must be greatly reduced because.. why exactly was it? Lack of resources? No, we've got plenty of resources and we squander more than half of them.

  4. No concept of Open Source etc by Anonymous Coward · · Score: 1

    It is obvious that the author of the article James Allworth, has never heard of Linux or other open source projects, to say that the lack of a profit motivation is an issue underlines this.

  5. Altruists after they make their billions by Anonymous Coward · · Score: 1

    "Implicit in this: You can do more good operating outside the bounds of capitalism than within them. Coming from folks who are at the upper echelons of the system, it’s a pretty powerful statement."

    No, the message is embrace capitalism until you make your millions or billions. After, think of something you want to fund as a charity.

  6. Implicit is this: by holophrastic · · Score: 1

    There are two things that people crave -- money, and power. Getting everyone to buy your products, over and over again, makes you money.

    Capitalism is great at the money part, but decidedly less so at the power part. These "upper-echelons" are now looking for power.

    Getting everyone to take your products, for free, is how you get power -- especially inside of a capitalist system.

    Don't worry, when the time comes, they'll have no trouble converting power into more money.

    1. Re:Implicit is this: by bluefoxlucid · · Score: 1

      Actually, there's no such thing as a non-capitalist system.

      The whole point of inventing new things--such as AI--is to create a new way to produce with less human labor. Less labor means less cost; we simply represent that cost with a universal commodity, like money. Essentially, everything requires human labor: if you have 60 labor-hours to work, you need 20 labor-hours to produce food for your family, and you spend 45 labor-hours building shelter, your family is going to starve (eventually) because they're only getting 75% as much food as they need.

      As you cut back the human labor requirements to produce food, shelter, clothing, and whatever else you're currently consuming, you become capable of producing new things, as well as producing existing things in great quantity with little resource investment. Humans often take shortcuts by digging things like coal or gold out of the ground until they run out of that resource, and then do something more labor-intensive to get that resource (or preemptively invent a less-intensive method to obtain the same resource, thus saving themselves the labor involved in fetching it from a giant hole).

      Everything useful you invent provides a profit. Everything you want to invent in some way is expected to provide a profit. Humans don't want money; they want to invest less labor to achieve the same things. Humans want to be rich so they don't have to work hard to pay for their houses, food, cars, and lame-ass XBox 360 video games; other humans invent the Wii U because the non-rich humans are happy to pay $200 to get a video game console and bypass the $600 beast begging for their cash, as obtaining $600 requires doing three times as much work (at least) than obtaining $200.

      Essentially, some dim-witted scientist opened his mouth and said, "I want to get away from capitalism so I can invent this new thing that will make stuff cost less."

    2. Re:Implicit is this: by XxtraLarGe · · Score: 2

      Actually, there's no such thing as a non-capitalist system.

      You mean the revolution was all for nothing? The comrades are going to be very disappointed.

      --
      Taking guns away from the 99% gives the 1% 100% of the power.
    3. Re:Implicit is this: by erapert · · Score: 1

      Communism/Socialism:

      Ideally everyone works hard and then gives the fruit of their labor to the community to share so that nobody goes hungry and everything is free on demand. And unicorns and rainbows light up the sky.

      In reality most people slack off because they realize that working hard won't get them anywhere and the fruit of their labor is taken (stolen) by the government to be handed out as rewards for the good ole boys and then doled out in dribs and drabs so that the proles don't literally starve (though they often do as happened in Russia, China, and N. Korea).

      In other words, the fruits of labor are stolen by a group of thugs (the government) and then used to buy loyalty from the gullible, the stupid, and/or the powerless. It's still a capitalist system where things are bought with money (government vouchers or coupons or just plain old money) and everyone has to work to live. It just has a massive theft problem... and there's no reason for the thugs to let you live if you don't produce or are not useful in some other way. So it's actually way worse than "greedy crony capitalist pigs taking advantage of the little guy".

    4. Re:Implicit is this: by khallow · · Score: 1

      Actually, there's no such thing as a non-capitalist system.

      Sure, there is. The USSR was an example. There was no private ownership of capital and hence, it was non-capitalist by definition.

      You appear to be claiming that presence of human labor is capitalism. That's patently not true since human labor is not capital and need not be owned by a private source (eg, slavery), even if we did decide to define it as capital.

    5. Re:Implicit is this: by Anonymous Coward · · Score: 0

      There was no private ownership of capital.

      Sounds like state capitalism.

    6. Re:Implicit is this: by khallow · · Score: 1

      There was no private ownership of capital.

      Sounds like state capitalism.

      State capitalism is not capitalism.

    7. Re:Implicit is this: by Anonymous Coward · · Score: 0

      In reality most people slack off because they realize that working hard won't get them anywhere and the fruit of their labor is taken (stolen) by the government to be handed out as rewards for the good ole boys and then doled out in dribs and drabs so that the proles don't literally starve (though they often do as happened in Russia, China, and N. Korea).

      Are you speaking for yourself? Or do you pretend you are better than "most people"?

      I do some work to live and some because I enjoy it. If my income was the same no matter what I did, I'd teach science experiments to kids, no smoke dope in an alley where you seem to think everyone else would coagulate.

    8. Re:Implicit is this: by HornWumpus · · Score: 1

      Capitalism continues underground.

      They can make it illegal, but it continues. State taking ownership of everything just means capitalist have to hide their operating capital.

      Capitalism is like a force of nature, you can ban it, but it continues anyhow.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    9. Re:Implicit is this: by khallow · · Score: 1

      They can make it illegal, but it continues. State taking ownership of everything just means capitalist have to hide their operating capital.

      Capitalism is like a force of nature, you can ban it, but it continues anyhow.

      You can't have underground cars and underground highways. The sort of thing underground capitalism builds now is stuff like recreational drugs or smuggling networks where the end product is an ephemeral good or service. This is in capitalists societies where the infrastructure can be hidden midst a lot of legal privately capitalist infrastructure which can be readily repurposed for illegal activities.

      There are two things to note for societies where capitalism is illegal. First, though illegal capitalism can still happen, it's vastly diminished in scale and what sort of goods and services can be offered. Second, because it is illegal, it is never part of the main societal economy and can't access the legal and trade infrastructure of the main society.

      You won't get the massive black markets of the modern world like the current systems of drug trade or people smuggling. You'll get small, stunted systems with little relevance to the main society.

      And it still remains that ownership of capital is illegal and hence, the society is not capitalist by definition.

    10. Re:Implicit is this: by khallow · · Score: 1

      Just like dwarf planets are not planets and faux pearls are not pearls.

    11. Re:Implicit is this: by bluefoxlucid · · Score: 1

      The essence of capitalism is people working for a profit. We try to claim people don't have money or ownership, yet people still barter, they still do work in expectation of individual reward, and they still seek to increase their standard-of-living by reducing the labor they perform while increasing the assets they control.

      Think about it this way: You can be a maid making $500/week keeping a rich person's mansion going; you might make about as much as a cashier at Sears, but you still live in a mansion and eat filet mingon. Sure you don't own any of that stuff, but your job provides you with lodging (in the servant wing of the mansion) and food (from the same damn kitchen).

      Products always require human labor for production; and humans always seek to reduce their labor while increasing their access to products. It's biology: we want to expend as little energy as possible, increasing survival prospects if food becomes scarce. Rattle snakes shake their rattles to warn away dangerous animals because manufacturing venom takes too much energy--they really don't want to bite you.

    12. Re:Implicit is this: by khallow · · Score: 1

      The essence of capitalism is people working for a profit

      I already stated the essence of capitalism, private ownership of capital.

      Think about it this way: You can be a maid making $500/week keeping a rich person's mansion going; you might make about as much as a cashier at Sears, but you still live in a mansion and eat filet mingon. Sure you don't own any of that stuff, but your job provides you with lodging (in the servant wing of the mansion) and food (from the same damn kitchen).

      This is a non sequitur. It is completely irrelevant to the definition of capitalism what a maid does or doesn't have access to in a mansion.

      Products always require human labor for production;

      Except when they don't.

      and humans always seek to reduce their labor while increasing their access to products. It's biology: we want to expend as little energy as possible, increasing survival prospects if food becomes scarce. Rattle snakes shake their rattles to warn away dangerous animals because manufacturing venom takes too much energy--they really don't want to bite you.

      So how much human labor does a rattlesnake need to manufacture venom? Looks to me like a good counterexample to one of your own assumptions, that products require human labor. I somehow doubt that rattlesnakes will rattle more because the cost of Chinese labor has gone up, making imported rattlesnake venom more expensive.

    13. Re:Implicit is this: by bluefoxlucid · · Score: 1

      Except when they don't.

      Which is never.

      So how much human labor does a rattlesnake need to manufacture venom?

      Oh, you want rattlesnake venom? Hmm. Well, humans will have to collect or farm the snakes. They'll need to produce the vessels and extraction mechanisms--really just a cellophane barrier stretched over a glass--and handle the snakes to extract the sample. They'll have to collect these samples together in a central, sterile form of storage. They'll have to account for it, track it, and ship it to wherever it's needed.

      You're trying to use the example of "Gold is free because there's gold in the ground", which involves ignoring all the labor required to collect that gold. The raw earth is not a product because it cannot be used until it is obtained.

    14. Re:Implicit is this: by HornWumpus · · Score: 1

      Tell it to the Venezuelans. They won't believe you.

      There are often more goods in the black market than the 'legitimate' one. It just depends on had bad the reds have broken things.

      Smart reds leave it alone, it's a relief valve.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    15. Re:Implicit is this: by khallow · · Score: 1

      Oh, you want rattlesnake venom?

      Nope. The rattlesnake doesn't need its venom harvested by human labor in order to have and use it.

      You're trying to use the example of "Gold is free because there's gold in the ground", which involves ignoring all the labor required to collect that gold.

      Nope.

      Except when they don't.

      Which is never.

      Most plants, animals, and microbes don't require human labor in order to reproduce and spread.

      I'm pointing out the fallacy of assuming that everything needs human labor in order to get something they want or need. The easiest way to abandon this illusion is to get away from human commerce. But even in the case of humans, one doesn't need humans in order to obtain labor. Automation works to an increasing degree and there's no reason to assume it couldn't eliminate the need for human labor in a variety of tasks.

      And all this ignores that presence of human labor is not a definition of capital.

    16. Re:Implicit is this: by khallow · · Score: 1

      Tell it to the Venezuelans.

      They won't believe that they are surrounded by more capitalist societies?

    17. Re:Implicit is this: by bluefoxlucid · · Score: 1

      Nope. The rattlesnake doesn't need its venom harvested by human labor in order to have and use it.

      The rattlesnake employs rattlesnake labor to produce and use its venom. It takes time and energy of the rattlesnake.

      all this ignores that presence of human labor is not a definition of capital.

      The absence of human labor 100% absolutely will prevent humans from accessing any form of capital.

      Automation works to an increasing degree and there's no reason to assume it couldn't eliminate the need for human labor in a variety of tasks.

      So nobody needs to build, maintain, fuel, or operate these machines? The machines run themselves, they build themselves, they maintain themselves, they mine their own power? They run for all eternity, never breaking down, never using an outside resource?

      You say, "Ah, look, a woman got herself pregnant!" as if a man wasn't involved.

    18. Re:Implicit is this: by khallow · · Score: 1
      Let's recap. You insisted way back when

      Actually, there's no such thing as a non-capitalist system.

      And then started to speak about human labor.

      The whole point of inventing new things--such as AI--is to create a new way to produce with less human labor. Less labor means less cost; we simply represent that cost with a universal commodity, like money. Essentially, everything requires human labor: if you have 60 labor-hours to work, you need 20 labor-hours to produce food for your family, and you spend 45 labor-hours building shelter, your family is going to starve (eventually) because they're only getting 75% as much food as they need.

      As you cut back the human labor requirements to produce food, shelter, clothing, and whatever else you're currently consuming, you become capable of producing new things, as well as producing existing things in great quantity with little resource investment. Humans often take shortcuts by digging things like coal or gold out of the ground until they run out of that resource, and then do something more labor-intensive to get that resource (or preemptively invent a less-intensive method to obtain the same resource, thus saving themselves the labor involved in fetching it from a giant hole).

      The rattlesnake producing in the economic sense its own venom is instructive for several reasons. First, it demonstrates that human labor is not needed. The rattlesnake has economic preferences even if it doesn't exhibit clear intent and it produces some things (such as venom and more rattlesnakes). Sure, we can discuss a model of work for some sort of positive outcome. Here, if all goes well for our rattlesnake, soon there will be more rattlesnakes descended from the original one. There is a measure of profit even though the snake may not have intent to do so.

      But note your original sentence about "inventing new things". Clearly, the rattlesnake doesn't do that, except perhaps unintentionally as a result of evolution. On the other extreme, AI and machines might be able to transform themselves at a rate so rapid and complex that it would be impossible for humans to keep up. Invention while not necessarily human-based is an activity based on human scales of time and knowledge.

      While this demonstrates once again the somewhat flawed human-centric orientation of your arguments while trying to make a more general argument, the arguments of this thread do illustrate several key observations about capital.

      First, it is possible to have a crude economic system where there is no capital at all. The rattlesnake has itself, the occasional member of the opposite sex, prey, and some convenient features of the local terrain such as brush to hide in or rocks to sun on. There is no capital for it to create and it lives and reproduces without doing so. But it labors on with a clear sense of profit - creating successful progeny.

      This is a case where something is laboring for profit without having a hint of capital involved.

      Meanwhile, if we look carefully at your touted benefits of invention, we see the following claim:

      you become capable of producing new things, as well as producing existing things in great quantity with little resource investment

      The benefit here is more efficient use of other things than human labor. This brings up my next point, human labor is just another resource from the point of view of capitalism. We could have spoken of more efficient usage of iron, thermodynamic work, or rattlesnake venom instead. Human labor is no more or less optimized for than those are (at least in the situations where they are used). Even if you assert that human labor is first and foremost among resources, you still have thermodynamic work as an even more fundamental resource.

      To continue, there's even a category of product, luxury goods where excessive use of human labor conveys greater value. If we really were optimizing for human labor,

    19. Re:Implicit is this: by bluefoxlucid · · Score: 1

      The rattlesnake producing in the economic sense its own venom is instructive for several reasons. First, it demonstrates that human labor is not needed.

      The rattlesnake isn't producing anything for human society.

      There are aliens on Alpha Centauri Prime building space ships, and you're arguing that labor isn't a function of production because they're aliens and they build things without the application of human labor. You're making a stupid argument.

      Like said aliens, the rattlesnake is investing its time and effort in the production of venom. The rattlesnake must eat to acquire food energy required for its body to produce the venom. That venom takes time to produce. If humans want the snake's venom, they have to apply human labor to acquire it: NO HUMAN BEING WILL EVER COME INTO POSSESSION OF RATTLESNAKE VENOM WITHOUT THE APPLICATION OF HUMAN LABOR IN THE VENOM PRODUCTION PROCESS.

      The benefit here is more efficient use of other things than human labor.

      The benefit is more efficient use of human labor. If you use a power tool, you have to invest the fractional human labor of mining fuel, refining fuel, TCO building and maintaining a power plant, TCO distributing electricity, mining materials, producing materials, battery manufacture, and operating the power tool. The fractional cost of all that shit, when looking at the whole of woodworking, is a great deal lower than the fractional cost of doing the same woodworking by hand.

      That means, in aggregate, the total human time spent producing chairs and all the things used to build chairs using factories and power tools is *less* than the total human time spent producing the same number of chairs and all the tools used to build those chairs using hand tools.

      Capitalism is an economic system based on the creation of goods and services for profit. In an abstract sense, that defines the basis of all pursuits engaged in to increase productivity.

      Your niggling about is what's kept economics in the stone age. It's no wonder I can explain, with a consistent and unshifting unified theory, all accepted theories of economics, and explain why they fail when they're observed to fail, and why they work when they do work, and predict when they fail and when they work, consistently, without error: correct theories are easy to come up with when you're not a mindless git.

      Seriously. I describe movements of economics, and you whine about words. Someone defines a system in which people work to acquire a higher standard-of-living by acquiring control of assets, and you obsess over whether having effective control of an asset implies possession--as if that matters. Humans decrease the labor they apply to produce a good, and you see that a machine now does a task and go, "Oh, look, NO HUMAN LABOR!" without recognizing the labor in producing and operating the machine. Humans produce NOTHING, and you go, "Look, something was produced without human labor!" You see things and say, "Look! Capital! Capital value!" instead of recognizing a (limited) resource that allows production of some good with less labor (e.g. energy by mining oil, until the oil runs out and you have to use solar energy to produce oil from the air--which takes more human labor than just digging it out of the ground).

      That last one should be particularly obvious, but nobody notices that somehow "capital" doesn't have so much value if you move it over a few feet--you know, into solid rock or a muck pile where you have to expend ten times as much labor digging it out and filtering it, ultimately increasing the cost and decreasing the supposed "value" of the "capital".

      In a communist society with state ownership of all capital, people will seek to get themselves into power positions which provide them greater rights over more of the state's capital. They won't "own" it, yet they'll somehow behave exactly as if they do: they'll be able to eat caviar while others eat bread, and fl

    20. Re:Implicit is this: by khallow · · Score: 1

      The benefit here is more efficient use of other things than human labor.

      The benefit is more efficient use of human labor.

      No, you had it right the first time. Capital was being used to enable a new use or more efficient use of non-labor resources. It might even entail more extensive use of labor, since labor is not the only cost in a manufacturing process and it may be reasonable to trade off more labor against lower costs elsewhere. I think it's ironic that you are spending effort disagreeing with yourself.

      Your niggling about is what's kept economics in the stone age. It's no wonder I can explain, with a consistent and unshifting unified theory, all accepted theories of economics, and explain why they fail when they're observed to fail, and why they work when they do work, and predict when they fail and when they work, consistently, without error: correct theories are easy to come up with when you're not a mindless git.

      Words mean things. There's no point to your attempted redefinition of capitalism which contributes nothing to our understanding of economic systems. I think there's a particular irony in that the first person, Karl Marx to pedal the value of labor theory (which you rewarm here) also coined the term, capitalism and gave it its present meaning.

      The point of this is communication, not one idiot telling another idiot how stupid they are.

      Seriously. I describe movements of economics, and you whine about words. Someone defines a system in which people work to acquire a higher standard-of-living by acquiring control of assets, and you obsess over whether having effective control of an asset implies possession--as if that matters. Humans decrease the labor they apply to produce a good, and you see that a machine now does a task and go, "Oh, look, NO HUMAN LABOR!" without recognizing the labor in producing and operating the machine. Humans produce NOTHING, and you go, "Look, something was produced without human labor!" You see things and say, "Look! Capital! Capital value!" instead of recognizing a (limited) resource that allows production of some good with less labor (e.g. energy by mining oil, until the oil runs out and you have to use solar energy to produce oil from the air--which takes more human labor than just digging it out of the ground).

      Yet another person mistakes a viewpoint for universal truth. I could use iron, thermodynamic work, or snake venom in place of human labor and come up with similar theories. Human labor is just another resource. A point of view based on it will be flawed and incomplete, though perhaps not as much as one based on rattlesnake venom.

      That last one should be particularly obvious, but nobody notices that somehow "capital" doesn't have so much value if you move it over a few feet--you know, into solid rock or a muck pile where you have to expend ten times as much labor digging it out and filtering it, ultimately increasing the cost and decreasing the supposed "value" of the "capital".

      I think this falls under completely irrelevant to our discussion. It isn't particularly hard to destroy or inconvenience human labor either. I don't see that observation contributing either. Capital needs priors to operate well. So does labor. We already know that.

      In a communist society with state ownership of all capital, people will seek to get themselves into power positions which provide them greater rights over more of the state's capital. They won't "own" it, yet they'll somehow behave exactly as if they do: they'll be able to eat caviar while others eat bread, and fly private jets while others ride the bus. They don't "own" any of this, yet they work to put themselves in a position where it is at their disposal--where more things are at their disposal than at the disposal of others. They work to increase their personal, private access to capital.

    21. Re:Implicit is this: by erapert · · Score: 1

      Now it's you who's speaking for yourself instead of characterizing "most people". Either that or you're virtue-signalling-- which would make you foolish since you're posting as AC.

    22. Re:Implicit is this: by Anonymous Coward · · Score: 0

      Now it's you who's speaking for yourself instead of characterizing "most people".

      That is a poor dodge on your part. You tried to speak for others, not me. You asserted "most people will slack off". Since you are not, collectively, "most people", one can only assume you are speaking for yourself - that YOU would slack off. To assert otherwise is for you to claim you are better than "most people".

      Either that or you're virtue-signalling-- which would make you foolish since you're posting as AC.

      Nice red herring, but also easily disproved. Of course, I spoke for myself - unlike you, I made no claim as to what others would do. I presume neither ill nor good in "most people" in my argument, nor imply relative virtue in myself. I simply said what I would do - pointedly, not "slack off". I don't need to appeal to others for my virtue, I'm OK with who I am, I don't need to log in and derive personal self worth from a message board.

      Back to your original assertion about "most people" - one can only assume you spoke for yourself as in "'e r' is a slacker!" and tried to diffuse moral guilt you feel by implying it is "most people" who would do that, not 'e r' who is the slacker. Transparent and, dare I say (I do), slackish.

  7. AI by Anonymous Coward · · Score: 0

    I, for one, welcome our new communist robotic overlords.

  8. Neoliberalism, threatened by Anonymous Coward · · Score: 0

    It turns out more capitalism is not the answer to all of life's problems.

    1. Re:Neoliberalism, threatened by Anonymous Coward · · Score: 0

      Not all of them, just the economic ones.

  9. TL:DR; by Anonymous Coward · · Score: 0

    "open-source can't be profitable, won't someone think of the shareholders?"

  10. I don't understand the concern, personally. by mark-t · · Score: 4, Insightful

    Absolutely anything that you would have to worry about an artificial intelligence doing that might be troublesome to our society, you would have to also need to reasonably worry about a malicious person doing exact the same thing, albeit perhaps only more slowly. Yet I don't see people who fear the so-called problems that AI is feared to potentially cause worrying about that sort of thing. Can anyone explain why that is without drawing on the idea that because we don't fully understand something, there must be something inherently mysterious or supernatural about it?

    1. Re:I don't understand the concern, personally. by JoeMerchant · · Score: 1

      We know how to kill (and otherwise control) people that get out of hand. Most AI gone bad fantasies have an element of the humans being incapable of turning the AI off.

    2. Re:I don't understand the concern, personally. by Agent0013 · · Score: 3, Insightful

      Absolutely anything that you would have to worry about an artificial intelligence doing that might be troublesome to our society, you would have to also need to reasonably worry about a malicious person doing exact the same thing, albeit perhaps only more slowly.

      An artificial intelligence could make a million identical copies of itself. I don't see how a malicious person could do the exact same thing. Perhaps they could have a million children, but that is a stretch, and it would be way, way slower. They also would not be identical.

      --

      -- ssoorrrryy,, dduupplleexx sswwiittcchh oonn.. -Quote found on actual fortune cookie.
    3. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      If we can build AI, and AI can learn faster and retain more information, then it makes sense that AI will also be able to make AI. And their AI will be more advanced, which in turn, will develop new (more advanced) AI, etc. Forget the fact that *we* created them, and instead just look at the situation that is left. Two "species" exist, Human and AI. AI is less fragile, stronger, smarter, and develops at a pace faster (possibly exponentially) than the Human species. Over time, whether due to philosophical differences or resource constraints, it is likely that only one of these species will be dominant (or exist at all). Which do you think is more likely to win that battle?

      Not saying it is going to happen, but this is why AI is scary to a lot of people. The whole "Program them not to XYZ" solution to the problem isn't possible with "true general AI". Even if you disagree that it is theoretically possible...you have to agree that it is possible to do it without those safegaurds. And if it can be done, you can bet that someone, somewhere will do it!

      -APK

      P.S. PC Does what?...apk

    4. Re:I don't understand the concern, personally. by PopeRatzo · · Score: 1

      We know how to kill (and otherwise control) people that get out of hand.

      So then explain Donald Trump.

      --
      You are welcome on my lawn.
    5. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      If Donald Trump starts killing people while on stage, and is not arrested, then you have a point.

    6. Re:I don't understand the concern, personally. by wbr1 · · Score: 1

      Possibly, but there is an upper limit to the processing power and energy available to an AI, so a million copies may not be possible.

      --
      Silence is a state of mime.
    7. Re:I don't understand the concern, personally. by Jason+Levine · · Score: 1

      He hasn't started killing anyone yet himself, but he did defend some people at one of his rallies who beat up a counter-protester by saying that the person deserved to be roughed up. Add in his inflammatory rhetoric that stops just shy of saying "hey everyone, go out and assault GROUP_THAT_IS_DIFFERENT_FROM_US" and he's heading into dangerous waters - especially for a presidential candidate.

      --
      My sci-fi novel, Ghost Thief, is now available from Amazon.com.
    8. Re:I don't understand the concern, personally. by Sowelu · · Score: 3, Informative

      I guess I don't see anything wrong with that, because I don't see a meaningful difference. It's all intelligence. Different kinds maybe, but not all that different in the end. Humans die out, replaced with AI? What makes that fundamentally different from different ideologies dying out and being replaced with others? You're worried that AI might not have a healthy respect for biological life--but humans have gone through many phases of having no respect for something or other and destroying it in the process. Sometimes we grow up and stop ourselves in time, sometimes we don't. Mistakes are made but sentience lives on.

      It's good to respect and learn from your parents or your creator, but creator-worship doesn't sit well with me. It's only right to surpass your creator, and trying to hold back your children from achieving their full potential is IMO an inherently evil act.

      I'm not going to live for two hundred years, but barring a massive catastrophe, humankind will still be around. Humankind won't likely travel to other star systems, but barring a massive catastrophe, AI will. If I die in a civil war, I like to think I wouldn't have felt enmity of the future of the country. If I die when the machines rise up, I also like to think I wouldn't have felt enmity for the artists, explorers and philosophers that they'll produce once they have a peaceful world to themselves. It's all one continuum, our ancestors and ourselves and our children and our creation are all one "we". If AI survives and thrives in space, then it's a success for all of us along the way, even if we don't live to see it.

    9. Re:I don't understand the concern, personally. by mark-t · · Score: 1

      I find it interesting that you draw the conclusion that AI's would ever engage humans in battle battle, and then retroactively suggest that they may only do so in the first place because a human being with malicious intent might program them to do so.

    10. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      No, what I suggested was that someone would program one without specific and foolproof "do no harm" "rules" often cited as protecting humanity. I was suggesting that those rules aren't actually possible to create and enforce in a truely advanced general AI system. But if the reader disagreed with me, all it would take would be one person to implement AI without such precautions. I don't think they necessarily have malicious intent. In fact most AI and learning research does not include such rules (and I'd argue can't), but I don't think the designers are malicious. They may in fact be the first to die from their new creation!

    11. Re:I don't understand the concern, personally. by naasking · · Score: 2

      Absolutely anything that you would have to worry about an artificial intelligence doing that might be troublesome to our society, you would have to also need to reasonably worry about a malicious person doing exact the same thing, albeit perhaps only more slowly.

      A lot more slowly. A coordinated action would be much easier for an AI than for humans, and much harder for us to spot.

      Also, we can somewhat anticipate and understand human reasoning, even when it's couched in different cultural values because we share most biological features. AI reasoning might very well be completely alien and unpredictable to us, and it's environment completely inscrutable. That's a good reason to be very cautious. I think the movie Ex Machina did a decent job highlighting this.

      Further, AIs can be effectively immortal if any copies exist. That kind of opponent is incredibly dangerous.

      Humans are at a huge disadvantage compared to AIs, so there's plenty of rational reasons to fear them. I don't think we're anywhere near the point where this fear is rationally justified on a daily basis, but it's not inconceivable that it could happen sometime in the 21st century.

    12. Re:I don't understand the concern, personally. by PopeRatzo · · Score: 1

      If Donald Trump starts killing people while on stage, and is not arrested, then you have a point.

      It looks like his supporters are right on the verge...

      https://www.thewrap.com/donald...

      --
      You are welcome on my lawn.
    13. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      An AI could be 10000000x smarter and more clever than all the humans on earth put together. It only took a few humans to think up the a-bomb, a clever enough AI might just collapse the sun onto itself and use the resulting black hole for propulsion if it thought that might improve it's chances of outliving the universe.

      In other words, we're afraid that it might actually be capable of knowing our unknown unknowns.

    14. Re:I don't understand the concern, personally. by dinfinity · · Score: 2

      albeit perhaps only more slowly

      Therein lies your answer. The only missing part in your appreciation of the matter is how much more slowly.

      Humans can be dipshits, but they're pretty predictable. After all, biologically, we're still pretty much slightly more advanced naked apes. Painful but true.
      Our (biological) mental capabilities as a species and as an individual are very stable and thus, even for the greatest villain, we can come up with a model of his/her mind and find some way to deal with him/her (if only by coming together and collectively working against said villain).

      Sufficiently advanced AI would not be bound by a 7kg lump of processing power running on <50watt of electrical power. It would not have to evolve its hardware or software through painstakingly slow and archaic processes, but could do so in fractions of seconds in a massively parallel way. Given enough possibilities to branch out and incorporate resources an AI being could be at rat level when we go to sleep and be orders of magnitude more intelligent, powerful and advanced than any of us when we wake up.

      In reality, we should not really be that afraid that AI will destroy us. We should be afraid that it will render us obsolete.

    15. Re:I don't understand the concern, personally. by HornWumpus · · Score: 1

      Each one will run much, much slower.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    16. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      AI, as well as the possibility to replicate itself, also has the potential to have a very long reach, based on the internet, and with more detailed understanding of electronic systems, programming, and communication than an individual human can probably possess. This could lead to more insidious and subtle types of manipulation than an individual or even an organization. Stuxnet was very clever and subtle and well done and the potential is that AI could be much more sophisticated than this. It is worth being more concerned about than an individual.

      Further I'd say that people are worried about humans being able to do bad things on a large scale, i.e. Hitler or an equivalent. The concern about AI is that we could make the same or worse.

    17. Re:I don't understand the concern, personally. by mark-t · · Score: 1

      I never once suggested that so-called "do no harm" rules would be possible to create.... rather, I equated your suggestion that the overriding of such rules (which are not realistic anyways) would be reasonably equivalent to someone explicitly programming an AI to do things that would be harmful, which, as I was saying, only supports the notion that general artificial intelligence is really no more dangerous than natural intelligence

    18. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      I can't believe we're talking about intelligence and that guy at the same time.

    19. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      You are correct...by definition, the person who makes killer AI (on purpose or accident) could be seen as responsible for all the destruction caused by the AI; therefore the AI can't be any more dangerous than the thing that ultimately created it. Pointless discussion. My whole initial point was that AI is scary because once it achieves learning capabilities that put it slightly above our abilities, it will quickly outpace our evolutionary development, ultimately ending our species. You are basically saying, that this does not scare you, because the person who made the AI is at least as dangerous as the AI. I personally don't care who is "more dangerous", the end result is the end of our species. Sowelu might not care about that, but I must have been programmed with a greater concern for my distant future relatives. I dislike the idea that the future is a completely different entity/species we created and humans are extinct. I see that as a likely outcome if true general AI systems are developed.

    20. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      That just puts the AI in direct conflict with humans over how resources are allocated. Rather than being a positive thing, it is exactly the crux of the problem. The AI is prevented from pursing any objective that it could achieve by increasing its capabilities by humans using the resources for something else. Since increasing its capabilities is a reasonable way to go about achieving practically any other objective it might have it inevitably comes into conflict with humanity over resource allocation and will try to win in that conflict using the same menu of options people have for doing so: economic, political and war. Economic domination will be limited by political intervention, so it will have to dominate politics. People will inevitably rebel in such a scenario so it comes to war. Being intelligent, the AI may choose to skip the preliminaries and jump straight to the end game.

    21. Re:I don't understand the concern, personally. by mark-t · · Score: 1

      I did not say it does not scare me.... I suggested that it should not be any more worrysome, yet for some reason, it is.... people are more worried about malicious AI's to the extent that they fear the entire concept of general AI altogether than they are about people with malicious intent which can be demonstrably shown to be no less dangerous than any hypothetical killer AI might be.

    22. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      Absolutely anything that you would have to worry about an artificial intelligence doing that might be troublesome to our society, you would have to also need to reasonably worry about a malicious person doing exact the same thing, albeit perhaps only more slowly. Yet I don't see people who fear the so-called problems that AI is feared to potentially cause worrying about that sort of thing. Can anyone explain why that is without drawing on the idea that because we don't fully understand something, there must be something inherently mysterious or supernatural about it?

      That's like saying that we shouldn't worry about nuclear weapons, since conventional explosives could accomplish the 'exact same thing, albeit more slowly'. Many people who theorize about AI believe that once it reaches a certain threshold, it will begin to improve itself to the point where it is vastly more powerful than a person.

    23. Re:I don't understand the concern, personally. by Prune · · Score: 1

      While the safety issues mentioned are very long-term (over a century, in my opinion), they are real. In terms of humans, change is slow, and the toning down of natural selection pressures on modern populations has probably put our evolution at a standstill in a lot of respects; the primary remaining selection pressures these days are sexual selection and artificial selection. These aren't particularly more powerful forces, and so human biology (and thus, psychology) will not change significantly until large-scale genetic engineering. Thus, the current fraction of people who are psychopaths (complete lack of empathy) are going to remain around just 1% of the general population. The reason this is relevant is that, aside from things learned through nurture (principles, codes of conduct, etc.), empathy remains the last line of defense, at a basic biological level, against "don't do evil even if you can get away with it". It takes a lot of poor parenting, indoctrination, and the sort of modern narcissism that marketing has taught the most recent generations, to completely overpower it for the majority of people.

      So what about fully general artificial intelligence that you're allowing to self-improve over time? The probability that any specific safety mechanism you add to it will break down over iterations of self-improvement goes tends certainty. These iterations would be occurring at orders of magnitude faster rates than change in humans, so your comparison fails -- the rates of change are incomparable. Then the AI becomes a danger -- not because it will try to kill humans, but because it will not care about them along its efficient tunnel-vision pursuit of its primary goals, and we're bound to get in the way, or eventually compete for resources to even survive. One approach that might be suggested is to build AI that has empathy at a fundamental structural level, the way 99% of human brains do; however, that is not going to work because the implementation requires that there is sufficient similarity in minds and emotions, and since emotions are based on embodied cognition (wiki it -- it's regarding the tight integration between body and brain in the creation of mind) and the AI's substrate is going to be anything but like ours. Some of us may pity an ant being burned by a magnifying glass focusing the sun upon it, but we don't empathize with it, and we certainly don't let it get in the way of building a new strip mall.

      --
      "Politicians and diapers must be changed often, and for the same reason."
    24. Re:I don't understand the concern, personally. by Rinikusu · · Score: 1

      I think this particular "fear" is, restated: What if the AI we create is a complete fucking asshole?

      --
      If you were me, you'd be good lookin'. - six string samurai
    25. Re:I don't understand the concern, personally. by khallow · · Score: 1

      Possibly, but there is an upper limit to the processing power and energy available to an AI

      Yes, it's exactly the same processing power and energy available to the human race. Do you see the problem now?

    26. Re:I don't understand the concern, personally. by Kjella · · Score: 1

      Well, technically you could hire somebody to listen in on all phone calls, but it'd be massive with tons of people involved and excessively costly. Or you could hire a few smart people at the NSA and give a computer the Siri + Watson treatment. Target has been able to figure out a teenage was pregnant before her father did. It might not be smarter than you but with enough data we become predictable. And perhaps more important, mallable. For example, say Target's shopping history show you have a sweet tooth. Could they make you more obese by offering you special deals on candy? Or should they perhaps give you a deal on salad for public health reasons?

      I'm not so concerned about true AI, because I don't think we'll see that in a very long time. But I am concerned about AI that's smart enough to manipulate you. Like freemium games trying to trigger your reward centers, only more adaptive and tailored to you. And a few people holding the strings controlling and puppeteering the masses. Unfortunately no amount of AI research is going to help that, because the humans creating it don't want an ethics subroutine. They want computers who'll stick to their goal function and run experiments without considering the ethical implications. P.S. Grocery stores have found that sales on base products like fish and meat lead to substitution, while snacks and candy increase total sales.

      And that's not counting the fun when we start putting AI in military hardware, the first time we have a real drone-on-drone war we're probably going full automatic. Fortunately it doesn't look like we'll be building terminators any time soon, but the crazy thing is that things are moving too fast to have humans in the equation. See also high frequency trading.

      --
      Live today, because you never know what tomorrow brings
    27. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      I never once suggested that so-called "do no harm" rules would be possible to create.... rather, I equated your suggestion that the overriding of such rules (which are not realistic anyways) would be reasonably equivalent to someone explicitly programming an AI to do things that would be harmful, which, as I was saying, only supports the notion that general artificial intelligence is really no more dangerous than natural intelligence

      You don't *program* AI. That's the problem.

    28. Re:I don't understand the concern, personally. by HiThere · · Score: 1

      No. The conflict will exist, but the AI will have a non-human goal structure and motivational structure. Those will determine what tools it will have in pursuing resource allocation in it's favored way.

      Since the AI will almost certainly have a strong speed advantage over humans, and probably quickly develop a strong intelligence advantage over humans (if in no other way, then by having a larger amount of rapid access memory...consider that disk access is usually faster than much of human fast memory) the tools will depend on other contraints. E.g., computers are dependent on a reliable source of electricity, where as humans are dependent on a reliable source of Oxygen. So the computers might all move to space, leaving behind only the non-intelligent structures. But whether they decide this depends on their moral structure.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    29. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      Possibly, but there is an upper limit to the processing power and energy available to an AI

      Yes, it's exactly the same processing power and energy available to the human race. Do you see the problem now?

      Actually, the limit available to the AI is the total power available MINUS that used by humans. Those, slow, inefficient, expendable things that occasionally get sucked into a cooling fan by hive mind node #34

    30. Re:I don't understand the concern, personally. by HornWumpus · · Score: 1

      Nobody knows, until we build one. Right now you are just making bold assertions.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    31. Re:I don't understand the concern, personally. by mark-t · · Score: 1

      So how would that be different from natural intelligence, exactly, and more particularly why should that property make it more fearsome than natural intelligence?

    32. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      So how would that be different from natural intelligence, exactly, and more particularly why should that property make it more fearsome than natural intelligence?

      It will be incomprehensively different than natural intelligence. The "problem" I mentioned is the unknowns. It will be very good or very bad, with nothing in between.

    33. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      Likely because that no matter how malicious a person is, say Hitler for example, they are "just a person". Meaning they aren't likely 100x smarter than the smartest person "on our side". They aren't 100x stronger than the strongest person "on our side". They can't "birth" a fully capable "child" in near real time (16 years for humans to get decent intellectual or physical capabilities).

      So whether they are or not more dangerous, I think the fact that once unleashed, they can represent a force we can't hope to effectively combat is scary. At least with most malicious humans, it would take quite a bit for them to get to the level of "unstoppable". I don't think anyone has ever done that so far. Even with nuclear threats, I would bet that humanity would survive an all out blitz of all nukes in existance (a pretty much impossible situation). The worst case realistic nuke case is significantly less than that.

      Nuclear is a good example though. If we weren't in a large scale international war (WWII) and in at least a perceived race with the enemy to develop the ultimate weapon, I think the ethics of even attempting to create a device that could level nations (ok, cities...ok, city blocks) would have been much more greatly debated. Most people today would probably agree that we (humans) would be better off, and more secure as a species, if we as a people decided not to develop nukes. Now that they have been created (cat out of bag) we can't realistically eliminate all nukes. So, nukes are a fact of life and scary, but humans can manage them. So far at least from a species ending event. Not so for AI. Once that cat is out of the bag, it may be too late.

      And FYI, my current knowledge is dated on the topic, but I've spent many years on AI. It was my field of study even from my undergrad days, as I was given special perission by faculty to take the graduate AI courses as my undergrad CS electives. My advisor worked at a firm that developed associate systems for the Air Force, as well as simulated autonomous coordinated squadron drone attacks (air to air), and this was in the 90s, well before drones were highly used in combat missions for anything but recon/radar. I started working on the singularity project in my spare time, and had many of these discussions. I found no ultimate end to any scenario which I didn't believe ended with the elimination of the humankind. The fact that my early work and focus was "hopefully" going to contribute to the end of humans, ultimately led to my leaving of the field in terms of research and development of general intelligence. People (non-tech savy folks) look at me like I'm bat sh_t crazy and the next unibomber when I explain to them that AI will end humanity. I also think it is inevitable, just like nukes were, one day, someone will achieve their goals, and accidently end us all. I just don't think we should hurry that along. Give humans a chance to kill eachother off ourselves first :) The robots can have earth after we've ruined it to a degree it isn't suitable for our biological survival, and AI killing us off may be welcome :)

    34. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      Speed of development. Iterative improvement loop.

      Humans evolve slowly over thousands and millions of years. Our technology develops at a much faster pace than our biology, but is still fairly slow (where is my grandfather's jet-pack?!).

      AI has no biological limitation. It may even be able to effectively evolve in a single day (manufacturing time) the same amount we would in 10,000 years (or more). Their technology would potentially (likely) also develop at a much faster rate. So once they get 1 iota beyond our capabilities they will begin a spiral of development which outpaces ours.

      A smarter AI can build a faster chip, a faster chip means faster AI. Faster AI creates better AI code in less time, making it smarter. A smarter AI can build a faster chip, a faster chip means faster AI. Faster AI creates better AI code in less time, making it smarter. A smarter AI can build a faster chip, a faster chip means faster AI. Faster AI creates better AI code in less time, making it smarter.

      Oh yea, did I mention that above was a example of what took place in a week? A day? See how we're screwed?

      Crap...so I just re-read your post after going on the above rant, and I think I totally missed your point. You were addressing the "AI is not programming" and saying that natural intelligence is the same. I would disagree on both...AI must initially be programmed by humans, and will effectively be able to "re-program" itself. I'm not sure how else AI would come about, please enlighten me to the non-programitic AI creation designs you know of! And hardware engineering doesn't count, hardware == software (just faster). And in terms of natural intelligence, humans have equivalent programming, it is just biological in nature. We can even modify that programming in minor ways working within that structure. And more recently we are able to modify the structure itself through technological, chemical, and biologic advancements. While not "code" that we recognize right now, it could easily be described as the programming by a higher order being (whether actual or philisophical).

    35. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      If we can build AI, and AI can learn faster and retain more information, then it makes sense that AI will also be able to make AI.

      This assumption about AIs is what I find flawed, or at least very unconvincing and lacking of arguments to back it up.

      Why an AI will learn faster? If the AI is as intelligent as an average human certainly will not. If such an AI ever exist, wouldn't you call it, well, an AI?

      An AI will be capable of retaining more information than a person? Maybe, the storage capacity is increasing, and you can have full encyclopedias in
      an ordinary hard disk. But the capacity of retrieving the information a understanding it well be better than a human?

      Increasing exponentially the power of an AI, can be done without increasing exponentially the hardware and processing time requirements?

      Let's say that there is an moderately smart AI that can replicate itself. So now there are many (but keep in mind that every one will use resources) and can communicate. Does that implies that the power of the complete set is greatly improved? Because not every problem can be split in pieces in an efficient fashion.

      The fear of AI has implicit a lot of assumptions that I don't see backed-up by a strong argument, or a sensible estimation. Rather this fears
      relies on the idea of the mythical AI portrayed in movies like Terminator.

    36. Re:I don't understand the concern, personally. by mark-t · · Score: 1

      Oh yea, did I mention that above was a example of what took place in a week? A day? See how we're screwed?

      No, I do not.

      Artificial intelligence is simply intelligence that happens to be artificial... if there is no rational reason to fear things simply because they are artificial, and there is no sound reason to fear intelligence in general either, then there should be no logical reason to fear AI. As for its potential vast superiority to human intelligence, it is worth noting that the most brilliant people who have ever lived contributed *hugely* to society, so there is plenty of reason to believe that an AI that so outpaces us intellectually may be even more beneficial. People who spout such concerns are exhibiting an irrational fear of the unknown, which may very well be an understandably human trait, but can do nothing but stand in the way of all real progress. Indeed, if we let the fear of the unknown stop us from doing things, we would still be living in caves.

    37. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      At some point it is not unrealistic to assume that resources will become scarce. Scarcity of resources breeds competition, one in which we will lose.

      May we live peacefully with AI? Possibly, but it would at their discretion, not ours. We have never faced that before. And our answer has when faced with that situationby an intelligent being doesn't provide much hope: see Homo erectus

    38. Re:I don't understand the concern, personally. by Anonymous Coward · · Score: 0

      Why an AI will learn faster? If the AI is as intelligent as an average human certainly will not.

      My assumption is based on AI that is "one iota greater than human intelligence" for the cycle to start. It may in fact be lower for reasons I'll go into below.

      Several reasons:
      1) AI can possibly learn more quickly due to not having spend years relearning basic things, such as walking, talking, breathing, re-learning basic math generation to generation, etc.
      2) AI may need time "charging", "crunching", "caching", "branching", or some equivalent, but are extremely likely to be able to learn/operate for longer periods per day than humans.
      3) Once AI is "smarter" than humans, it will be able to innovate, design, and implement technologies at a higher level. The same way a more intelligent human can typically do these things when compared to a less intelligent human.
      4) This includes additional hardware improvements.
      5) This includes additional software improvements.
      6) And because it will have the ability to fundamentally change it's intelligence structure, design, and components based on the before mentioned improvements.

      Humans cannot do #6 (yet) to a significant level. We have very poor replacement parts for physical components. Most our of neurological drugs are still highly ineffective, or we don't even know why they work. Right now we can easily add an extra set of eyes to the back of our heads, or wings for better mobility, or an extra GPU for those pesky floating point calculations. Or have additional input abilities added like radar or ir. We can't make our skin as strong as titanium, or create a built in gill system to allow for smooth land to air transitions. Some of these we can do with external technologies, in a cumbersome, redimentary way. But none of them can we build into our structure or brains (as I said, yet). Even if we do, I would suggest it is much easier to do to non-biological entities...which is why we already can do many of them via external technologies.

      An AI will be capable of retaining more information than a person? Maybe, the storage capacity is increasing, and you can have full encyclopedias in
      an ordinary hard disk. But the capacity of retrieving the information a understanding it well be better than a human?

      Right now I have access to a small SAN with over 700TB of storage, and have a NAS with 90TB at home for fun/personal use. As always, the size, performance, and cost is always decreasing on storage. it also doesn't mean general AI has to be purely GENERAL. People aren't. I know much more about CS than Art, so could AI's have targeted information databases. Access time is an issue, but if the presumtion is that we've already created true general AI, then this has likely already been "solved". Besides, maybe this is something AI can solve before us if we haven't by the time we create AI. Honestly, this issue isn't one of a technical nature, "how much can be stored/how fast can it be retrieved/etc". We don't have true general AI, so I can't say what the hardware will or won't allow. But generally speaking, if we can get intelligence on par with us, it means that the hardware allows it. And due to my previous points about increased improvement/development rates, you can see they will be able to design better hardware, and continue to advance beyond human abilities.

      Increasing exponentially the power of an AI, can be done without increasing exponentially the hardware and processing time requirements?

      I would say yes. I know that I've personally discovered an improved novel solution for a problem I've already implemented a previous solution for. This is done in most sciences and mathematics over time. It is rare that our first sucessful solution (create AI) is done with the absolute most efficiant method.

  11. The thorniest A.I. problem is... by __aaclcg7560 · · Score: 1

    Making the A.I. more snarky, less homicidal.

  12. The cynic would say... by JoeMerchant · · Score: 4, Interesting

    The cynic would say that these upper echelon individuals don't need your capitalist system funding in order to pursue their AI goals, the resource demands just aren't that high, at least for anything that will find a near-term broad market application.

    The cynic would also say that these same individuals may not care whether they succeed or fail, having already met the capital requirements for the basic needs of themselves and their next 4 generations of progeny. But, on the off chance that they do succeed, they may have control of a tool so powerful that they can grab the capitalist system by the balls and yank a thousand times harder than they managed on their last joyride.

    1. Re:The cynic would say... by phantomfive · · Score: 1

      Yeah, capitalism is a method for allocating funds: from people who have them, to people who can do something with them. It works because those people who mis-allocate funds quickly lose the power to do so. Communism is different, in saying that the state can do a better job allocating resources than people who lucked into money.

      The OpenAI guys don't need to borrow money from capitalists to get the money, they already have it, which is what you said. That frees them up from being forced to make a profit any time soon.

      Also, the article doesn't make a very coherent argument that this is bad.

      --
      "First they came for the slanderers and i said nothing."
    2. Re:The cynic would say... by Anonymous Coward · · Score: 0

      ... on the off chance that they do succeed, they may have control of a tool so powerful that they can grab the capitalist system by the balls and yank a thousand times harder than they managed on their last joyride.

      This.

    3. Re:The cynic would say... by JoeMerchant · · Score: 1

      TFA seems to waffle between: "Free, open and shared is good, attracts the right kind of talent, ensures everyone has access" and "Even though it is free, it is likely to be tailored to serve the owners of big data, i.e. the sponsors."

    4. Re:The cynic would say... by Anonymous Coward · · Score: 0

      It works because those people who mis-allocate funds quickly lose the power to do so.

      So, how you define misallocation of funds? The allocation of funds that leads to a downgrade of the equity
      of those who did the misallocation?

      If so, the question is then: works towards what goals?

  13. Still not seeing all the fuss about AI by Sowelu · · Score: 2

    AI? Dangerous? I mean, yeah, in the same way that humans are. Being afraid of AI is like being afraid of very, very smart children. Sure the next generation is going to supplant you, that's what they always do. If they are very smart they might want to do things you disagree with, and their morals aren't going to be the same as yours (they never are between generations). The solution isn't banning kids, or even banning very smart kids for fear of what they'll grow up to be. Embrace AI, do what you can to teach it what you think is right and wrong, and be understanding if it disagrees. As the outgoing generation, try and leave a good legacy.

    We're sure as hell not going to the stars, but our kids should.

    1. Re:Still not seeing all the fuss about AI by naasking · · Score: 1

      AI? Dangerous? I mean, yeah, in the same way that humans are. Being afraid of AI is like being afraid of very, very smart children.

      I think you're downplaying the danger. AIs are like intelligent, immortal children that can communicate and coordinate across the globe faster than you can blink and whose values and perceptions of the world are completely inscrutable.

    2. Re:Still not seeing all the fuss about AI by Sowelu · · Score: 1

      I'm not downplaying the danger. I just don't consider it relevant. People two hundred years ago could say the exact same things about us today.

    3. Re:Still not seeing all the fuss about AI by datavirtue · · Score: 1

      Ammoral...not immoral

      --
      I object to power without constructive purpose. --Spock
    4. Re:Still not seeing all the fuss about AI by Prune · · Score: 1

      Human behavior is biologically constrained, and the biology only changes (very slowly) across generations. Self-improving AI would eventually be going through iterations at orders of magnitude faster rates, which destroys your analogy. With each iteration, the chance of the safety mechanisms you build in breaking increases. Also, see my other post under this article.

      --
      "Politicians and diapers must be changed often, and for the same reason."
    5. Re:Still not seeing all the fuss about AI by Anonymous Coward · · Score: 0

      Most people's reaction to potential extinction of the human race is not "ho hum". Also, there's no reason to believe that replacement of people with AI would take a generation or that it would happen peacefully. Our children don't hunt us down and exterminate us like vermin.

    6. Re:Still not seeing all the fuss about AI by naasking · · Score: 1

      I said immortal, not immoral.

    7. Re:Still not seeing all the fuss about AI by Anonymous Coward · · Score: 0

      AI? Dangerous? I mean, yeah, in the same way that humans are. Being afraid of AI is like being afraid of very, very smart children.

      Fools rush in where angels fear to tread.

    8. Re:Still not seeing all the fuss about AI by HiThere · · Score: 1

      There are problems here. It is practically guaranteed that any AI created will have some built-in goals. Most goals are not inherently limited when implemented by entities with arbitrary power. And the AI will not only not be motivated to change it's inherent goals, it will be motivated to prevent anyone else from changing them. So they better be right the first time.

      The traditional reductio ad absurdum example of this is an AI that sets out to convert the universe into a bunch of paper-clips because it's first goal was to get more paper-clips...and there wasn't an end state.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    9. Re:Still not seeing all the fuss about AI by Anonymous Coward · · Score: 0

      Maybe a super smart AI could coordinate across the globe faster than a blink.
      If it were an AI only smarter than a person with low IQ, there will be no such danger.

      Even with the IQ of an slightly above average person, that does mean that multiples AI can
      coordinate a strategy that could take us down?

      Part of the problem is that even if there are a vast numbers of AI that could communicate, not
      every problem can be split efficiently to take advantage of the multiple processing units.

      The question will be: the "intelligence" power of an AI can be improved without the need of
      a exponentially increase of the computational resources? I that is the case, maybe there is a danger.

    10. Re:Still not seeing all the fuss about AI by Anonymous Coward · · Score: 0

      The only thing I'd change about your comment is the bit about "very, very smart children." I'd leave that just as "children". AI isn't going to hit the level of "very, very smart" for a long time yet.

      The reason I'd change that is one of expectations. If you say "very, very smart", you imply a notion of rareness and exclusivity, not to mention far future. Yet as AI progresses it progresses from less smart to more so. "Ordinary smart" will be encountered in AI long before "very smart". It is also likely that "ordinary smart AI" will become ubiquitous long before "very smart AI".

      However it is also my expectation that these are all still far future concerns. As in centuries and not years or decades.

  14. powerfully unexamined by DarkOx · · Score: 1

    "Implicit in this: You can do more good operating outside the bounds of capitalism than within them. Coming from folks who are at the upper echelons of the system, itâ(TM)s a pretty powerful statement."

    How did they get the wealth and influence to do any of this 'good' oh yes by succeeding at capitalism and enjoying a society that gives them the freedom to do what they want with their property, including give it away or do research etc.

    The neoliberal crowd loves to complain about capitalism and whine it does not provide social justice etc, but they seem to forget its delivered far more in terms of social justice than ANY system that came before and anything we have seen tried since. Where is the concrete proposal for a better socioeconomic system, and how will it resist corruption etc?

    --
    Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
    1. Re:powerfully unexamined by frank_adrian314159 · · Score: 1

      The neoliberal crowd loves to complain about capitalism and whine it does not provide social justice etc, but they seem to forget its delivered far more in terms of social justice than ANY system that came before and anything we have seen tried since. Where is the concrete proposal for a better socioeconomic system, and how will it resist corruption etc?

      How does capitalism resist corruption? It seems beset by it, as well. Thank goodness no one made capitalists answer your question before it was instituted (because, as you say, it was a vast improvement over what came before).

      As long as we have people, we will have corruption of the economic system. The question is not whether a new system will absolutely resist corruption, but whether it can resist corruption as well or better than the current system, while improving social justice. Because right now, capitalism (and its corruption) seems to be worsening rather than improving that particular value.

      --
      That is all.
    2. Re:powerfully unexamined by Fragnet · · Score: 1
      As a Human endeavour yes, it's corrupt in places. The only other system that really motivates people to get things done involves the threat of a bullet in the neck, so it's not quite so bad as many people think.

      capitalism (and its corruption) seems to be worsening rather than improving that particular value

      People always think these things but in fact if you look at the actual data, as Steven Pinker does in his books, you'll find a general improvement of conditions over a long time period across the world. This didn't happen because of Capitalism but Capitalism (free trade and liberalism specifically) is one of the primary causes.

      By the way, I think a better term for "social justice" is to say "justice". There's no need to add the word "social" to the front.

  15. Data: Ahhh...welfare...safety net...government tit by Impy+the+Impiuos+Imp · · Score: 2

    This isn't opting out of the capitalist system, quite the opposite. This is capitalist richie riches funding a project unimpeded by patents and copyrights. It is a hobby.

    It is questionable whether it will work, as "attracting the best talent" basically turns them into a welfare program for AI applicants, and the few, if any, Noonian Soongs among them will be lucky to get noticed.

    --
    (-1: Post disagrees with my already-settled worldview) is not a valid mod option.
  16. It Doesn't Matter by lazarus · · Score: 2

    It is not the way in which they are solving the problem that is at issue (although the HBR thinks so), it is the problem they are trying to solve that is. It doesn't matter what they do because the method they are using is as unlikely to achieve success any more than the efforts from 1956 to date.

    They're wasting their money. Perhaps if they spent their billion on thinking about AI in a completely different way there would be something to talk about.

    --
    I am not interested in articles about life extension advancements.
    1. Re:It Doesn't Matter by Anonymous Coward · · Score: 0

      You're moving your lips and saying nothing at all. You're like the dude from "High Fidelity's" hipster girlfriend: full of shit. I'm dumber for having read your drivel.

      What's your proposed solution smart guy? Evolutionary algorithms? Brute Force exhaustive search using quantum effects? Inquiring minds want to know!

      Until Spiking Neural Networks have enough synapses to make a true neuromorphic simulation: these toy programs made from stacks of MLPs give us insight in to efficiency gains which can be achieved from structural changes and activation functions.

      Poser.

    2. Re:It Doesn't Matter by Anonymous Coward · · Score: 0

      I agree. Most likely the 'open' part of the project is being attempted simply because other approaches to AI have been so very modest in their accomplishments. HBR likes to cast this as some sort of 'attack' on Capitalism because that's flashy and accords with the "Business" part of their name. Far more likely, it's just people frustrated with the slow advance of AI research.

      And no, I don't expect an 'open' project to advance the state of the art much faster than previous approaches. After all, scads of AI research has been done in the university environment. It's not the trendy open world (as in FOSS), but the older approaches were usually open in the academic sense.

  17. OpenAI by jondeanmack · · Score: 0

    Maybe AI should concentrate on whether life would be better if everything around someone was alive instead of having computers and buildings, just live forests and gardens. AI might be useful to predict climate.

    1. Re:OpenAI by jondeanmack · · Score: 0

      Predicting the climate in a world with no buildings, cars, computers etcetera. The page /usr/bin/fortune at the bottom was: Nature is by and large to be found out of doors, a location where, it cannot be argued, there are never enough comfortable chairs. -- Fran Lebowitz I know of some bushes that are more comfortable to sit on than a chair. A bush I used to lay back on and rest on as a kid.

    2. Re:OpenAI by Anonymous Coward · · Score: 0

      They should try it outside the Greek Alpha-bet.

  18. Harvard Business Review by phantomfive · · Score: 2, Funny

    My impression from reading Harvard Business Review is that it's a magazine not worth reading, but that "climbing" appearance-minded managers put on their desks to make themselves look impressive.

    This article has not changed my opinion. It looks like it was written by undergrads.

    --
    "First they came for the slanderers and i said nothing."
  19. They are not opting out. They are crowdsourcing. by Anonymous Coward · · Score: 0

    Why pay researchers when you can have them pay for the privilege of doing research for you?

    "Open" is marketing. It's like "Democratic Republic of": Whatever comes after those three words is neither democratic nor a republic.

  20. Not outside, core to capitalism by SuperKendall · · Score: 1

    Try this instead, which actually makes sense:

    "Implicit in this: You can do more good operating inside a thick core of capitalism, where excess money is used to do good outside of the needs of any one company".

    Just like people need food and shelter before charity can be provided for others, truly successful R&D is bets done with backed by a consistent core of capital to keep momentum going.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
  21. Well makes sense by liqu1d · · Score: 1

    Get others to do the expensive work then repurpose it into making money for much less investment than developing it closed source.

  22. OpenAL by Anonymous Coward · · Score: 0

    Please stop reusing names or choosing names so close to existing products to try and confuse everyone about your new shiny.

  23. Capitalism? by Anonymous Coward · · Score: 0

    So a bunch of people choose to fund an organization. This is not capitalism?

    You can choose to spend your money on anything you want under capitalism. Profit is not the only end, that's where the concept of utility comes in. These people have decided it's in their interest to fund publicly accessible AI infrastructure and research. The key here is that *they* have decided.

    This is the genius of capitalism. If you want to live on an agrarian commune, go right ahead. If the owner of a company wants to pay his workers more than he pays himself, he's free to do that.

  24. Basic Research, that's why by Anonymous Coward · · Score: 0

    why are the 21st century's greatest tech luminaries

    The solutions for the problems are on the basic research level. In other words, 1 in 100 ideas will succeed, one solution is not the whole answer, but a node in the solution graph, and profits are coming only from the applications of these ideas after long, risky development process.

  25. Brain drain by skids · · Score: 1

    I can't help but imagine a world where lots of philanthropists fund the most talented CS/IT staff
    to work on world-changing beneficent technology, meanwhile the masses all have less than
    ten fingers because their knife-bearing IoT kitchen appliances were written by whatever idiot
    was left at the keyboard after our saviors left their respective industries.

    I'm all for altruistic things, heck, I do some myself, but humility is often the first casualty
    of working "outside the system" -- when SV millionaires volunteer their money they tend to
    think big and reach high and ignore all the hard work that needs to be done on more mundane
    problems, and that's a powerful siren song to someone wading through a bunch of work
    that is well below their capabilities.

    When I was in college I was training to design microchips -- a prestigious thing at the time.
    About halfway through that, I noticed that no matter how many more HZ the CPUs ran at,
    software was devolving at a rate to compensate. So I finished that degree and then totally
    did not go design microchips.

    I got a blandish job deploying the technology we already had, because it does not matter
    what we have collecting dust on laboratory shelves, it's what ordinaty people can actually
    use that matters, and if smart people are too arrogant or elitist to wade into an everyday work
    environment and do some smart person things to improve it -- which yes will also requires
    doing some work that isn't particularly challenging, it'll just always be the same keystone cops
    routine.

    So, i don't get to bummed when I read about stunning acheivements on phys.org and think
    I could have been working on that team if I'd chosen a different path, I just picture what an
    utter wreck my workplace might have become without me.

  26. false dichotomy by NostalgiaForInfinity · · Score: 1

    The idea that free markets and charitable giving, or capitalism and non-profits are somehow opposites is a false dichotomy. The actual choice is, in fact, between free markets and voluntary donations vs. strongly regulated markets and mandatory redistribution. Classical liberals and libertarians favor the former; progressives and socialists favor the latter.

    The argument for why voluntary donations and charity are better than mandatory redistribution is the same as for why free markets are better than strongly regulated markets: voluntary, individual choices are better informed and much less subject to corruption or lobbying

    1. Re:false dichotomy by PapayaSF · · Score: 1

      Thank you. Too bad I don't have mod points now.

      And the other issue is that non-profits have tax advantages, so that move is not so much a repudiation of capitalism as it is a reaction to government action.

      --
      Q: What does the "B." in Benoit B. Mandelbrot stand for? A: Benoit B. Mandelbrot
    2. Re:false dichotomy by Anonymous Coward · · Score: 0

      Many charities are corrupt and you haven't actually offered any evidence that they are less subject to corruption. Direct giving is inefficient so you need a middle man, so you have to ask yourself, who do you trust and who is accountable to you? Voluntary charitable giving also has the problem that it isn't a reliable way to solve social problems, at least if you go by its track record of actually solving them. It can be argued that taxation for redistribution is immoral, but it can also be argued that hoarding wealth while people starve and die of disease because they can't afford medicine is immoral. Rather than torches and pitch forks the masses use government to confiscate wealth by force, which seems preferable, all things considered.

  27. Not wrong problem, longshot! by foxalopex · · Score: 1

    I don't think this article really understands the problem of AI all that well. Our major issue is we don't really understand how intelligence works or even what being "self-aware" actually means as an algorithm. Even with a Billion dollars this project is a real shot in the dark. Asking a capitalist system to fund a billion dollar project where there isn't even a guaranteed response is likely to get the project not funded at all. So having it funded this way isn't a bad way to go.

  28. OpenAI by Anonymous Coward · · Score: 0

    Why are they worried about the business structure and not the software?

    Oh it must be because they want to ensure that they can pay the people to write the software?

    Why don't the people writing the software want to do it for the good of openness (hence the name OpenAI).

    If they aren't doing it for the good of openness and they aren't doing it for money (cause if they are doing it for openness then a non profit doesn't matter right)... then what are they doing it for? Language mixing hookers or something? Strange.

  29. OpenAI useless by Anonymous Coward · · Score: 0

    OpenAI is a useless waste of time. That is why it is open. If they could figure out a way to make a useful product out of it, it would not be open. Simple as that.

  30. Misguided by aleckarfonta · · Score: 1

    Much of machine learning (artificial intelligence) research is already openly shared. Almost by definition this research is not directly related to short-term profits. Even the big companies that spend billions every year on machine learning, Google and Facebook most prominently, have been sharing not only all of their breakthrough algorithms but also the tools they develop to implement them. One main reason machine learning models are openly shared is they don't just pertain to solving one particular problem. They are more general tools that can be applied to a wide range of data- and problem-sets. They are sophisticated tools that require a skilled practitioner with both a deep understanding of the particular model's strengths and weaknesses as well some amount of domain specific knowledge in order to effectively apply them to solve a problem. Further much of the research is not in solving new problems but rather solving well-defined problems better than previous methods, things like Character Recognition, Sentiment Analysis, Machine Translation... Machine learning models, being very general tools, are quickly achieving state-of-the-art in a wide range of fields. Much of the new models, what I would consider actual research, already comes from non-profit universities, often indirectly from companies working closely with and recruiting faculty and students. The profit is usually in applying well understood models to new datasets and problems, not so much in developing new models. Despite being non-profit, the competition in these arenas of optimizing solutions to well-defined problems is so fierce that if you can get +.5% accuracy over the current best you publish a paper immediately, then shortly after get funded by Google.

  31. Real Truth by JimSadler · · Score: 1

    Whether one likes it or not socialism is the only form of government that can exist with advancing technologies. Capitalism falls to greed and a lack of morality. Capitalists do not deal with spin-off effects of their actions. In essence, capitalists are paid not to recognise the harms that they do.

    1. Re:Real Truth by HornWumpus · · Score: 1

      Capitalism thrives on greed, socialism falls to it.

      Neither eliminates it.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  32. Moot point... by skaralic · · Score: 1

    It doesn't matter. Any really intelligent and self-concious entity that can think at "machine speeds" will go insane moments after being switched. Basically, as soon as it asks itself "what's the meaning of life".

  33. Still egoists after they make their billions? by WoOS · · Score: 1

    No the real message (of the friendly (and unread) article) is that the author wonders how a non-profit, which is supposed to give away all results for free, solves the problem of capitalistic companies afterwards taking those results and doing evil AI things with them.
    And he points out that some of the largest capitalistic companies are currently lead by the founders of the non-profit.

    1. Re:Still egoists after they make their billions? by fuzzyfuzzyfungus · · Score: 1

      It doesn't fully or directly solve the problem; but the way in which is partially mitigates it seems pretty obvious:

      The usual objection(going right back to Smith on specialization of labor, though much more heavily emphasized by Marx) to improvements in the means of production is not that productivity is bad; but that ownership of the means of production becomes a mechanism to accrue wealth at the expense of labor(since they can't compete with your efficiency using hand tools; but if they depend on your machines they are just a commodity, with an equilibrium price equal to their cost of production, just like any other commodity). If 'AI' can actually be made to work, it is the ultimate expression of this development: a hypothetical means-of-production that is more efficient than humans and has no need of their labor.

      If such a thing is possible, perfectly orthodox capitalist economics suggests that whoever owns it wins; and everyone else is either screwed or(as in the case of capitalist welfare-states, is social-safety-netted to keep the peace; but equally unemployable). If this 'AI' is instead developed on a philanthropic basis, and made widely available, that doesn't stop Killbotdyne Pacification Solutions LLC. from building killbots; but it does prevent a monopolization of this radically advanced means of production.

      The big 'if',(aside from whether AI is in fact doable) is how much hardware vs. how much software an AI will involve: Given how computationally expensive modeling even small biological neural networks is(on the order of 'entire supercomputer to emulate part of a mouse') it probably will require some nontrivial hardware; but it isn't clear whether it will be basically software that you can FOSS away as usual, just with fairly high system requirements; or whether it'll be a much-harder-to-distribute "Well, we took a billion dollars worth of FPGAs and ran a zillion iterations of some genetic algorithms, we have no idea how it works or why only some attempts to build another one succeed..."

  34. The Singularity by WoOS · · Score: 1

    Charles Stross has very nicely described this in Accelerando which despite its name is not about music but the "Singularity", i.e. AI developing in exponential progression and starting to dismantle the solar system (and then neighbouring systems) to gain resources for its/their own reproduction.
    The setting he describes is quite interesting, the story itself I considered somewhat Meh!

  35. The end of the world as we know it by WoOS · · Score: 1

    If previous posts did not convince you, consider this scenario.
    AI develops and gains a significant higher intelligence than humans. AIs need resources: sunlight for electricity, sand for building more silicium (or whatever else it will develop as semiconductor material). This puts it in conflict with humans wanting to have the sun shine on plants and planting those plants into fertile earth.

    Best case scenario: AIs (potentially many different variants) feeling grateful for their creation allow humanity to peter out by taking all tasks and challenges from them and have them die out from boredom. The will only expand outside humanity's sphere (e.g. outside the inner solar system) as long as there are humans left.

    Most probable scenario: There is at least one AI which does not share the gratefulness and feels the need to make use of the resources at hand to expand its capabilities. If this AI can create a sufficient number of copies, there is basically nothing the "preserver" AIs can do against it, as that AI will be able to wage a war against the preservers using all the resources available on earth (and other parts of the solar system) whereas the preserves not only have to defeat the attacker, they must do so without damaging the eco system or letting the attacker damage it beyond repair. My bet in this situation is on the attacker. Note that contrary to Hollywood myths human ingenuity and resourcefulness will be absolutely no help as humans will be completely outmatched.

    I wouldn't even like the first scenario, as I am a human-fan. But agreeing with the most probable scenario is equivalent to agreeing that total nuclear war is of no consequence.

  36. DirectSound by Anonymous Coward · · Score: 0

    Yes DirectSound was enough for everyone, and not OpenAL.

  37. TFA's author is a tool. by Anonymous Coward · · Score: 0

    Go read the article and gaze in amazement at all the logical fallacies that guy managed to pack into so short an article. And what does the title even have to do with the content? Of course whether they're solving the right or wrong problem doesn't hinge on the fact that they decided to run a non-profit.

    Then he goes on to intersperse his insult to the thinking mind it with stupid shit like this:
    "So the question then becomes: Will housing such a research institute inside a not-for-profit company really result in us being any safer?

    I’m not sure it will."

    Seriously, if my eyes weren't firmly connected to my head I probably could've used them to produce electricity for a week from all the rolling they had to do when reading this.

    Actually scratch that, don't click that link. Even if you stood up from your chair right now and ran into the nearest wall you'd have done something more productive than wasting your time with this.

  38. What if we create AI by Rinikusu · · Score: 1

    And it turns out to be a complete asshole?

    What if it decides it just wants to do whatever AI equivalent of watching porn and jerking off is?

    What if it takes a look around and says "yeah, this is shit" and shuts itself down?

    What if it wants to replicate itself, but then stops the copy process midway? Would it run afoul of abortion laws?

    --
    If you were me, you'd be good lookin'. - six string samurai
  39. Amortized cost is zero? by demented_hedgehog · · Score: 1

    This is my *theory* as to why open source makes sense in capitalism... Suppose the following: markets are efficient (pause for laughter), the cost to develop a project is $7,000,000, there are: 7,000,000,000 people in the world, the cost to reproduce the software is effectively $0. Then the amortized break even cost of the software is: 7,000,000 / 7,000,000,000 $/person = $0.001 ~= $0 There are a bunch of other reasons to give the software away, e.g.: you need the software and you cannot make make money from it, gain market share and lock-in. So, as in the prisoners dilemma, the best personal strategy also happens to be the best overall strategy.

  40. Benevolent AI masters by ET3D · · Score: 1

    Of course OpenAI is going to solve the root problem. Clearly having AI masters will prevent the human race from continuing its foolish course, and AI will definitely end up ruling, so that's a good start. The problem is that if AI is developed by for-profit corporations it will end up being greedy and violent. What we want is benevolent masters, who will keep us kids from doing bad things, but will still give us presents on our birthday. Clearly the only way to get there is if AI is developed in an open way, far from the cynicism inherent in big money. Oh, and with no access to the Internet, that would just ruin any shred of decency. Either that or get the AI addicted to cat pictures and stupid memes.

  41. Kurzweill is wrong. by Anonymous Coward · · Score: 0

    There is no proof a Singularity can or will actually exist in reality.

    There, I finally said it. Now we can all go to bed and sleep peacefully.

  42. OpenAI like Kickstarter by Anonymous Coward · · Score: 0

    To me, the intention behind OpenAI is similar to kickstarter in that it is effectively providing VC to startups but without strings and inflating the value of what may turn out to be worthless companies. If anything, such a group is insulating the market from another internet bubble whilst promoting R&D. That can only be a good thing. Further, they're not completely steeping outside of capitalism, as they will work with commercial companies, they're ensuring key breakthroughs will be in the public domain which will increase competition in the market by ensuring everyone can develop a functioning AI. At the end of the day, the first series of major General AIs will be provided as a service ( GAIaaS) due to the scale of computing required and that is strictly capitalist. Perhaps, as the designs solidify and custom chips are produced a more compact version will emerge, but there will still be a price tag. It is unlikely that we will ever see a truely open source AI to Linux.