Slashdot Mirror


Google's DeepMind AI Plans To Take On StarCraft II (venturebeat.com)

An anonymous reader quotes a report from VentureBeat: Google and Blizzard are opening up StarCraft II to anyone who wants to teach artificial intelligence systems how to conduct warfare. Researchers can now use Google's DeepMind A.I. to test various theories for ways that machines can learn to make sense of complicated systems, in this case Blizzard's beloved real-time strategy game. In StarCraft II, players fight against one another by gathering resources to pay for defensive and offensive units. It has a healthy competitive community that is known for having a ludicrously high skill level. But considering that DeepMind A.I. has previously conquered complicated turn-based games like chess and go, a real-time strategy game makes sense as the next frontier. The companies announced the collaboration today at the BlizzCon fan event in Anaheim, California, and Google's DeepMind A.I. division posted a blog about the partnership and why StarCraft II is so ideal for machine-learning research. If you're wondering how much humans will have to teach A.I. about how to play and win at StarCraft, the answer is very little. DeepMind learned to beat the best go players in the world by teaching itself through trial and error. All the researchers had to do was explain how to determine success, and the A.I. can then begin playing games against itself on a loop while always reinforcing any strategies that lead to more success. For StarCraft, that will likely mean asking the A.I. to prioritize how long it survives and/or how much damage it does to the enemy's primary base. Or, maybe, researchers will find that defining success in a more abstract way will lead to better results, discovering the answers to all of this is the entire point of Google and Blizzard teaming up.

33 of 75 comments (clear)

  1. One huge difference by Solandri · · Score: 3, Insightful

    Games like Chess, Go, Tic-Tac-Toe always let both players see the complete world state. Armed with that knowledge, it's easy to be systematic and deterministic.

    Games like Poker and Starcraft hide part of the world state from each player, forcing them to guess at the parts they can't see. That opens up the possibility of one player bluffing - leading the opponent down the wrong decision tree because he's fooled into thinking the part of the world state he can't see is different from what it really is. I don't think this is something an AI can "solve". Certainly one could optimize it, so that it becomes damn good at guessing when a certain player is bluffing or not. But put it up against a different player and all that "learned" experience becomes useless, or even counter-productive. Or even pit it against the same player who's aware he's playing against the AI which beat him last time, and he'll simply do something he would never normally do to throw off the computer. It's a difficult enough problem that in pretty much all commercial computer games with a fog of war feature, the computer is just programmed to cheat by ignoring the fog and seeing everything.

    1. Re:One huge difference by Calydor · · Score: 1

      This isn't so much about 100% solving as it is about learning HOW to solve. If the AI can go toe-to-toe with human players that's great, if it can't even come close then it's an area that needs more work.

      --
      -=This sig has nothing to do with my comment. Move along now=-
    2. Re:One huge difference by Kjella · · Score: 2

      Playing optimally does not mean you win every time. Take for example Texas Hold 'Em, no matter how poor a hand you have pre-flop (worst is 7-2 off-suite) against the best (pair of aces) you still have about 11-12% chance depending on colors and flush draws if you just shove every time and never see a flop. If it's your one-in-a-million lucky day you could do that six times in a row and win every time. Every poker pro - and most amateurs too - will have some bad beat story where they did everything right and still lost big. But in the long run it should work most of the time.

      That's what should happen if you play optimally with a fog of war too, you don't have one static strategy where you build the same every time, at least not if the game follows basic rock-paper-scissors rules that should never work. You have a variation that mostly beats your opponent's variation and you hedge and switch strategies on the fly as your opponent's strategy is revealed to you. And of course that includes bluffing, but that's part of the call or fold decision. Assuming your opponent never bluffs and always bluffs both lead to very poor strategies, they bluff part of the time and you call part of the time on the same board.

      It's not like chess where in position X you always want to do Y. But it's a lot more like the real world where you don't have perfect information and that's kinda the point here to make AI that can function instead of humans in the real world. They won't necessarily be better than our best, but they'll be more consistent in not doing things that are clearly sub-optimal, like say rear ending the car standing still in front of us. I'm not a good RTS player. I notice quite often that I'm simply not keeping up with the action, those should have retreated, those should have pushed the attack, that position should have been reinforced, those troops I build didn't get any orders and so on. Just consistently using what you have in a good way probably beats any strategy I got.

      --
      Live today, because you never know what tomorrow brings
    3. Re:One huge difference by Place+a+name+here · · Score: 1

      An AI can solve imperfect information games, it just is a lot harder. See, for instance this solution of heads-up limit Texas hold-em. Since the game has imperfect information and aspects of randomness, it's impossible to win every single time, but in the long run, the AI plays as well as or better than any other player.

      Just how much harder it gets shouldn't be overlooked. Even imperfect information chess (Kriegspiel) would be pretty much impossible. Now imagine how much greater a game state StarCraft 2 has in comparison to chess... and I'm not holding my breath.

    4. Re:One huge difference by Ferocitus · · Score: 1

      Nicely put!
      I think there are a similar problems facing human language processing.
      Slang, cant and argot change very quickly, and so it's very similar to a Fog of War for computers.
      Teenagers, in particular, will change the meaning of words, or create words, or even maul grammar to include
      or exclude others from their cliques. Irony and sarcasm are other bollards to progress for computers, innit.
      AI Winter is Coming!

      --
      USB, USB, USB!
  2. Oblig. by nospam007 · · Score: 1

    Let them play Global Nuclear War.

  3. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  4. Shall we play a game? by zifn4b · · Score: 1

    How about Global Thermonuclear War? https://www.youtube.com/watch?...

    --
    We'll make great pets
  5. Civilization by carvalhao · · Score: 2

    I would be really interested to see what would the results be if you would get DeepMind playing a game like Civilization, in which cooperation and soft-power can be used to win the game. That could really give all of us some hints on how to manage diplomacy/belligerence in a way that could lead to some interesting thought experiments in the real world.

    1. Re:Civilization by drinkypoo · · Score: 2

      I would be really interested to see what would the results be if you would get DeepMind playing a game like Civilization, in which cooperation and soft-power can be used to win the game. That could really give all of us some hints on how to manage diplomacy/belligerence in a way that could lead to some interesting thought experiments in the real world.

      Not unless you made a game like Civilization which was more than a glorified board game. Civilization bears only the slightest passing resemblance to reality. As such, you can only learn the most superficial lessons from it.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    2. Re:Civilization by aliquis · · Score: 1

      I wonder how long until an AI run the government.

    3. Re:Civilization by aliquis · · Score: 1

      Well the one thing we know is that being restricted from "being racist" or expressing "hate speech" completely ruin your civilization, society, culture, technology and people.
      So that's a sure path to a loss in the game of civilization.

      Vote Trump!
      Help us make EUrope.. well.. not worse and worse all the time again :D

    4. Re:Civilization by west · · Score: 1

      I doubt a Civilization's AI's real-world applicability to real-life diplomacy, but a truly successful Civilization AI (i.e. one that played at Master level exactly as a human would) would terrify the hell out of me. Being a master of Civ involves managing limited information and about a *thousand* degrees of freedom each move, if not more.

      It makes Go look like a cakewalk (in terms of the size of the decision tree).

      If AI's can do that, then probably 2/3rds of the intellectual-related jobs on the planet are toast.

      (As for applicability to real-life diplomacy, you have to be able to evaluate "success". Since there's no agreement as to what that even means, there's no teaching an AI.)

    5. Re:Civilization by aliquis · · Score: 1

      Thank you.

      Over here in Sweden we can't change the outcome democratically any longer since our parliament with lots of parties has becoming like your solution except it's 7-8 parties which are joined together who are all responsible for what has happened and then the 1 party which has been against it and still are but they of course don't have as many votes as the others and considering the population is being replaced and lied to and you can't say what you want ..

      So any change has to come from outside of the parliament and democratically means. Starting our own Swedish parliament for Swedes? Leave the Swedish state and establish our own within the same borders? Violent solution? Leave EU / EU influence how? Liberated by foreign nation? Lost and destroyed forever?

      I don't know what the solution is really. 60 million refugees they say, few millions who has come to EU, and already we are likely many tens of millions of people in Sweden, Norway, Denmark, Germany, UK, France, .. who feel like refugees ourselves in our own nations fleeing from socialism, cultural Marxism and the aliens who has come to take our land, property and freedom.

  6. EULA by Anonymous Coward · · Score: 2, Funny

    So it's fine if Google does it, but if I do it, I get a ban for running a bot? Okay then.

  7. Not AI by 110010001000 · · Score: 1

    Playing games is NOT A.I. This, like "playing" Jeopardy, is just a flashy demo of algorithms and shows us how clueless AI researchers really are.

    1. Re:Not AI by Visarga · · Score: 1

      > Playing games is NOT A.I.

      AlphaGo was playing a game. So ... it was not A.I.?

      But even so, it was clearly something, what shall we call it, then?

    2. Re:Not AI by Ferocitus · · Score: 1

      > Playing games is NOT A.I.
      AlphaGo was playing a game. So ... it was not A.I.?
      But even so, it was clearly something, what shall we call it, then?

      AI, but not Artificial General Intelligence (AGI).

      --
      USB, USB, USB!
  8. Obligatory Archer meme... by johnnys · · Score: 2

    "teach artificial intelligence systems how to conduct warfare."

    Do you want Skynet?

    Because that's how you get Skynet!

    --
    Sometimes the "writing on the wall" is blood spatter...
  9. Should have been DOTA2 by eddy · · Score: 1

    My initial reaction when I saw this news was that it was a boring choice. It's a step up from Galaga, so maybe it makes sense as a stepping stone, but as a game something like DOTA2 would be much more interesting.

    DOTA2, unlike SC2, heavily depends on both cooperation AND competition between players as an integral part of the standard game. It's got all all the same fog-of-war issues (i.e imperfect knowledge). There's for all intents and purposes one map, so you can focus on the strategy of the game without the changing topology of the map interferring. There's also a huge library of replays to learn from, with more coming online every minute.

    It'd be interesting to know if DOTA2 was considered and rejected for some reason. Maybe it's as easy as Valve not being open to providing the hooks they need, but that doesn't sound like Valve.

    I guess the positives for SC2 is that it's simpler, and they won't have to contend with too many changes/new units since it's at the end of its life.

    --
    Belief is the currency of delusion.
    1. Re:Should have been DOTA2 by majorme · · Score: 1

      yeah, nice trolling bro your interest in team play is fine but doesn't exactly support your theory about how complex dota2 and sc2 are. controlling a single character vs a full blown rts? you can't be serious. i cannot sanction it

    2. Re:Should have been DOTA2 by psycho12345 · · Score: 1

      Problem with dota 2 is the snowball nature of the PvE aspect. An AI there will quite easily crush any team because they will have near perfect farm, which eliminates any skill/strategy any human is going to come up with. A fully slotted in 20 minute Spectre/Void/Sniper is not all that interesting to win against

      They also noted why SC was preferred, the team lead and presented was a former UC Berkeley student who worked on Overmind, the SCBW AI.

      Simply put, DotA 2 is less taxing APM wise, since as you as you play safe and have perfect lane equilibrium control with your CS, it is rather difficult to lose. Even top pros can't deny and last hit every wave.

    3. Re:Should have been DOTA2 by eddy · · Score: 1

      The only way you get to "play safe" and "have perfect lane equilibrium" is if your opponents aren't doing anything. This is no different from any other game.

      Farming is a much larger problem space in DOTA2 than in SC2, where there are already optimal or near-optimal strategies to number of workers, etc. The first few minutes of a SC2 game is just the same old boring mechanical opening shit. IMO YMMV.

      --
      Belief is the currency of delusion.
    4. Re:Should have been DOTA2 by eddy · · Score: 1

      Yes you have a lot of units in SC2, but often they're controlled as a group. You can micro, but it's mostly about the strength of the combined force, not individual units.

      An AI would have to be able to play a whole team, i.e control and coordinate five units from a pool of over one hundred unique heroes, some of which can summon and control separate units in turn (e.g Lone Druid) and have abilities that interact in various non-obvious ways (and where it would be interesting to see new combinations and counters evolve).

      After all, the AI learns by playing itself or watching games, so it's not about playing a /single/ unit. It's about playing a side.

      --
      Belief is the currency of delusion.
  10. Wil pay to watch by majorme · · Score: 1

    I've always been a multiplayer man myself with just about two decades of history fighting people in Quake and StarCraft. While bots work reasonably well with single player games, multiplayer is a different matter. We're yet to be presented with a real AI in a game. They all cheat. My point is I will pay money to watch e-sports where AI and humans fight on equal terms and we have no idea who is going to win. and how. my money is on the korean pro

  11. Why bother by _xanthus_47 · · Score: 1

    They are still going to lose to some Korean guy

  12. How will DeepMind interface? by berchca · · Score: 1

    A lot of Starcraft is how fast you can do things that don't require you to be particularly clever (clever is a large part of it, too, but time to execution is key, as is the ability to physically deal with multiple areas on the board). It seems very unfair if DeepMind can do things like see more of the board than its opponent's monitor and move/select faster than someone could with a keyboard and mouse.

    1. Re:How will DeepMind interface? by iridium_ionizer · · Score: 1

      The MIT Tech Review article stated that they will limit the commands per second to something in line with what a human (professional) player can do.

      I am not 100% sure of what Deepmind's game awareness will be, but they do have a simplified graphics output for the AI (mostly just friend-foe, not the fancy artist made pixels).

  13. Winning strategy found by guruevi · · Score: 1

    Zergling rush kekeke.

    Not sure how you can defend against an AI that can simultaneously and individually control 200 units. Kind of like the mutalisk and pathing in SC1, SC2 is broken in many ways where it's easy for an AI to win simply by brute force and having superhuman unit control. Even Koreans and other high level players make many mistakes in optimization and strategy and simply make up by being physically faster than their opponent.

    --
    Custom electronics and digital signage for your business: www.evcircuits.com
  14. "teaching itself" by Bobtree · · Score: 3, Insightful

    > DeepMind learned to beat the best go players in the world by teaching itself through trial and error.

    AlphaGo was trained on databases of historical games. It looks for moves that are similar to what a human pro would play, and then reads out sequences to score the strength of the resulting position. It did not learn by itself from scratch. Once proficient, it was played against itself to improve.

  15. Re:Interesting by psycho12345 · · Score: 2

    They are addressing this directly, by limiting the APM of the AI to human levels. So it won't be able to rely on perfect micro to win.

  16. Blizzard legitimizes botting? Surprised. by sethstorm · · Score: 1

    So much for their commitment to integrity if they'll let a deep-pocketed botter buy them up.

    --
    Twitter supports and protects racists - by smearing their critics with the "Hate Speech" label.
  17. What is Intelligence? by bussdriver · · Score: 1

    What we have is Applied Intelligence and as far as the Artificial kind of AI that becomes a big philosophical debate. Even so, what is Intelligence? If you start to define it in a way where you can build upon it logically, you end up with obvious conclusions where for example, your house thermostat is intelligent.

    The domain or context is essential to the consideration too. So, the house thermostat is intelligent and within it's tiny world it performs quite well adapting and making decisions with it's simple stimuli. It is easy for us humans to think since we can write describe that intelligence in code or as a math function that there is no intelligence, just mechanically defined cause/effect. It is arrogant to define intelligence in terms of capabilities of humans... or just some subset of humans; plus practically speaking, it constrains us to only a select few to be the judges. The thermostat will not perform intelligently playing chess; just as human experts out of their depth do not perform intelligently either.

    So lets say we have some math that is powerful enough to describe the problem of winning at Jeopardy. Do you honestly think that we or any math genius will be able to fully grasp that solution? So then do we call that Intelligence? It's "mechanical" but it does a better job than our human solutions. But why is that not intelligence? Because it can be described in some way and copied between machines? (we can't do that with our expert Jeopardy players.) No.

    Lets go to a common fall back position: Humans can teach themselves without as much help a broad range of tasks. We have teachers, books etc... but why should we consider that way of learning the only way? Again, we are constraining it to humans. So... how far from "Idiot Savant" do we have to get before we consider it Intelligent? Again still constraining it to humans... What about mentally limited humans, like children? Do we let them off the hook simply because they grow up?

    Getting back to the "some math:" What if you could describe incredibly complex real world problems found in life as complex math approximations? Well, that is just what we have been doing and the whole process of finding those mathematical non-linear equations is beyond our intelligence but for some problems our brains somehow do approximate solutions (unless you can find a perfect chess player, etc.) The amazing thing is that the math derived from theories on how our brains work is how we have algorithms which find approximate solutions - these are described as complex non-linear approximations (far better than human descriptions.) It is an iterative discovery process akin to our learning. So you might again say that this math is mechanical... but as we keep getting closer to mirroring human approximation abilities or surpassing them doesn't the trend make you wonder if everything in life can be described mathematically? Humans can describe solutions as math for simple problems but the machines do the work quicker. Is it unfair if a human teacher helps describe the problems and types of math (approaches) needed to learn the best solution to the task? Is it unfair that you learned your alphabet in a linear order? as a song? So do we give up at the point where we have automated the teacher?

    Perhaps life is a non-linear approximation of 42... Do we know what the question was? no. does it matter? probably not. But we live in the process of approximating it. ;-)