Slashdot Mirror
OpenAI Built Gaming Bots That Can Work As a Team With Inhuman Precision (qz.com)
OpenAI said on Monday that its newest AI bots can hold their own as a team of five against human gamers at Dota 2, a multiplayer game popular in e-sports for its complexity and necessity for teamwork. The AI research lab is looking to take the bots to Dota 2 championship matches in August to compete against the pros. From a report: Dota 2 is a challenging game for AI to master simply because of the amount of decisions that the players have to juggle. While chess can end in fewer than 40 moves, and Go fewer than 150, OpenAI's Dota 2 bots make 20,000 moves over the course of a 45 minute game. While OpenAI showed last year that the bots could go one on one against a human professional in a curated snippet of the game, the company wasn't entirely sure that they could scale up to five against five.
But the research team doesn't credit this breakthrough to a new technique or a lightbulb moment, rather a simple idea. "As long as the AI can explore, it will learn, given enough time," Greg Brockman, OpenAI's chief technology officer, told Quartz. The bots learn from self-play, meaning two bots playing each other and learning from each side's successes and failures. By using a huge stack of 256 graphics processing units (GPUs) with 128,000 processing cores, the researchers were able to speed up the AI's gameplay so that they learned from the equivalent of 180 years of gameplay for every day it trained.
But the research team doesn't credit this breakthrough to a new technique or a lightbulb moment, rather a simple idea. "As long as the AI can explore, it will learn, given enough time," Greg Brockman, OpenAI's chief technology officer, told Quartz. The bots learn from self-play, meaning two bots playing each other and learning from each side's successes and failures. By using a huge stack of 256 graphics processing units (GPUs) with 128,000 processing cores, the researchers were able to speed up the AI's gameplay so that they learned from the equivalent of 180 years of gameplay for every day it trained.
So children aren't intelligent, since they need training to do things like read and write, or even how to talk?
File under 'M' for 'Manic ranting'
If the only thing that matters is APM, there's no point in playing.
Why does this conjure up images of hordes of inhumanely fast robots swarming cities and taking out citizens and soldiers with ease... How long until there forms an upperclass completely immune to revolution or the conscience of its human military?
You mean that kind of inhuman?
That makes sense, since Quake is indeed an Inhuman.
...it can be applied to important things like X and Y and Z! We promise. It isn't just for games. This is real important stuff.
They must have some kind of guidance, though - even something as simple as "killing good, dying bad, these are the buttons you can push."
The rest though, yeah - self-training. I'm still not sure that it's true "intelligence" though... But what *is* intelligence, exactly?
I dunno.
These are just buzzwords and their meaning is evolving. The latest distinction between machine learning and AI that I saw is that we let AI make decisions based on it's training. In other words, AI is just ML with the handcuffs taken off. Within either, you still have directed or non-directed training.
at first i read "with human imprecision" which is some form of irony.
this amazing news needs a new word! lets call it, botting!
When humans start looking to bots to figure out the meta game that'll take out half the fun
From TFA: The bots learn from self-play ...
The equivalent of 180 years of self-play must have left them deaf as an adder.
(OK, I admit, I'm really a bot that learned how to post jokes through self-play)
I learned a lot from 'self-play'; does that count?
I'm still not sure that it's true "intelligence" though...
Of course not, except in a very narrow sense. AI is a field of research to develop machine intelligence. We are making progress, but it will be a long journey.
But what *is* intelligence, exactly?
Intelligence is the ability to formulate an effective initial response to a novel situation.
The wording here is important. It is an "ability" not a mechanism. A system that consistently behaves intelligently is intelligent. The internal mechanism is irrelevant. It is an ability to "formulate" a plan, not a physical ability to act on the plan. It is the initial response that matters, so random trial and error, or undirected evolution, don't count. It is the response to "novel" situations that matter, not just the ability to lookup and repeat previous solutions.
What is "effective" may be subjective, but in this case it is obviously to win the game.
It would be interesting to see how the AI performs when restricted to the same equivalent wattage as the human brain consumes in calories of glucose. Let's be generous and only look at compute... not counting power for HVAC.
The latest distinction between machine learning and AI that I saw ...
Where did you see that? ML is a proper subset of AI. Period.
Anything that is ML is also AI. But there are subfields of AI, such as min-max and alpha-beta pruning, that are not ML.
What! A zeroed hard drive isn't a functioning AI? Are you sure?
Dear past dweller,
If you can get your hands on it's training data you'll instantly know all it's future moves.
Best regards,
John Conner
Just remember... whenever a computer can do it, it's not A.I. any more.
So when we have a computer with a robotic body that passes for human and is better than humans in every way... folks will say, "Oh that's not A.I."
The amygdala isn't intelligent.
The cerebellum isn't intelligent.
No component of the brain is really intelligent.
I actually think it's plausible that intelligence might emerge from multi player collectives where each "player" isn't intelligent individually.
She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
Even highly intelligent humans often use random trial and error when confronted with totally new situations.
They also do stupid things like seeing patterns that don't exist or extending from prior situations they think are similar but which are not.
The human brain is delightfully buggy, subject to framing errors, physical defects, and can't even detect when it's broken most the time.
She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
Presumed to be the most advanced. And you forget that while it may be a program, it's all about procedural generation. Those 725MB become countless TB once the program is unpacked and starts accumulating information and building a dataset of its own.
Even in the future, people still haven't learned the difference between its and it's.
Wrong. The intellectual abilities that an infant can exert allow him to give a meaning to his experiences without any required training at all. We train our children because we want them to learn our ways to communicate and to behave in society, not because they cannot learn on their own language and behaviour. No computer program can do this.
So you meant that if you just drop a new born baby in a jungle, the baby will learn how to walk, eat, and talk by itself without any help/train (from humans or animals)? Intelligent abilities of a baby are simply capabilities and speed of learning due to its physique which is NOT ready to do anything by its own, regardless how intelligent it is.
Even though training and learning are 2 separated things, the learning is directly related to training for a baby which is pretty much like a computer. If you are talking about children, that is a completely different state.
See Hans Moravec's informed speculations like his book "Mind Children": https://www.goodreads.com/book...
Or going beyond that to the nature of consciousness and reality:
http://www.frc.ri.cmu.edu/~hpm...
And see also Vernor Vinge's various writings on a "Singularity".
That said, hedging our bets by making the world a happier and healthier and more resilient place for everyone right now before a singularity is probably not a bad idea given our trajectory out of any singularity may have a lot to do with out path into one.
A 21st century issue: the irony of technologies of abundance in the hands of those still thinking in terms of scarcity.
Weren't you going to retire off your trolls? Shit talk them and annoy them to drive traffic to your content? I would think this pleases you everything is going according to plan,
You're stupid to realize that creimer spent a year trolling your sorry ass.
Comment removed based on user account deletion
http://varianceexplained.org/r...
Dota 2? Complex? Starcraft laughs at this, it must be so hard to micro one unit against a few enemies.