Ask Slashdot: Best Way To Learn About Game Theory and AI?
xmojox writes "I would like to learn more about Artificial Intelligence and Game Theory. I know these are both large areas of study; however, my main interest is in how these affect decisions in the world. This would include politicians, business people, and general society. I'm not looking for a career or anything; this is just a personal interest of mine. Where are good places to start in these areas for somebody new to them? I'm aware of the Stanford on-line classes, but those don't work with my current schedule."
Grab a copy of Russell and Norvig. It's a nice survey, and a fairly easy read.
See: http://www.lenfisherscience.com/books/rock_paper_scissors.html
-bone up on your probability (continuous/discrete distributions, transformations, etc)
-grab a book on statistical decision theory like Parmigiani and Inoue or Berger (85).
-read Von Neumann/Morgenstern
PS: I don't reply to ACs.
I haven't had much time to dig in yet, but I hear good things about Less Wrong from some friends who are into game theory, ai, and sociology.
Here's their front page blurb:
Thinking and deciding are central to our daily lives. The Less Wrong community aims to gain expertise in how human brains think and decide, so that we can do so more successfully. We use the latest insights from cognitive science, social psychology, probability theory, and decision theory to improve our understanding of how the world works and what we can do to achieve our goals.
Stop-Prism.org: Opt Out of Surveillance
I'm aware of the Stanford on-line classes, but those don't work with my current schedule
Why? You can just watch the videos instead of doing the homework, or watch them sometime later and do the homework then.
But if you really had any interest you would be shifting around everything else, including sleep, to take fullest advantage of these classes in real time.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
I purchased a course from "The Great Courses" on DVD last year (thegreatcourses.com), the topic of which was Game Theory. I've enjoyed the first half of the course, but haven't completed it. Unfortunately whenever I get time to go back to it, it has been long enough that I tend to start back at the beginning and watch the entire course over.
Read perceptrons, I'm sure a copy exists in your local college library.
I guess he knows something about using his time, after all, since he didn't answer you.
AHAHAHAHA oh snap!
After you go thru the usual stuff (Intro to AI, on-line courses, et al)
Game Theory and Decision Theory in Agent-Based Systems ISBN 978-1-4020-7115-7
Game Theory: Analysis of Conflict ISBN 978-0674341166
Hope this helps.
One possibility here is of course that the original poster knows that the field is quite large and isn't interested in studying it intensely for several years. In that case it can be good to ask those who already have studied the field for pointers to figure out just which things are most essential to learn about, which books are likely to be most useful and such things. Basically, the original poster may just be trying to avoid wasting his/her time studying more or less irrelevant parts of the field (anyone who has ever gone through a few college courses in a technical field should know what I'm talking about here, there are plenty of textbooks out there that imply pretty heavily that specific peripheral details are somehow core concepts when in reality you could spend a day or two on them and learn all you'll reasonably need to know about them, I myself have a book somewhere in storage which confused me to no end when I was in high school, it went on for page after page after page about linked lists like they were the only thing that mattered to computer science when it could've just explained the concept, what they were good for and then moved on).
Greylisting is to SMTP as NAT is to IPv4
Read Artificial Intelligence: A Modern Approach, 3rd edition. It's supposedly the most-used AI textbook in the world.
It's weak on the biologically inspired methods (genetic algorithms, neural networks, fuzzy logic), but very solid in "Good Old Fashioned AI" (GOFAI) and some of the decision-making procedures from other fields such as economics.
If you don't have a background in CS, you'll need to work through a book on discrete math first.
Sheesh, evil *and* a jerk. -- Jade
Comment removed based on user account deletion
Central planning doesn't work nearly as well as decentralization of knowledge does.
The best way to learn is to do it. Choose a "game" and try to solve it with some different approaches. I say "game" with quotes because the game you pick should definitely not be a game which a normal adult would choose to play, but something very young children would play, or a heavily simplified variant of a full game. Something like Tic-Tac-Toe or RPS.
RPS seems trivial, but it's actually a very interesting game to study. It's an easy-to-understand example of how a Nash equilibrium strategy doesn't always produce an optimal outcome. The equilibrium strategy is to choose between the three moves at random, but you can't naively use the strategy because it offers no way of taking advantage of weak opponents, such as an opponent that favors a particular move or a pattern of moves. Computer RPS tournaments will always include a variety of bots that are predictably weak in various ways, to separate out the good bots that are capable of using these weaknesses.
Another simple game you could experiment with is Leduc Poker. Leduc Poker is another matrix game, and it's simple enough that you can easily compute the Nash equilibrium (which, remember, is not necessarily optimal, but it's a good starting point) or iterate over the entire game tree. You could also use a similar subset of poker to experiment with more advanced techniques - e.g. minimax and alphabeta pruning, or maybe Monte Carlo Tree Search (I can't guarantee that MCTS would work for poker, I'm not sure it's ever been done, but it might be interesting to try.)
Some think that artificial intelligence seeks to emulate the real intelligence of humans. But most of it is just software, and has little to do with real intelligence.
There are certain problems that AI can solve, but those solutions are not "intelligent" but rather are merely "formulas" programmed by intelligent people (computer scientists).
We get excited when these formulas emulate what a real person might do, and when we can hide the underlying machine, but that is not to say we know how people think or even how we are implemented. We are just getting better at programming.
There are some great advancements in cognitive science, and the more we discover about how the brain works, the less it looks like it could be run by any "code". No intel inside. The brain is an organ that grows and dies, and takes its memories with it. If anything, it programs itself.
That is not to say there haven't been advancements in AI. It too is incredibly useful.
A good place to start: ... and wikipedia of course...
http://www.ted.com/search?q=brain
http://www.ted.com/search?q=artificial+intelligence
www.ai-class.org, by Sebastian Thrun and Peter Norvig
Not to belittle your choices, but this is a VERY complicated subject. My favorite introductions to game theory are, "The Compleat Strategyst" by Williams, and, "Strategy in Poker, Business and War" by McDonald. These are not trivial books, but they are easy reads into the uses of Game Theory.
After that, you get into some Math. Read anything you can on Probability and Risk; know your Statistics and Calculus. Much of what you are looking for will be found under the subject "Decision Theory."
I say study Economics because this is where political and economic scientific thought is making the greatest gains at this time. Game theory has a lot to do with "payoff" and Economics is a fertile field for studying payoffs. (So is Political Science, and there some good laboratories in, say, Afghanistan, Mexico and Chicago. But that's a slightly different, pragmatic, field of study.)
My favorite definition of "politics" is: "The behavior of vying for scarce rewards." This is almost exactly a definition for Economics. At one time Economics was thought to be a sub-level of politics; it now seems the opposite is true.
Hayak pretty much proved that economic behavior cannot be quantified because of the complexity. What is useful is deriving principles of actions under a variety of conditions to provide maximum payoffs, for the most people, under the widest variety of conditions. (An alternative course is to try to derive the largest payoffs for the fewest people under specific conditions.) AutoDesk used to have an Artificial Life laboratory that you could manipulate to learn about Genetic Algorithms and other AI behavior. Context-dependent AI can be learned through developing Neural Nets. Some of the guys I've talked to at Carnegie Mellon in the Quantitative Economics studies have warring economic artificial hybrid GA/Neural Nets, and the observations are pretty interesting.
If it was simply a matter of rational decision making, optimum economic strategies could probably be described and tested in a much smaller AI field. However, politics and economics are burdened with mis-perceptions, human values, and stubborn beliefs. This is a big field, and you should be able to enjoy it as a hobby for the rest of your life without running into a limit of learning.
"The mind works quicker than you think!"
For AI, I would suggest enrolling into the Stanford Artificial Intelligence Course. It will start on October 10th this year and lasts until December (I think).
Ubuntu is an African word meaning 'I can't configure Debian'
First, read up on Braitenburg Vehicles and The Selfish Gene, by Richard Dawkins. Dawkins is something of a deity in the annals of evolutionary biology and is worthy of worship :-p
Then read up on Neural Networks, start simple with a feed-forward with error backprop.
Then try your hand at some Temporal Difference Learning.
Then take a look at genetic algorithms, but it might help you to first understand the classic A* heuristic search algorithm. Genetic algorithms tend to be interesting search algorithms that are inspired by a genetic process, but they have little connection to the actual biological process for which they are named, so I am biased against them. This perception could just be a local cognitive minima that might be avoided with better training.
"Every time I see an adult on a bicycle, I no longer despair for the future of the human race." - H. G. Wells
Not knowing exactly what level of knowledge you're starting from... One of my first game purchases was Patton Versus Rommel, which included some artificial smarts. The liner notes included a reference to his second book The Art of Computer Design, [PDF] and based on the context, I hoped it might include at least introductory pointers to game AI. Nope. There's also Chris Crawford on Game Design, [Google Books]. It does include some high level designs, which may or may not be what you're looking for.
Luke, help me take this mask off
I've been in the same boat as the OP. I did research it and its wide and varied.
If you don't understand the question, why the hell did you post an answer?
Mod: Troll
Are available here.
Happy studying.
May I suggest the following book:
Multiagent Systems
Algorithmic, Game-Theoretic, and Logical Foundations
Yoav Shoham
Stanford University
Kevin Leyton-Brown
University of British Columbia
http://www.masfoundations.org/index.html
If you really have no patience for philosophy, try Game Theory for Applied Economists by Robert Gibbons instead. ;-)
John Maynard Smith's Evolution and the Theory of Games is accessible and indispensable.
Less technical works that explore the implications of the theory in fascinating ways include The Evolution of Cooperation (the book that first got me interested in the subject) and The Complexity of Cooperation by Robert Axelrod, and anything by Brian Skyrms.
Here is the complete Youtube playlist for the Yale course "Game Theory", lectured by Ben Polak. 24 lectures in total, about 1 h 15 min each.
Course description: This course is an introduction to game theory and strategic thinking. Ideas such as dominance, backward induction, Nash equilibrium, evolutionary stability, commitment, credibility, asymmetric information, adverse selection, and signaling are discussed and applied to games played in class and to examples drawn from economics, politics, the movies, and elsewhere.
I have had the intention of watching through this, but haven't had the time after the first few lectures. The material is recommended, though.
http://www.youtube.com/playlist?list=PL6EF60E1027E1A10B
Good game theory books I keep on my shelf:
Nonlinear Dynamics, Mathematical Biology, and Social Science (Santa Fe Institute Studies in the Sciences of Complexity Lecture Notes)
by Joshua Epstein
Westview Press
ISBN: 9780201419887
(if you know enough math for partial differential equations, this book is a must-have, since it's directly applicable to mathematically modelling open source software projects)
The Evolution of Cooperation
by Robert Axelrod and William D. Hamilton
Paper: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.147.9644&rep=rep1&type=pdf
Book: ISBN 0-465-02122-2
Perspectives on Adaptation in Natural and Artificial Systems
Basic Books
ISBN: 9780195162929
The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration
by Robert Axelrod
Princeton University Press
ISBN 978-0691015675
Game Theory and the Social Contract, Vol. 1: Playing Fair
by Ken Binmore
MIT Press
ISBN 978-0262023634
Game Theory and the Social Contract, Vol. 2: Just Playing (Economic Learning and Social Evolution)
by Ken Binmore
MIT Press
ISBN 978-0262024440
Analyzing Policy: Choices, Conflicts, and Practice
by Michael C. Munger
W. W. Norton & Company
ISBN 978-0393973990
Growing Artificial Societies: Social Science from the Bottom Up (Complex Adaptive Systems
by Joshua M. Epstein, Robert L. Axtell
MIT Press
ISBN 978-0262550253
See also:
http://www.santafe.edu/
http://www.youtube.com/user/santafeinst
The Brookings Institute is also active in this area (it was their math that led most of the U.S. Cold War policy and kept everyone out of a nuclear exchange with the Soviets).
-- Terry
MIT has tons of material on AI, on their OpenCourseWare site, especially in the Electrical Engineering and Computer Science section.
From the first link I got to this page which has the delicious quote:
"we might want to stop thinking about jobs as the main aspect of our lives that we want to save. They may be a means, but they are not the ends."
I'll get shot down in flames for this, but it's a geek fallacy to think that you can understand "politicians, business people, and general society" through "Artificial Intelligence and Game Theory".
To understand politicians, study politics.
To understand business people, study business.
To understand society, study sociology.
Of course, to understand Artificial Intelligence and Game Theory, then study Artificial Intelligence and Game Theory.
Tank, I need a program for AI and Game Theory... Hurry!
Set your phasers on "funky"!
"I would like to learn more about Artificial Intelligence and Game Theory. I know these are both large areas of study; however, my main interest is in how these affect decisions in the world. This would include politicians, business people, and general society. I'm not looking for a career or anything; this is just a personal interest of mine. Where are good places to start in these areas for somebody new to them? I'm aware of the Stanford on-line classes, but those don't work with my current schedule."
Do you really understand how unwise it is to put those words together in that manner? Don't interfere.
Shh.
I haven't seen anyone post it yet, but if your interest is in human-like intelligence, read an AI critic like Searle.
No, I want to play full scale thermonuclear war.
Read Avinash Dixit's Thinking Strategically to get started. It's a great book which does not use much math and can make for light reading and a great start.
M.I.T. had two 150th birthday conferences on A.I. this year. This would give some ideas on the state of the art and the players. Its not a systematic, pedagogical presentation.
If you've read the rest of the thread, you'll find dozens of suggestions of books and online resources. These help not only the OP with his questions, but also has the potential of helping dozens or hundreds of slashdot readers expand their education. Some of these are books that they might never have known existed, or online documents that wouldn't easily have turned up on typical google searches.
In other words, you don't understand the whole point of slashdot. It's a discussion board.
DISCUSSION.
The answers to a slashdot question are not primarily for the person asking them. The purpose of the answers is to interest and enlighten thousands of browsers. The question is simply a stimulus.
Obviously, there is nothing between 0% and 100%. Only an idiot would think you can learn more about something without dedicating your life to it.
Actually I am only half kidding! I was interested in this myself recently and found that there is a Yale proff teaching game theory that puts his lectures on youtube. I sat through two lectures on Nash Equilibrium a few months back: http://www.youtube.com/watch?v=7oASpaBdDMs
Course it couldn't hurt to get a text book, but, it would be trivial to lookup the required books for these or other similar classes, and go buy them at any college book store. Just walk right in and buy them, or find them online.
Is it the best way? Dunno.... but its a resource that you can use.
"I opened my eyes, and everything went dark again"
The Compleat Strategyst is an old but very good (not too mathematical) introduction to pure game theory.
Winning Ways for Your Mathematical Plays is a great series of books on the mathematics of games.
For AI, see previous reco's. For my money you can't go wrong with Russel/Norvig, unless you are looking specifically for AI that plays games.
Its definitely a subset of AI, but if you are interested in Machine Learning then you should check out the Deep Learning Tutorials [deeplearning.net]. They cover most of the building blocks of "Deep Learning", which you can think of as the new wave of Artificial Neural Networks. The tutorials include complete theoretical (and mathematical) descriptions of the model, as well as Python/Theano implementations. Pre-requisites would be a good math background (first year calculus should suffice), basic probability theory and coding in Python/numpy. You can learn Theano as you go along.
ps: sorry for the repost, forgot to log-in beforehand.
A million monkeys and this is the best sig they could come up with...
http://www.ai-class.com/
how is babby formed?
"The Predictioneer's Game" by Bruce Bruno de Mesquita is an overview of the authors use of game theory and statistical predictions of behavior (for profit, no less). He has a Ph.D. in political science, covers a few historical situations and bangs out some predictions. It is not heavy on the math, but would take a few afternoons to plow through.
Sounds like you are interested in Multiagent Systems. I am current taking a graduate course in MAS theory at Waterloo. Here is the book we use; it's free online http://www.masfoundations.org/index.html. It's an excellent book; the details and the high level ideas are broken apart nicely, such that if you want to go balls deep you can, but if you just wan't the high level ideas you can grab those too.
This is a hard-work. One of my friends is studing in this. But it is still a long way to learn .
UGG is a legendary brand of Sheepskin Boots . Ugg Boots appearance is simple cartoon that is popular in the Eurasian land.And now it bring a new fashion style all over the word. In 1978, an Australian surfer whose name is Brian Smith, brought a group of sheepskin boots to California of United States,where the developed market surfing attracted the Sheepskin Boots . Since then, Ugg become to be a world-renowned luxury brand of boots.