Slashdot Mirror
Google's AI Can Now Learn From Its Own Memory Independently (sciencealert.com)
The DeepMind artificial intelligence (AI) being developed by Google's parent company, Alphabet, can now intelligently build on what's already inside its memory, the system's programmers have announced. An anonymous reader writes: Their new hybrid system -- called a Differential Neural Computer (DNC) -- pairs a neural network with the vast data storage of conventional computers, and the AI is smart enough to navigate and learn from this external data bank. What the DNC is doing is effectively combining external memory (like the external hard drive where all your photos get stored) with the neural network approach of AI, where a massive number of interconnected nodes work dynamically to simulate a brain. "These models... can learn from examples like neural networks, but they can also store complex data like computers," write DeepMind researchers Alexander Graves and Greg Wayne in a blog post. At the heart of the DNC is a controller that constantly optimizes its responses, comparing its results with the desired and correct ones. Over time, it's able to get more and more accurate, figuring out how to use its memory data banks at the same time.
A neural network normally uses it's own connection weights as "memory" or storage. There's a tradeoff between making a network with enough parameters to store lots of information and making one that's fast, efficient and doesn't overfit problems. In many cases you're practically limited by how much memory you've got on your video card. Having a neural net that can learn to store some information separately from its own processing apparatus is interesting.
highly charged political election season
A strange game. The only winning move is not to play. How about a nice game of chess?
Have gnu, will travel.