Slashdot Mirror


Can Curiosity Be Programmed?

destinyland writes "AI researcher Jurgen Schmidhuber says his main scientific ambition 'is to build an optimal scientist, then retire.' The Cognitive Robotics professor has worked on problems including artificial ants and even robots that are taught how to tie shoelaces using reinforcement learning, but he believes algorithms can be written that allow the programming of curiosity itself. 'Curiosity is the desire to create or discover more non-random, non-arbitrary, regular data that is novel and surprising...' He's already created art using algorithmic information theory, and can describe the simple algorithmic principle that underlies subjective beauty, creativity, and curiosity itself. And he ultimately addresses the possibility that the entire Universe, including everyone in it, is in principle computable by a completely deterministic computer program."

12 of 269 comments (clear)

  1. curiosity 0.1 by Anonymous Coward · · Score: 5, Funny


    #!/bin/sh
    for i in who what where when why how; do
        echo "But $i, dad?"
    done

    I hereby submit this project to the /. community under the GPL v2.

  2. Physics of computing the universe by BitZtream · · Score: 4, Interesting

    And he ultimately addresses the possibility that the entire Universe, including everyone in it, is in principle computable by a completely deterministic computer program.

    The problem with this is that you need to be outside the universe in order to do so, you can't calculate the universe from within itself any more than a VMWare can run a machine faster than the host processor.

    You'd also need more mass in your computer than exists in the universe, observable or otherwise.

    So sure, I'll go with the theory that its possible, just not by any thing in our universe.

    Likewise, nothing in our universe could leave it to perform the calculation elsewhere, as doing so links the two realities together, so you now need to simulate both.

    Everything is interconnected and the very act of attempting to simulate the universe changes the simulation. Every new version of the simulation would instantly require a new version to take into account the changes from the previous version.

    The theory is ... cute at best, but unworkable.

    --
    Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    1. Re:Physics of computing the universe by ScytheLegion · · Score: 5, Funny

      I'll be programming all of this tomorrow... on my new iPad

    2. Re:Physics of computing the universe by Profane+MuthaFucka · · Score: 5, Interesting

      There's a workaround. You don't need to simulate the entire universe at one time, and there's no way that anything inside the universe would ever be able to tell that huge swaths of the universe aren't being actively simulated.

      Reasoning: If a universe simulator needs to have more states than exist inside the universe (we're both assuming this) then then any process which verifies the universe simulator would also need to have more states than exist inside the universe. Therefore, the universe can only be fully simulated from outside the universe, and you could only determine that the universe was fully simulated from outside the universe. From inside the universe, all you could simulate and all you could check would be a subset of the universe you are in.

      So you could actually pull off a neat trick, just like the human eye does. The human eye doesn't actually see clearly except in the very middle of the vision. But, wherever you look, whatever you're looking at is clearly resolved. Your brain gets the distinct impression that it's looking at the entire scene clearly, except it's not. Only the part that it's actually looking at is clear.

      Well, that's enough hacking of the universe for today. I need a beer.

      --
      Fascism trolls keeping me up every night. When I starts a preachin', he HITS ME WITH HIS REICH!
    3. Re:Physics of computing the universe by p00ya · · Score: 4, Interesting

      Even at a slower rate than real time you cannot simulate the universe from within the universe. This has been proved by Cantor diagonalization (see Wolpert's "Physical limits of inference" paper).

    4. Re:Physics of computing the universe by mcgrew · · Score: 4, Interesting

      At the atomic level there's a lot of randomness.

      Can we be sure? What seems random may not in fact be truly random. The flip of a coin is considered random, but if you could account for all the variables with enough precision; angle of the coin, angle of the thumb, force of the flip, distance to the floor, etc, you could likely predict each and every toss.

      Rather than being random it could be that it's just more complex than we know, or that we can't determine the variables with enough accuracy. What is the exact value of PI?

  3. Coding For Patterns of Anomalies by neorush · · Score: 5, Interesting

    Aren't we really just talking about coding for patterns of anomalies? We know how to code for patterns, we know how to code for anomalies. Isn't it a matter of processing huge data sets and looking for patterns that have not been recorded before? Of course, you could argue that whether or not the pattern is relevant is the big problem, but curiosity is not necessarily about relevance.

    --
    neorush
  4. of course it can by walkoff · · Score: 4, Interesting

    When I was a fledgling programmer in the 80s I worked on some financial AI programs for a bank with some very smart people with lots of letters after their names and programming artificial curiosity was assigned to me. After some thought and a lot of dead ends I managed to program a reasonable (for our needs) facsimile of curiosity by assigning weights to the various pathways the program was evaluating and making those weights tend towards 0 (curiosity satisfied) or 1 (Curious) without ever reaching the final values. By having the program modify the weights and make decisions on which paths to follow based on those weights the program acted as if it was curious and came up with several interesting results that were completly unexpected.

  5. Re:What's that like? I'm curious. by Trepidity · · Score: 4, Insightful

    Depends greatly on what you research. Unfortunately, the vast majority isn't as glamorous as you might imagine. I work in a pretty interesting area (an academic area with connections to videogame AI and game design), and this sort of creativity / discovery-systems / curiosity / art / etc. research is interesting too. But the vast majority is more pedestrian. Sure, there's interesting applications: computer vision, robotics, planning, data mining, bioinformatics, etc. But 90% of the work that comes out is incrementalist stuff; relatively boring proofs of some fact, or new algorithm that's 7% faster in some important special case (I suppose that's true of a lot of scientific fields, though).

    It goes back and forth in waves, though. It seems that there will be waves of pretty exciting AI research, then a backlash as some of it goes over the top into sci-fi Singularity Is Nigh sort of AI, then things swing all the way to the other direction into AI as a really narrow field that's basically applied statistics, control theory, symbolic logic, and planning, and the only stuff that can get published is Rigorous stuff with Proofs (sort of a defensive reaction by people worried about being branded kooks). Then after a few years of that everyone realizes that 5000 more proofs in some super-narrow area aren't getting us anywhere because the field is stagnant with no direction, and people start doing more speculative applications and proposing new problems again. Then repeat.

    It's somewhat unfortunate on the whole that there's such a big gap between what you might call "layperson AI" and "academic AI". The layperson AI (the singularity crowd, etc.) are excited about stuff, and have interesting goals, etc., but often do stuff that verges more on the sci-fi than the scientific. But academic AI is so scared of being them that it consciously tries at times to be super-boring so nobody mistakes them for Hans Moravec.

  6. Re:Of course it can. by Fantastic+Lad · · Score: 4, Interesting

    Of course curiosity can be programmed. What are humans if not big, fleshy, biological machines of sorts? Granted we do not work like computers do, but the underlying processes are still structured and computational--if the brain were chaotic it wouldn't work.

    ~waves hand~ Speak for yourself, Mister Roboto. ~/waves hand~

    But seriously, this is a really fascinating question. Souls aren't handed out like candy. You have to build them through main force; by actively choosing to be aware from moment to moment. What I am finding to be the biggest challenge in that requires the supreme effort of recognizing one's own automatic nature and cleaning the gunk out of it.

    Every time some subject comes up in conversation which makes me twitch or sweat or want to pull away, THAT indicates a piece of gunk. Each time I want to fall back and use a comfortable and proven behavior routine to deal with a given moment, THAT indicates a piece of gunk.

    After one does enough work, you begin to see very clearly just how messy and automatic the people around you are. -These days, I find I am constantly aware of people's programs and little acts, why they work and what they are designed to do, and where people get stuck running those silly programs over and over day after day, year after year without ever stopping to ask, "What is the real me under this?". The soul is that part of us which is capable of recognizing the automatic nature of the brain and body and stepping in through an application of Will to interrupt the code execution.

    It's difficult and the ego doesn't like it at all; Any suggestion that one is a robot is usually met with disgust and fear, if the accusation is even understood in the first place. The Ego is, I think, a foreign installment designed exactly to keep us from performing that self-examination. With the Ego in place and strong, there is no hope of breaking out of the cage of automatic behavior.

    Like I said, a fascinating topic.

    -FL

  7. Re:Non-determinism. by Burnhard · · Score: 4, Insightful

    P-zombies are a ridiculous construct.

    No more ridiculous than the idea that Consciousness is reducible to basic, known, physical laws.

  8. Re:Of course it can. by Fantastic+Lad · · Score: 4, Funny

    let me be the first to say... what the hell are you talking about?

    First of all, your question is a lie. You don't actually want to know what I'm talking about. Here's what I see:

    You recognized a pattern which is out of keeping with the "official" mode of thinking, and the automatic program you come pre-installed with kicked into play. Some variant of herd-motivated ridicule.

    When the program finished running, you felt better about yourself; secure in your membership in the herd. That warm, fuzzy hit of feeling of belonging is the reward for running the program. The program itself is a very simple, but otherwise clever little trap for those ensnared by it. It pushes those it is run against to stop thinking outside the official parameters while at the same time blocking awareness of whatever topic of thought or discussion first activated the program.

    In order to implant the program, the subject needs to have been tormented as a child so that it A) recognizes and understands the dynamics of the social pecking order, and B) has had its self-confidence crushed through repeated attacks so that it remains dependent upon the herd for all of its personal validation and love.

    This program is layer one; among the first and most basic hurdles which must be cleared in order to have even the smallest hope of waking up. Very, very few people are able to this. Until then, you are a robot, plain and simple.

    That's what I'm talking about.

    Aren't you glad you asked? ;)

    And don't worry. We all go through this. I'm not trying to hurt you.

    -FL