Slashdot Mirror


MIT Students' Audiopad Mixes Electronic Music

nicodemus05 writes "Grad students at MIT's Media Lab have come up with an innovative control device called the Audiopad to run their digital music studio. The Audiopad, '...is a composition and performance instrument for electronic music which tracks the positions of objects on a tabletop surface and converts their motion into music.' It's practical, but more importantly it looks really, really cool."

33 of 122 comments (clear)

  1. Sure by minghe · · Score: 4, Funny

    But can I play Chopsticks on it?

    --
    ...um...like...a sig...
  2. How long until... by daveo0331 · · Score: 3, Funny

    Someone gets sued by the RIAA for arranging the objects in their cube the wrong way?

    --
    Remember the days when Republicans were the party of fiscal responsibility?
  3. Re:Its practical by tankdilla · · Score: 3, Funny
    needless to say it's very cool, just need to integrate it into a table with the projector pointing up onto say a translucent surface rather than down onto a surface

    Better yet, make it work in a 3d space, where full body motion translates into music. There are a few actions that would translate into some interesting 'music' i'm sure.

    --

    -Look lively. LOOK LIVELY!!! --Mr. Shmallow

  4. I've seen it live.... by lennart78 · · Score: 4, Insightful

    I've actually seen this device in action and I was amazed. I think the way it interacts with the user/musician is something a lot of people are looking for. Let's hope some manufacturers of musical devices take note of this project and incorporate some of it's ideas in products that can be made available for a broader range of people.

    1. Re:I've seen it live.... by torpor · · Score: 3, Interesting

      I watch out for this stuff all the time.

      It's not always practical to apply this technology to the music-instrument market, though. The economy of the musical instrument market is a pretty tight one, sometimes - licensing things like this for incorporation into a product can make or break a product. I don't think the D-Beam or any of the other Ir-based controllers, for example, resulted in any kind of increased revenues, but they sure did cost a bundle to license.

      As far as integrating alternative-control methods into musical instruments, we're actively engaged in research, within certain constraints.

      There may well be some interesting new synthesizers on the horizon ...

      --
      ; -- the corruption of government starts with its secrets. a truly free people keep no secrets. --
    2. Re:I've seen it live.... by lennart78 · · Score: 4, Interesting

      Excuse me for being software-minded, but wouldn't it be possible to use some of the control-functions and build a MIDI-controller to use with softsynths, or even modular software such as Reaktor?
      I think it would offer some interesting possibilities.

    3. Re:I've seen it live.... by entartete · · Score: 2, Interesting

      The d-beam did seem to add some 'gee whiz' factor to the groovebox things roland stuck it on to, which might have not directly sold many units (I own one, and mostly because of the d-beam and general knobbyness of it, to use as a portable machine to play with live, but i picked it up used so roland didn't directly make any money from me) but it might have paid off in terms of advertising/name recognition. I did a lot of my graduate work using a Very Nervous System (gestural control system using a couple cameras that could track motion,etc) and without fail everytime i'd perform with it in public someone would go 'hey! that's like that thing on the mc-505!' and a mini roland commercial would ensue. dunno if that it would completely justify the costs though. For the forseeable future though I agree that it wouldn't be worth if for most synth companies to build any of the more exotic interfaces directly into an instrument. but it might be worth it for an instrument manufacturer to work closely with a third party controller manufacturer and make certain their synthesizer worked especially well with whatever gizmo the interface maker was coming out with, make a bank of preset sounds that work well with it, much like how a lot of yamaha fm synths have patches designed for some sort of vector sweep like control or for wind controllers, midi guitars, etc as well as make sure that the interface shipped with an instrument definition for whatever your new synth is. If access would like to give me one of those oh so pretty indigo2's i'd be happy to help out with some gestural control oriented patches for it. ;)

    4. Re:I've seen it live.... by torpor · · Score: 4, Interesting


      Yes, of course it would be possible, but I don't work for a software synthesizer manufacturer, I work for a hardware synthesizer manufacturer.

      We actually make money (soft synth guys don't, pity for them). This means it is more seductive for someone to require us to license something like this technology.

      We'd rather just come up with it ourselves.

      Either way though, the lesson to be learnt from MIT is that there is a loooot of room for improvement in the control surface side of things.

      (We know that already, though.)

      --
      ; -- the corruption of government starts with its secrets. a truly free people keep no secrets. --
  5. Re:Its practical by Anonymous Coward · · Score: 2, Funny

    I've already done this, when we were kids, me an my sis joe, we loosened one screw in mom's bed so we can hear whenever she has a friend over. It worked pretty well, well enough for us to calculate the number of thrusts, the duration, delta T, and so on.

    Incredibly, joe now works for NASA.. while I wither away in unemployment (who wants to hire a SCO admin?!)

  6. Sounds great by arvindn · · Score: 4, Funny

    ...but since I can't access the page, I'll just say that if they can make a similar device to convert the death throes of a webserver into digital music, we could have some real fun during slashdottings :)

    1. Re:Sounds great by 3.5+stripes · · Score: 2, Funny

      I'd imagine it'd sound somethng like pac-man dying, or a wind up music box 2 seconds before it's completely static.

      --


      He tried to kill me with a forklift!
    2. Re:Sounds great by Illserve · · Score: 2, Insightful

      There's value in tradition.

  7. Done before? by m1kesm1th · · Score: 4, Insightful

    I haven't had time to see the site in action, probably due to the slashdot effect.

    From the description, other than using a tabletop as its active surface, i'm wondering how different it is to Korg's Kaosspad in functionality.

    http://www.korg.com/gear/info.asp?A_PROD_NO=KP2

    1. Re:Done before? by radish · · Score: 2, Informative

      The most obvious difference is that the KaossPad isn't an instrument, it's an FX module. Basically you have a bunch of 2 paramater filters and an x/y touchpad to control those 2 parameters. Wicked good fun and slots nicely into a DJ setup, but in my experience only about 10 of the 50-odd presets are actually worth using. The low/high pass filters, some of the reverbs, and phasers etc sound good. A lot of the coarser echos, fx "noises" etc sound awful. The sampler is also annoyingly limited to only 5 seconds, which is just too short for a full phrase at a normal 135bpm :( Still, a fun toy, and the girls always love it for some reason (flashing lights and bits to rub?).

      I believe you can use it as a midi controller as well, but again you're going to be pretty limited (I guess a couple of continuous controllers?). My understanding of the article is that the MIT thing is a lot more flexible.

      --

      ---- Den ene knappen er powerknapp, den andre er Bender voice knapp "Bite My Shiny Metal Ass"

  8. Re:The interface is amazing.. by minghe · · Score: 2, Insightful

    This could probably be made with more affordable hardware, like a TFT touch screen, or even a regular monitor and an XY pad. It would take a slight adjustment of the original constuction, interface-wise. But the main idea would still be applicable.

    The really low budget version of this would be a software-only product controlled by mouse. It would probably sell, even though some functionality would probably be lost.

    --
    ...um...like...a sig...
  9. Can MIT do the reverse?? by jkrise · · Score: 2, Funny

    These days, with the DRM and the DMCA, it's tough getting a music file without DRM crap. What I'd like the MIT folks to do is this:

    Get some objects on a table to dance, based on the music! And then we can have another Audiopad to capture the music from this dance - non DRM MP3....breakthrough!

    -

    --
    If you keep throwing chairs, one day you'll break windows....
  10. Re:The interface is amazing.. by srinner · · Score: 2, Informative

    some years ago there was a toy-company called Zowie (bought by LEGO as far as I know) they had two products - a "pirate ship" and a "garden" where you could frrely move around some small dolls and their accurate position was transmitted to a connected PC - they did all the positioning stuff some custom chip included in the toy - so producing this stuff cheap in large quanitities is no problem at all

    - stefan

  11. Re:Its practical by kfg · · Score: 2, Informative

    Already been done. It's called a Theremin.

    http://www.thereminworld.com/learn.asp

    KFG

  12. sigh. by den_erpel · · Score: 4, Insightful

    This is just another one of those MIT projects that makes it to slashdot. Just as you seem to have chain effect in 'peer review' processes, it's not because it is spectacular that it gets published, but mainly because it is from place X or Y.

    Loads of universities create student projects but they basically give it the attention it deserves: they are student projects; practical definately, revolutionary, not by far. Their main purpose is to give students a direct experience with real life toy projects. Real life, because in those projects, several aspects from real systems are included. Toy because students do not have the time to really do the advanced design and testing a profesional project requires.

    --
    Genius doesn't work on an assembly line basis. You can't simply say, "Today I will be brilliant."
    1. Re:sigh. by broeman · · Score: 2, Interesting

      I just ended my master in interaction design among other design tasks. The idea of interaction design is to create tangible (mostly) interfaces that can connect to human logic and emotion (human computer interaction). Of course the tools looks like toy and act like a toy, simply because they are easy to use. What is the real challenge is to connect the evergrowing functionality with easy handling, and it seemes that the MIT guys, Professor Bill Verplank (the travelling lector *grin*) in northern Italy and Berkley (also music interaction mostly) and the study I went to here in Denmark (IT Product Design, Sønderborg) are the only educations and research facilities for easy handling in the world. My education was also quite focused on working with the industry (and especially the users). The industry also see the products as toys that is produced for showing off, but when a situation arouse they would suddenly see why we designed the products in those ways, and then get the full acknowledgement of our work. It has nothing to do with spectacular design, but with experiencing new ideas first hand, and even to create them as realistic as possible (isn't that was studying is about?).

      --

      (yes this can be compared with sex)
    2. Re:sigh. by skirch · · Score: 2, Insightful
      This is just another one of those MIT projects that makes it to slashdot.

      I'm sorry, but did you even go to the page? Did you watch the movie? It's frickin' rad!

      Who cares if this is just another one of those MIT projects. This is a useful, fun, and ingenious toy! People (i.e. me) are giving this project attention because it's interesting and unique, not because it's from MIT. Please.

  13. Re:Its practical by Anonymous Coward · · Score: 3, Informative

    Leon Theremin did that back in the 20's. It was called a Terpsitone and worked off of body capacitance.

  14. Theremin by zoeblade · · Score: 5, Informative

    If you want to wave your arms around to make music, you still can't beet a Theremin.

    1. Re:Theremin by CausticPuppy · · Score: 3, Funny

      Actually, if you want to wave your arms around to make music, you can't beat being the conductor of the New York Philharmonic.

      --
      -CausticPuppy "Of all the people I know, you're certainly one of them." -Somebody I don't know
  15. nice by tade · · Score: 4, Interesting

    This reminds me of this. It is called Mixed Reality Pong.

    Mixed Reality Pong is a mixed reality version of the classic "Pong" game. The aim of the game is to score goals by hitting a virtual ball over the other end of the game area protected by the opponent player. The game counts the goals the players have scored, and they can agree to play either for a limited amount of time, or until either of them has scored a certain amount of goals.
    The players can play the game with their hands or other real-world objects. The game physics simulate the behaviour of a real ball, except that the virtual ball doesn't slow down at all.

  16. Nothing new... by httpamphibio.us · · Score: 2, Insightful

    Max/MSP and Pure Data have been doing stuff like this for years. The only thing "unique" here is the fact that they aren't using a mouse, and that's just a bunch of standard Max/MSP and PD externals. Bleh.

    --
    sig.
  17. different site with video by Tmurder · · Score: 3, Informative

    As it seems the MIT site is slowly being slashdotted... here is a different site with a demonstration video.

  18. The ideas in this aren't all that amazing by ev3nly · · Score: 2, Informative

    what's really neat is the interface... being able to move sounds around in a 3d space and manipulate the samples/loops with a completely uncluttered interface. This is the main problem with vst/softsynths, being able to use them in real time w/o a midi controller. The ideas is to get as close as you physically can to the music be made and computers.Audiopad does this thru least one computer to do it's job and radio tagging of the objects being moved around the table. The reason something like this won't go commercial for a long time is b/c there are no real new ideas as far as the actual sound manipulation is concerned. See ableton live for example or jeskola buzz.

    1. Re:The ideas in this aren't all that amazing by shaniber · · Score: 2, Insightful

      this in itself might not be commercially viable, but it makes an interesting case study in applications of their Sensetable, which this is based on. They've demonstrated the use of this tool in the demonstration of molecular interactions, as well as tracking business methods. it's seriously interesting HCI stuff.

      --
      mah na mah na.
  19. I see a problem by AndroidCat · · Score: 2, Funny

    Never mind all the fancy stuff, I think the basic problem is students and fairly clear table space.

    --
    One line blog. I hear that they're called Twitters now.
  20. Actually, this is very new by Makarakalax · · Score: 2, Insightful

    Oh come on, the interface is everything to an instrument. Instruments vary in only two ways, firstly the sound they produce, and secondly the way they have to be manipulated to produce those sounds.

    This instrument may be similar to the device you reference, however its novel and easy to manipulate interface will allow completely new sounds to be woven into compositions. I'd wager that an experienced artist could make music with this device that he couldn't do with any other instrument - but I'd need to read more about it first.

    So to argue more directly with your point: The user interface would be the whole point if it actually helped the user achieve something in a more efficient fashion... but it doesn't do anything that doesn't already exist. The interface is the whole point and it does help the user either make music more efficiently, or to make completely new types of composition. I'd say both, but I expect you'd have to ask someone who's made music with it.

  21. Coming soon to a toy store near you... by lastsamurai · · Score: 2, Informative

    Earlier this year at a Boston concert, Tod Machover showcased Beatbugs http://www.media.mit.edu/hyperins/projects/beatbug s.html Concert staff were telling everyone that Beatbugs would be available for sale this Christmas through a major toy manufacturer. That's great for getting music into the hands of kids at an early age and also for breaking through the classism that plagues intellectual music, but is the "music" that's being created really something that anyone (other than grandma) wants to listen to?

  22. Re:Is that a big Wacom tablet? by shaniber · · Score: 2, Informative
    actually, it's based on
    a pair of modified commercially available Wacom Intuous(TM) sensing tablets that are placed next to each other to form a 52cm x 77cm sensing surface.
    this is taken from an article published in the Proceedings of CHI 2001, March 31 - April 5 2001. so, you're right!
    --
    mah na mah na.