Slashdot Mirror


Ask Slashdot: How Can a Blind Singer 'See' the Choirmaster's Baton?

New submitter krid4 writes "Question from a blind friend: 'My ears replace my eyes. However, when it comes to the very moment of starting, or the change of tempi, my start will always come too late. Neither tuning in with the voices around me, nor listening to the moment of their breathing-in helps to solve this problem. Fancy that it might be possible to produce tactile pressure or even lines at the top of my right hand, head or body. Even pulses would do, because what finally counts is the moment of the 'beat' produced by the choirmasters baton.' What simple, possibly DIY solutions are possible? It would help many blind chorus singers."

30 of 189 comments (clear)

  1. motion tracking video by femtobyte · · Score: 5, Insightful

    Motion tracking video of the baton (cheap webcam view from the side, colored foam ball on the baton end, track up/down motion with some very simple image processing); convert to a usable signal (e.g. audible clicks through an earpiece when the baton reaches maximum/minimum positions and turns around).

    1. Re:motion tracking video by femtobyte · · Score: 2

      alternate "visualization" method: have a constant stream of clicks through headphones (open-sided so as not to impede following the singing), varying the audio phase to move the stereo "image" side to side as the baton goes up and down; this should make it easy to follow the whole motion of the baton, not just the extrema, using the most cheap and available off-the-shelf hardware.

    2. Re:motion tracking video by femtobyte · · Score: 3, Interesting

      What part of this is hard? Cheap webcam? Bright-colored foam ball? Earpiece? Software to coordinate these?
      Though image recognition in general, uncontrolled conditions is extremely hard ("here are snapshots of random traffic; identify the location of all signs, pedestrians, vehicles, and obstacles"), specialized tasks under controlled conditions ("there is one saturated red dot in the picture, between 30 and 50 pixels wide; find it.") are trivial to implement. If I was asking for software that could take any random photo of a choir and figure out where the conductor and baton were, that would be "flying car" hard; but, by reducing to a much simpler and well-controlled problem ("find the known-color, known-size spot"), the task is trivial (select all pixels within appropriate color range; apply dilation and expansion morphological operators to select the right size range; return the centroid of remaining pixels --- easy-peasy).

    3. Re:motion tracking video by newcastlejon · · Score: 4, Insightful

      Motion tracking seems excessive when the poster would be satisfied with a simple pulse. I would suggest an accelerometer mounted to baton/conductor and a rumble motor ripped from an old gamepad for the singer (or an earpiece).

      For a no-tech alternative try having the singer sit/stand near the conductor and have the latter tap their feet (hard) along with the baton.

      --
      If God forks the Universe every time you roll a die, he'd better have a damned good memory.
    4. Re:motion tracking video by femtobyte · · Score: 4, Insightful

      The downside of using "specific pitch tones" is confusing the heck out of the subconscious of someone trying to sing at some other particular pitch (to match the voices around them). Something broad-spectrum and atonal (a click, hiss, tick, or thump) can relay timing and position information, without interfering with (competing for attention in the brain) tonal perception.

    5. Re:motion tracking video by Anonymous Coward · · Score: 5, Informative

      They already have motion sensitive batons. A person I know uses one to practice his conducting. His old one connected to the computer through a MIDI interface (and his new one uses USB) so that way the music would follow his conducting. It is interesting how much information just the baton conveys, especially through the way modern conductors form the ictus. He can control the tempo, dynamics and many other more minute things.

    6. Re:motion tracking video by femtobyte · · Score: 2

      Even if motion tracking is "excessive," it's probably easier to implement in readily-available hardware: use a camera already on a laptop/phone, rather than needing to wire up the conductor with a custom accelerometer mount. And ripping a rumble motor from a gamepad (and creating the software/hardware interface to control it) is a heck of a lot more work than just piping sound out to headphones. As I describe in another post above, the motion tracking (in a simple and controlled environment) is pretty trivial to implement; I'm not asking for full 3-D capture of the whole conductor's body, just a colored spot (selected to be different from any wallpaper behind) moving up and down.

    7. Re:motion tracking video by Kell+Bengal · · Score: 5, Informative

      I would suggest an accelerometer mounted to baton/conductor and a rumble motor

      I'm a robotics researcher - some of my work includes developing aids for the blind. Of all the comments here, this is the sanest one and the one that would actually work for people with vision impairment. It's simple, it's cheap and it will WORK. We've had good success with similar systems for other tasks like navigation and playing soccer.

      --
      Scientists point out problems, engineers fix them
      altslashdot.org: The future of slashdot.
    8. Re:motion tracking video by i.r.id10t · · Score: 2

      Could something be done with a small LED bulb that is emitting non-human-visible light that a camera could pick up work instead?

      --
      Don't blame me, I voted for Kodos
  2. Have someone next to you squeeze your arm by sanpitch · · Score: 5, Insightful

    If you're singing in a choir, then you're standing next to someone else, who is likely sighted. Just have them give you the cue. It could be that they hold your upper arm, and slide it down to the elbow it as the choirmaster's baton drops. If the choirmaster gives a four-count before starting, then the helper's signal may be four squeezes on your arm, or four taps on your shoe. I don't imagine that it would take much training for a new person to help you with this, and it's much cheaper than some high-tech solution which may not work.

    1. Re:Have someone next to you squeeze your arm by Cow+Jones · · Score: 5, Informative

      FWIW, this is exactly what we do to cue a blind choir member.
      It's not a geeky solution, and it involves people touching each other, but it's very reliable.
      I can't imagine any sighted choir member refusing to do this.

      --

      Ah, arrogance and stupidity, all in the same package. How efficient of you. -- Londo Mollari
    2. Re:Have someone next to you squeeze your arm by martin-boundary · · Score: 5, Funny

      It's not a geeky solution, and it involves people touching each other, but it's very reliable.

      Ah, but I'm afraid that only solves 99.99% of cases. To fully solve the problem, you also have to deal with the 3 blind-choralists-in-a-row problem, which is well known to not have an analytic solution except in trivial cases. Perhaps a numerical approach using a Sobolev auditorium might work, though.

  3. Re:Counting down by BradleyUffner · · Score: 3, Informative

    Can't the choir director accommodate your disability by counting down the beginning of the song? Forcing you both to adapt some cumbersome technology seems silly.

    The baton is used for more than just starting the a song.

  4. Re:No way to see! by sanman2 · · Score: 3, Insightful

    In Marvel Comics, lawyer Matt Murdock found a way... ... and became Daredevil!

  5. Re:Counting down by digitig · · Score: 3, Insightful

    "when it comes to the very moment of starting, or the change of tempi" (My emphasis). No, it won't come with practice, because the conductor won't necessarily set exactly the same tempi every time. Not all music is done to click-tracks.

    --
    Quidnam Latine loqui modo coepi?
  6. Re:Counting down by AK+Marc · · Score: 2

    Tempo changes and such should be covered, but starting a song from silent room would be hard to do. They don't yell "5-6-7-8" clicking the drumsticks together before starting Ave Maria.

  7. Re:Counting down by jklovanc · · Score: 2

    By that logic a conductor is not needed during a performance; all they would have to do is press play. Every performance is a little different as the conductor modifies volume and tempo.

  8. Wrong forum - ask a choir director by rrkaiser · · Score: 2

    Ask someone who's encountered the problem and seen it solved... Like a choir director or one of the many organizations of choir and choral directors. Here's one. http://www.chorusamerica.org/ Part of the purpose of such organizations is to share information about what works for common and uncommon situations.

  9. This is more difficult than it seems. by robbak · · Score: 3, Insightful

    Although the choir starts singing on the large downward movement of the baton, that is not the cue the choir is using - if the started singing after seeing the downward movement, they would always be late. They are actually taking their cue from the very subtle upward movement just before the downward sweep. Even detecting this would be difficult. The size of this movement, and the delay between this movement and the drop, whether a movement is the of the 'get ready' upward sweep... all very difficult and confusing things. And the nature of the movements will change depending on conductor, the nature of the music, or even the conductors mood. The human brain sorts all of these things out just fine. The best idea is one I read from another poster here - have the neighbour of blind singer give them their cue.

    --
    Prediction for end of Universe #42: Fencepost error in Quantum_bogosort.cpp
  10. discrimination and detection needed by Tsu+Dho+Nimh · · Score: 3, Informative

    However, when it comes to the very moment of starting, or the change of tempi, my start will always come too late.

    Ah .. the trauma of remembering band practice:

    Every conductor has a different style. The signal to start your part of a song that has already begun may be a small flick or pointing of the baton in your general direction, barely interrupting the overall tempo of the conducting, or if you have a dramatic conductor it can be a two-handed "picador going over the horns" gesture ... or no gesture at all.

    Because the baton may be signalling to someone near the OP - in front or behind - but not the OP, the problem is discrimination as much as detection.

    Also, it's not always a down beat. Changes of volume, extended notes and the final cut off of a long final note may be sweeping or tiny gestures sideways or straight towards the choir or orchestra.

    Very few conductors will make big changes in tempo from what was practiced. No good will come of it.

    In short, it might be more practical to start on the second note and drop out on the next to last note, paying attention to the parts of the production that immediately precede your bits so you are ready for it.

    1. Re:discrimination and detection needed by Twinbee · · Score: 2

      To make matters worse, the 'beat' for some conductors comes in on the downstroke, and for others, on the upstroke, and variations in between. It varies according to country, but even within a country, there's differences.

      --
      Why OpalCalc is the best Windows calc
  11. Re:No way to see! by larry+bagina · · Score: 3, Insightful

    Yes. Instead of a baton, use a cattle prod.

    --
    Do you even lift?

    These aren't the 'roids you're looking for.

  12. Stand next to a sighted helper. by gd2shoe · · Score: 4, Insightful

    Gah. No. That'd throw your pitch off terribly.

    There's only one answer I can come up with. Have someone stand next to the blind friend and give him/her tactile cues. Hand squeezes would work, but be very basic. If the sighted friend has any skill, holding hands (down by their side) and making a very small pattern would be even better.

    Either way, the sighted person would need to pay extraordinarily close attention to tempo changes and cuing. I'd be a hard job, but it would be doable.

    As for the aesthetics of the performance? Nobody cares when you're helping a friend like this. If you're really concerned about how it looks, then make it obvious somehow that they're blind. (have them wear the great big stereotypical black glasses, etc)

    --
    I won't join Slashcott. OTOH, If Beta goes live, I just won't be back until it's fixed. Sorry Dice.
    1. Re:Stand next to a sighted helper. by Macman408 · · Score: 2

      Yeah, I'm with you on the no-tech solution bandwagon. Especially in a chorus, it's pretty easy to be close to somebody else, and if you feel the need, hide the tactile cues behind the row of people in front of you or your music. Though some people might question what the blind chorus member is doing holding a music folder. ;-)

      I was in a youth orchestra that had a blind member playing viola (or maybe it was second violin?) for a while. I never knew her, but from what I gathered, she'd learn and memorize all the music on her own before we started rehearsals. She was seated right in the middle of the orchestra - between violins and violas, and in front of the winds - so that she could hear everybody around her. I think for entrances and tempo changes, she'd rely on listening to the rest of the orchestra, or come in a little later if she had to. (Obviously, it's a little harder to have tactile communication in an orchestra, where everybody is using both hands for their instrument, and the strings tend to be spaced apart a bit so that their bows don't collide.)

  13. Simple by bratwiz · · Score: 2

    Simple, replace the baton with a starter's pistol..

  14. Motion tracking with an IR LED by girlinatrainingbra · · Score: 2

    Multiple steps:
    1 - modify baton to include an IR-led (infrared wavelength Light Emitting Diode) so that motion tracking of the baton's moving tip can be done easily without bothering other people in the orchestra or the audience with a visible or flashing or distracting red or green LED
    2 - set up some sort of motion tracking system that can track the IR led and come up with X-position and Y-position and possibly also X-velocity and Y-velocity
    3 - calculate X-velocity as the derivative of the X-position, calculate the X-acceleration as the derivative of the X-velocity with respect to time; do the same for Y-position to calculate Y-velocity and Y-acceleration
    4 - when you hit zero-crossings for X-velocity (e.g. X-velocity goes from positive [right to left perhaps] to negative [left to right], then the X-clicker is activated
    5 - when you hit zero-crossings for X-velocity (e.g. Y-velocity goes from positive [down to up perhaps] to negative [up to down], then the Y-clicker is activated
    6 - hide/place X-clicker in the right-foot, maybe at the heel-pad/ankle region or right under the big-toe, whichever the user likes best
    7 - hide/place Y-clicker in the left-foot
    .
    alternate 6 - X-clicker-A goes under little toe of right foot, X-click-A is activated when the baton goes from (left--right) to (right-to-left), which means it hit the right-extent of travel and reversed; X-click-B goes under the big toe of right foot and it clicks when the baton stops going (from right-to-left) and reverses direction to go (from left-to-right), which is the left-most extent of travel.
    alternate 7 - do like alternate 6 but place one clicker at the back of the heel Y-click-min which clicks when the baton changes from traveling downwards to traveling back upwards, and tape Y-click-MAX along the calf, maybe 6 inches up or so, and Y-click-MAX clicks when the baton stops traveling up and changes direction to go down. This is an intuitive mapping of what the baton is doing.
    :>) If this works, please send me royalty or idea money if you're grateful. JK. No, maybe if you do make money, gimme! (alternate-6 and alternate-7 from brother on phone. Thanks!) Note that the alternate clickings will match what the baton is doing in real-geometric space!

  15. Re:No way to see! by LukeWebber · · Score: 2

    Better yet, a lightsabre. Then you just listen for the pitch and volume of the hum.

  16. There Is A Way by b4upoo · · Score: 2

    In concert bands and orchestras frankly the director is not in control. The tubas and Sousaphones have enough tube length that the player must lead the beat by a fraction of a second. The reality is that the director's baton is actually following the big brass in timing. Since a chorus is often without the deep brass sections you need a device that will send you an audio cue slightly ahead of the choral director. I suspect that a portable or hand held PC like device could be programmed to measure the tempo and report the beat slightly ahead. It also would need to vary the intensity of the cue so that you would no when to play forte or pianissimo.
                        You can get what I am describing by looking at marching bands. The last row in the band will be the Sousaphones. The Drum Major is pretty much invisible to most of the band members so it really is not the drum major controlling either the pace of the march nor the pace of the music. It is the sousaphones and they are pointed right over the heads of the band members. And it is most likely feeling the sound and not hearing the sound that cues in the players. Think about all the noise in a stadium and the cheering etc.. If you are playing a clarinet or other instrument you won't be aware of the Sousaphones much or at all. But they are controlling the pace at all times. The drum major blows his whistle when the piece is finished and when a piece is to be started and puts on quite a show. The low brass knows what pace to set from rehearsals. And the bulk and weight of the Sousaphones comes into play as it is obvious that if the pace were too quick the Sousaphones could not keep up with the marches at all. Very few conductors want to admit that the low brass is running the show. Large drums can also do the same sort of function at times.

  17. Re:No way to see! by cammoblammo · · Score: 2

    Now that I think about it, I don't think I've ever sung in a choir in which the conductor uses a baton. It's standard in bands, but it doesn't seem to be so much in choral work, at least in my circles.

    Now that I think about it more, the few times I've conducted choirs I don't think I've used a stick, even when one was available. It seems wrong putting an instrument in my hand when the musicians don't have one.

    --

    Cogito, ergo sig.

  18. Re:No way to see! by K.+S.+Kyosuke · · Score: 2

    ...or just make a special baton with a tiny accelerometer, wirelessly connected. Would make more sense than attempts at CV.

    --
    Ezekiel 23:20