Slashdot Mirror


Your Computer As Your Singing Coach

Roland Piquepaille writes "Israeli researchers have developed an electronic ear to coach vibrato technique. Until now, the quality of a vibrato — the pulsating change of pitch in a singer's voice — could only be judged by voice experts. Now, a Tel Aviv University research team 'has successfully managed to train a computer to rate vibrato quality, and has created an application based on biofeedback to help singers improve their technique.' Interestingly, this research could be used for other applications, such as improving automated help centers, where computers could be trained 'to recognize a range of different emotions, such as anger and nervousness.'"

21 of 127 comments (clear)

  1. Automated help centers? by DigitAl56K · · Score: 4, Insightful

    Interestingly, this research could be used for other applications, such as improving automated help centers, where computers could be trained 'to recognize a range of different emotions, such as anger and nervousness.

    This task should be quite easy. Frustration and anger are the only two emotions I tend to experience when I get through to an automated help center. It would be a better investment of time to evaluate how long I spend interfacing with the system, how many times I have to re-navigate the menu hierarchy, how many times I have to call back and start over, how many actual people I end up being directed to, how many times I have to restate the same information and how long I spend talking to someone before I solve my problem, if I ever do. .. but I'm not bitter..

  2. new? by JazzyMusicMan · · Score: 2, Interesting

    How is this technology new? I remember hearing many many years ago that they had developed gadgets that you could attach to your phone that could more or less sense if a person was nervous or not and could even function as a lie detector. These devices were probably pretty primitive, and their claims of being able to be used to spot when someone was lying to you were probably a little over the top, however, this technology doesn't strike me as new.

  3. Even easier by Serenissima · · Score: 2, Insightful

    They could also just listen for:
    "Goddamnit!"
    "You piece of shit!"
    or the always indicative "FUCK!"

    Just by checking for those 3 phrases, they should be able to ID an angry caller with at least a 99% positive rate.

    --
    Give a man a fire and he'll be warm for a day. But light a man on fire and he'll be warm for the rest of his life.
  4. cheaters! by ILuvRamen · · Score: 2, Insightful

    I've said it once, I'll say it again...vibrato is just cheating when you can't sing the actual pitch. Seriously, just pick a note and sing it. What's so wrong about that?

    --
    Google's Super Secret Search Algorithm: SELECT @search_results FROM internet WHERE @search_results = 'good'
    1. Re:cheaters! by Tirno · · Score: 2, Interesting

      Well, as a cellist, I can say that vibrato definitely has pleasing effect on the ear, and allows for extra expressiveness (through varying types of vibrato, fast/slow, wide/narrow, etc.). And you can't fake intonation, vibrato or not. Of course, I'm no expert in vocal music, but I would think the idea is similar.

    2. Re:cheaters! by st33med · · Score: 2, Insightful

      Want bad vibrato and notes? Listen to any American Idol entry. Instant ear bleed. In a bad way.

    3. Re:cheaters! by mrbluze · · Score: 2, Interesting

      Seriously, just pick a note and sing it. What's so wrong about that?

      Many a good choir is ruined by people who sing vibrato. Once a singer learns it, their voice is rarely if ever 'natural' again and many great (usually early) choral works cannot be sung properly.

      --
      Do it yourself, because no one else will do it yourself. [beta blockade 10-17 Feb]
    4. Re:cheaters! by Anonymous Coward · · Score: 2, Interesting

      Many choir directors have a certain conception of good choral singing. This often includes straight toning (singing without vibrato), unnatural vowel modifications to reduce 'brightness', and a number of other things which are foreign to trained singers. More than anything else, these methods are designed to compensate for poor individual voices. If you listen to the early work of the Robert Shaw chorale, particularly his collaborations with Toscanini, it is clear that his choir consists of professional voices singing with a full and truly magnificent vibrant sound, and that the individual singers have vibrato. They also have full and balanced sounds unlike many choirs which by applying the aforementioned choral techniques have an imbalanced sound with insufficient higher-frequency harmonics (in the 2,800 - 4,500 Hz range).

      Many choral directors and choristers in these sorts of choirs make the further mistake of believing that the singing technique that they are using for their choral singing is appropriate for good solo singing. Many young voices have been damaged by following through on this disastrous line of thinking.

      I would also question your use of 'natural', as though this is the ideal. 'Naturally', most tenors for example cannot sing higher than about F#4 and the range between about C#4 and F#4 is marked by a 'shouty' quality that is wholly inconsistent with the rest of the voice. To sing the literature, which regularly goes above F#4, they generally have to resort to the 'unnatural' practice of training and proper vocal technique.

  5. Re:Machine vs. Human by OctavianMH · · Score: 2, Informative

    how pleasant someone's singing voice is, is a completely subjective thing that can only really be properly judged by other human beings.

    They said nothing about the pleasantness of the singing voice. The system judges the quality of the vibrato.

    While I believe the above was referring to "quality" in a scientific sense rather than how "good" or "bad" it was, the whole hypothesis of one's "vibrato" having all that much to do with whether one is a good singer or not is hogwash. There are many uses of vibrato from virtually none (listen to a good singer perform Handel) to a ton (listen to a different good singer perform Wagner), where the amount of vibrato in a given style changes over the course of a phrase...etc.

    In the end, all this algorithm can probably do is determine how well a singer can constrain their voice into a certain vibrating range, having much more to do with muscular control than technique.

    --
    "In the end, we all fall back on fiction." -- Lonely Planet
  6. Re:Machine vs. Human by omeomi · · Score: 2, Informative

    OK Mr. Literal. But what they're working towards being able to quantify with a machine, is someone's singing voice.

    I'm not sure that's necessarily true. The summary says they're using "biofeedback to help singers improve their technique". Based on that, it would seem they're more interested in it as an educational tool rather than a tool for critics. There are a number of other technologies to help musicians improve their technique, so it's not like this is the first. For instance, many wind musicians will practice playing long tones with a digital tuner to improve their overall intonation. There are also systems that schools use that track the notes that you've played, compare them with the notes you were supposed to have played, and tell you what you've done wrong.

  7. Truly impressive by javaman235 · · Score: 4, Interesting

    ...every programmer should work with something like this at least once. I did some audio programming work in college, and its a totally different world than the regular web dev stuff I have done, because you're working with the convergence of acoustics and physics with programming. In true signal processing apps, what you are doing has to happen FAST as well, which makes the guys who work in it true wizards, and that's without even considering the subjective recognition stuff that these researchers had to do. Kudos to them.

    --
    -The art of programming is the pursuit of absolute simplicity.
    1. Re:Truly impressive by jonaskoelker · · Score: 2, Interesting

      every programmer should work with something like this at least once

      Agreed. My pet project of this sort is a wiimote hack, whereby you can play music with the wiimote. And no, it isn't just playing loops, it's indicating a tone with the angle of the wiimote (and nunchuck).

      So, it's really simple, right?
      - You steal the code that gives you the vertical angle of the wiimote from wmgui,
      - quantize it to [-12, 12],
      - raises the twelfth root of two to that power (or do a lookup into a temperament table),
      - multiply it onto the base frequency (say, 441 Hz),
      - generate a wave of that frequency,
      - copy it to the sound card (or the wiimote speaker, if your library supports it).

      Right.

      + Now add two more tones generated similarly; how do you mix them without sounding like shit?
      + Also, when making a wave, you want to start at the last seen elongation to avoid clicky noises.
      + When stopping a wave, you want to cheat and continue the wave with constant frequency until the elongation hits zero, again to avoid clicky noises.
      + And this is assuming that the transfer delay from the wiimote to your code (and from there to the sound card) is essentially zero. Now make some good use of the timestamp value on wiimote events; say, having a fixed small delay on everything.
      + Oh, and minimize battery usage please ;)

      It's an interesting project, to say the least. So far I've learned that I know and remember the necessary bits of physics and music theory; I haven't the faintest clue about the psychology of auditory perception and what would be a reasonable delay, but I can use myself as a test subject.

      I'd recommend doing something like this to everyone who has a wiimote and a bluetooth interface on their box. And if you don't have a wii, buy a wiimote anyways: it's great fun playing tetris, kobo deluxe, mu-cade and other arcade'ish games with a game controller. Especially on the university's big projector screens. Instead of studying.

  8. Singing Couch by slashhax0r · · Score: 2, Funny

    Yep. It's time for bed. I read "Your computer as your singing couch"

    good night folks.

    1. Re:Singing Couch by FooAtWFU · · Score: 2, Funny

      I'm sorry you have to sleep on the couch! Especially if it sings. Though maybe if it's a lullaby it's not so bad....

      --
      The World Wide Web is dying. Soon, we shall have only the Internet.
  9. Re:Machine vs. Human by Anonymous Coward · · Score: 5, Informative

    I have to say, you're stepping into a high-expertise field armed with a perilous lack of technical knowledge.

    There are already numerous types of acoustical analysis and biofeedback in use in many places for the training of elite vocalists - by that I mean high-level classical singers. These include spectography which can be used to examine tonal balance factors, legato, vowel differentiation and modification, and so on; the electro-glottal graph which is a device that measures vocal fold closure and displays the individual cycles which can be used to evaluate pressed vs. breathy phonation; a device which measures the relative expansion and contraction of the chest and abdomen during breathing and singing and graphs them.

    Contrary to your assertion, vibrato is a very important pedagogical tool. Vibrato rates that are too rapid (above 7.5 cycles per second or so), too slow (below 4 cycles), or too wide all indicate specific types of technical deficiency.

    Vibrato is an important element of vocal technique as well, because the achievement of consistently vibrant sound through the range, and through different vowels, is an important goal in the training of singers. Vibrato is generally not related to muscle control factors except largely to the extent that through muscle tension or 'holding' the presence of vibrato can be reduced or eliminated. This is called "straight toning."

    A tool that can help to measure quantitative vibrato factors: rate, consistency, pitch excursion, changes in dynamic, etc., could be very helpful in the training of singers. These are all subject to acoustical analysis and there's no reason to think that this machine wouldn't be able to do it.

    As a matter of style, for both historical reasons and modern aesthetic reasons, I believe Handel should be sung with a fully vibrant sound. The tenor for whom Handel wrote Messiah and many of his other works was a full dramatic tenor whose large voice bore little resemblance to the light, lyric tenors who generally perform that music today for reasons of "historical accuracy."

    I also find it somewhat odd that Shakira is held up as a model for good vibrato. She has a bleating vibrato which varies not only in pitch but in dynamic as well, which in another singer would be considered a serious technical deficiency.

  10. Re:Machine vs. Human by atraintocry · · Score: 2, Funny

    I also find it somewhat odd that Shakira is held up as a model for good vibrato. She has a bleating vibrato which varies not only in pitch but in dynamic as well, which in another singer would be considered a serious technical deficiency.

    It's not odd when you consider that most people can't tell when Auto-Tune has been used on a track.

  11. Vocal vibrato? Where's my earplugs? by Geak · · Score: 2, Insightful

    It should be programmed to give a poor score for using a vibrato. I don't know about you but I can't stand it when I go to a ball game and have to tolerate a 40 minute version of the national anthem because the singer vibratos every line of the song for a full minute.

    eg: "The land of the FRE-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E............."

    Personally I consider it a mockery of the anthem.

  12. Re:Machine vs. Human by dodecalogue · · Score: 2, Interesting

    I haven't RTFA (never do) but it would be interesting if the biofeedback somehow encouraged you in directions that you felt pleased with. That's the general kind of trajectory I think of when I think of "feedback", so it would make sense in that regards. I'm not sure how that would work, maybe encouraging you when you felt good about your results.

    I just don't understand these singing competitions, their appraisals seem totally random. I've sang in a bunch of choirs and worked on the open vowels and proper articulation, but I prefer the Lou Reed/Leonard Cohen school of singing.

  13. Re:Vocal vibrato? Where's my earplugs? by kohai_ut · · Score: 2, Informative

    Actually, singing without vibrato is a singing style just as much as singing with vibrato. "Mixed" singing uses both, classical uses all vibrato, and a Capella uses almost none. Your statement indicates you prefer "mix" as a singing style.

  14. As a professional tenor by Pheidias · · Score: 3, Informative

    Here's what I know, and forgive me if any of this seems rudimentary, but I think vibrato (like singing generally) is not well understood by most people:

    Vibrato is a cyclic departure from and return to a pitch. When a cellist holds a note and wobbles her left hand without starting a new note, or when B.B. King does the same, that is vibrato. It is heard as a "throb" in the voice, especially in those voices where it coincides with a cycling of intensity as well. This pulsing quality is something that musical instruments can rarely capture.

    Some things vibrato is not:
    -Tremolo: the repetition of a note, usually rapid, despite the misuse of the term in electric guitar circles to mean pitch-bending equipment.
    -Glissando: a change in pitch moving in one direction, like a slide whistle or a pianist running a finger across the keys.
    -Trill: the rapid alternation of two distinct notes, though in some voices this can sound a lot like vibrato
    -Melisma: in vocal music, the inclusion of many notes on one vowel -- think Mariah Carey

    In singing, most or all of the excursion of a person's vibrato is below the note being held. The graph of a person's vibrato would rarely look like a perfect sine wave, but usually would have an element of saw wave mixed in. That is, during the 1/6th of a second of an average vibrato cycle, the pitch might drop fairly quickly to the bottom of the range of excursion (let's say 1/3 of a whole tone) and take the rest of that time to climb back to the "correct" pitch, and perhaps go sharp by a few cents briefly.

    The rate, shape, dynamics and excursion of a singer's vibrato is something that a well-trained singer can tell with some accuracy after a few seconds of listening. "Eight beats per second, rather smooth, consistent dynamic, and shallow," for example. It is a an objective evaluation, and I'm not surprised a machine can do it too.

    But it is terribly difficult to change one's natural vibrato. It takes months of practice and guidance for the typical voice student with a poor vibrato to improve it. Knowing that the end result (the voice) comes from a combination of physiology, psychology, and technique that involves muscles from the face to the feet, I don't see how this type of feedback will help them fix it.

    Assuming, of course, that it needs fixing. The ideal of a moderate and inoffensive vibrato, while present in many successful singers' voices and most opera singers' voices, is also conspicuously absent from the voices of many well-loved singers and entertainers.

    --
    811.29.3.2
  15. Re:Machine vs. Human by 192939495969798999 · · Score: 2, Funny

    Yeah, but Shakira makes up in lack of singing talent with huge... tracts of land.

    --
    stuff |