Your Computer As Your Singing Coach
Roland Piquepaille writes "Israeli researchers have developed an electronic ear to coach vibrato technique. Until now, the quality of a vibrato — the pulsating change of pitch in a singer's voice — could only be judged by voice experts. Now, a Tel Aviv University research team 'has successfully managed to train a computer to rate vibrato quality, and has created an application based on biofeedback to help singers improve their technique.' Interestingly, this research could be used for other applications, such as improving automated help centers, where computers could be trained 'to recognize a range of different emotions, such as anger and nervousness.'"
Other related references come to mind. AI being used to predict hit numbers, maybe this: http://www.freepatentsonline.com/3432617.html and Wreck-A-Nice-Beach too....why is this story different?
Interestingly, this research could be used for other applications, such as improving automated help centers, where computers could be trained 'to recognize a range of different emotions, such as anger and nervousness.
This task should be quite easy. Frustration and anger are the only two emotions I tend to experience when I get through to an automated help center. It would be a better investment of time to evaluate how long I spend interfacing with the system, how many times I have to re-navigate the menu hierarchy, how many times I have to call back and start over, how many actual people I end up being directed to, how many times I have to restate the same information and how long I spend talking to someone before I solve my problem, if I ever do. .. but I'm not bitter..
This is all well and good, but when it comes right down to it, how pleasant someone's singing voice is, is a completely subjective thing that can only really be properly judged by other human beings. I say this as someone who has had formal vocal training, has performed publicly -- and as someone who is heading out the door in a few minutes to go to karaoke. ;-)
How is this technology new? I remember hearing many many years ago that they had developed gadgets that you could attach to your phone that could more or less sense if a person was nervous or not and could even function as a lie detector. These devices were probably pretty primitive, and their claims of being able to be used to spot when someone was lying to you were probably a little over the top, however, this technology doesn't strike me as new.
If you die from doing that, then why aren't you dead already, wanker? You do it all the time -- at least that's what your mom said to me last night!
They could also just listen for:
"Goddamnit!"
"You piece of shit!"
or the always indicative "FUCK!"
Just by checking for those 3 phrases, they should be able to ID an angry caller with at least a 99% positive rate.
Give a man a fire and he'll be warm for a day. But light a man on fire and he'll be warm for the rest of his life.
So now instead of pressing zero until I get a real person I can just start yelling into the phone.
I what you'll be saying to talk to an agent faster, once they implement this on phone support lines.
I may agree with what you say, but I will defend to the death your right to face the consequences of saying it.
I would be happy to judge a singer's vibrato technique for free, so long as she has never posted on Slashdot
I've said it once, I'll say it again...vibrato is just cheating when you can't sing the actual pitch. Seriously, just pick a note and sing it. What's so wrong about that?
Google's Super Secret Search Algorithm: SELECT @search_results FROM internet WHERE @search_results = 'good'
where computers could be trained 'to recognize a range of different emotions, such as anger and nervousness
Nothing new to see here, we been doing this on software for call centers for managers to help agents if people in the other side of the line starts to get angry or something.
Dunno why this is labeled as "new".
DON'T PANIC.
1. Gather a bunch of recordings of good and bad vibatos
2. Analyse their characteristics with a spectrograph to find what makes the good ones.
3. Make a simple program that analyses such characteristics using fairly basic techniques such as FM demodulation.
4. Wait for Roland to praise your work in his blog and cross your fingers that Slashdot will relay the 'news'.
5.
6. Profit?
No really, someone explain to me what's the big deal, that's something simple that could probably be done in analog electronics. Or is the 'OMG AWSM' part the fact that 'OMG it replaces human beings!!1'?
You just got troll'd!
...every programmer should work with something like this at least once. I did some audio programming work in college, and its a totally different world than the regular web dev stuff I have done, because you're working with the convergence of acoustics and physics with programming. In true signal processing apps, what you are doing has to happen FAST as well, which makes the guys who work in it true wizards, and that's without even considering the subjective recognition stuff that these researchers had to do. Kudos to them.
-The art of programming is the pursuit of absolute simplicity.
Could this technology, or a derivative, be used to help computer-generated speech technology?
I'm thinking something along the lines of a genetic algorithm that tweaks text-to-speech parameters and uses a technology like the one in the FA to determine the best output.
Cube On! (http://stores.ebay.com/PuzzleProz)
Yep. It's time for bed. I read "Your computer as your singing couch"
good night folks.
"... why is this story different?" Maybe it's not different.
Why is it that Roland Piquepaille stories always seem to include some place to send money? In this case the place is called the "American Friends of Tel Aviv University". Why only Americans? Why not Europeans, too, or anyone who has money?
Quote: "Your gift may help develop the computer science and engineering solutions that are the backbone of Israel's defense technology." As in 4 million Jews in Israel getting into gun battles with 1.3 billion Muslims?
If I think of ways that Jews can be peaceful, doesn't that make me more Jewish than those who think of ways to be violent? If I help Jews live in peace in the world, aren't I morally more a member of the Jewish tribe than those who think of ways for Jews to be adversarial? Even though I have no genetic, political, or religious connection to the Jewish culture, don't my caring ideas make me more truly Jewish than those who call themselves Jews, but whose minds are filled with violence?
Though a Peterson strobe tuner might have helped too. Certainly for anyone who is tone deaf.
This reminds me of the time (perhaps six years ago) that my friend got a great deal on airline tickets to Italy, so he and his wife and another friend decided to go on relatively short notice. My friend got a "Learn Italian in 10 days" cd, and would practice in his office.
The lady on the CD would say a phrase, and you were supposed to repeat it back, into the microphone, and it would grade you. My friend got phenomenal scores.
One day, I listened to what he was doing. The lady said, "La vostra madre è un criceto" (understand that I'm making this part up), and, in his best sing-song Italian stereotype voice, my friend said something outrageous like, "A bug just hit my windshield." All he would do is ape the intonation, and he'd get fabulous grades on it.
I think this qualifies for the strangest headline on /. yet.
I guess this will be used at the airports for anti-terror purposes. Ask the traveler some questions and measure the tremolo in the voice to figure out if he's nervous.
I've never been able to sing with any vibrato myself. Is it something that everybody can do with proper coaching, or does it require some innate ability that only certain individuals possess? Any links to relevant on-line information would be appreciated.
My dialup modem taught me to sing.
I'm going to need you all to GIIIIIVVVEE meeee... GIIIIIVVVEEE meee... one hundred and ten perCENNNNNTTTT!!!
>I what you'll be saying
This makes no sense.
Yet another high UID idiot on Slashdot.
It should be programmed to give a poor score for using a vibrato. I don't know about you but I can't stand it when I go to a ball game and have to tolerate a 40 minute version of the national anthem because the singer vibratos every line of the song for a full minute.
eg: "The land of the FRE-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E............."
Personally I consider it a mockery of the anthem.
break glass, that ain't a real vibrato
Hello,
I see that your customers are so disgusted with your new shiny version of your software that they are jumping ship and choosing competing products by the droves...
Would you like some help with:
1- Making changes to your software the users will hate?
2- Earning severe redirection by most web-masters?
3- Attracting the evil eye of BOFHs worldwide?
# ~: no sigs today
It should be programmed to give a poor score for using a vibrato. I don't know about you but I can't stand it when I go to a ball game and have to tolerate a 40 minute version of the national anthem because the singer vibratos every line of the song for a full minute.
eg: "The land of the FRE-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E-E............."
Personally I consider it a mockery of the anthem.
I agree. I think vibrato is like the special effects of singing. It can be impressive if used in moderation, but it should not be overused. And much like action movies, nowadays it's all car chases and explosions, instead of any real contents.
GAAH! MY PRINTER IS ON FIRE!!! PUT IT OUT! PUT IT OUT!
holodeck opera
Now if only singers used software to improve their intonation as well...
When practicing violin (just started two years ago) I use aptuner (www.aptuner.com) on a pc connected to a microphone to check on my intonation. Helps for vibrato to stay in place.
The only thing you need to get into a biofeedback loop is an immediate playback device that just spews back your singing phrase at you when you are finished.
Only when the solutions making use of the artist's ear as a detection device have been exhausted might it make sense to introduce an electronic referee.
Very few singers routinely work with record/playback devices. Which is just stupid.
"Interestingly, this research could be used for other applications, such as improving automated help centers, where computers could be trained 'to recognize a range of different emotions, such as anger and nervousness.'"
STFU with this bullshit. Just get someone to actually solve my problem. Don't spend cycles getting a robot to figure out my emotional state that you can't do anything about anyway.
We know where leadership by an anti-intellectual "strongman" who scapegoats minorities and likes boisterous rallies goes
Actually, singing without vibrato is a singing style just as much as singing with vibrato. "Mixed" singing uses both, classical uses all vibrato, and a Capella uses almost none. Your statement indicates you prefer "mix" as a singing style.
If you die from doing that, then why aren't you dead already, wanker? You do it all the time -- at least that's what your mom said to me last night!
You forgot to say, "..., Trebek!"
Here's what I know, and forgive me if any of this seems rudimentary, but I think vibrato (like singing generally) is not well understood by most people:
Vibrato is a cyclic departure from and return to a pitch. When a cellist holds a note and wobbles her left hand without starting a new note, or when B.B. King does the same, that is vibrato. It is heard as a "throb" in the voice, especially in those voices where it coincides with a cycling of intensity as well. This pulsing quality is something that musical instruments can rarely capture.
Some things vibrato is not:
-Tremolo: the repetition of a note, usually rapid, despite the misuse of the term in electric guitar circles to mean pitch-bending equipment.
-Glissando: a change in pitch moving in one direction, like a slide whistle or a pianist running a finger across the keys.
-Trill: the rapid alternation of two distinct notes, though in some voices this can sound a lot like vibrato
-Melisma: in vocal music, the inclusion of many notes on one vowel -- think Mariah Carey
In singing, most or all of the excursion of a person's vibrato is below the note being held. The graph of a person's vibrato would rarely look like a perfect sine wave, but usually would have an element of saw wave mixed in. That is, during the 1/6th of a second of an average vibrato cycle, the pitch might drop fairly quickly to the bottom of the range of excursion (let's say 1/3 of a whole tone) and take the rest of that time to climb back to the "correct" pitch, and perhaps go sharp by a few cents briefly.
The rate, shape, dynamics and excursion of a singer's vibrato is something that a well-trained singer can tell with some accuracy after a few seconds of listening. "Eight beats per second, rather smooth, consistent dynamic, and shallow," for example. It is a an objective evaluation, and I'm not surprised a machine can do it too.
But it is terribly difficult to change one's natural vibrato. It takes months of practice and guidance for the typical voice student with a poor vibrato to improve it. Knowing that the end result (the voice) comes from a combination of physiology, psychology, and technique that involves muscles from the face to the feet, I don't see how this type of feedback will help them fix it.
Assuming, of course, that it needs fixing. The ideal of a moderate and inoffensive vibrato, while present in many successful singers' voices and most opera singers' voices, is also conspicuously absent from the voices of many well-loved singers and entertainers.
811.29.3.2
It is was first developed by Soviets -- Israeli just stole it. Even this took two decade to build a semi "functional prototype".
Even veals have more autonomy!
If I think of ways that Jews can be peaceful, doesn't that make me more Jewish than those who think of ways to be violent? If I help Jews live in peace in the world, aren't I morally more a member of the Jewish tribe than those who think of ways for Jews to be adversarial? Even though I have no genetic, political, or religious connection to the Jewish culture, don't my caring ideas make me more truly Jewish than those who call themselves Jews, but whose minds are filled with violence?
The Jewish religion isn't some quack like Christianity. Other than converts, you are either born Jewish or you aren't. There's no "feeling Jewish" or any crap like that. You can't just wake up one day, throw yourself into a pond and say "I believe in God, therefore I am Jewish". We leave such crap to religions that have to gain membership through murder and torture.
Baf X of Hidden Agenda infamy taught me how to coach vibrato to female rock singers: punch them in the gut until they stop it.
Fortunately band politics removed the threat before I could test this method.
Tartini is OSS that has some similar functionality. I'd love to get it running, but when I tried, I failed. If anyone can give instructions that work for compiling it on Ubuntu Hardy Heron, I'd be very grateful. I emailed the author, and he tried to help me, but I was out of my depth with Qt, and gave up for lack of time. Below is what he told me about the problems I was experiencing.
Find free books.
I agree. And let's not forget the rock renditions/guitar solos of the anthem. Ugh, what a mess. Hendrix, Van Halen, I love you guys, but seriously I hate your little versions of the anthem. And you know what? Maybe part of it is that I just don't really care for the anthem's tune to begin with. Maybe the anthem isn't the best freakin' choice for solo riffing. You know?
See how your audience likes your 5-minute guitar solo version of the T-Mobile jingle. Lame, right? So stop it.
Imagine the looks you would get if you turned timeless church hymns into a 10-minute-long self-indulgent vibrato goat bleating extravaganza.
That's what it amounts to, I think. "Looka me I make wobbly voice with mah face!!1! I do tricks fer you!!"
OK I'm done.
-b
No offense, but I've stopped responding to AC's.
There's also a video version of the coach that can be used on any machine.
so, you are saying it's not a religion but simply a large family ?
MP3 Search Engine
This is wonderful news for someone who wants to sing, but I'm still waiting for those clever Israeli researchers to come up with a system capable of correctly predicting next week's winning lottery numbers. Such a system would cause many people to sing (though not very skillfully).
McCain/Palin '08. Now THAT's hope and change!
... But a lot of singers think it is. Vibrato is a change in volume.
+++OK ATH
I sent a link to this page to my Dad who is a classical singing teacher, his response follows:
Actually, vibrato is something one does not teach in singing, although some early music singers do deliberately avoid using it. It is something that just occurs when there is the right combination of tension and relaxation in the voice, and varies a lot from individual to individual. There are variations of pitch which are undesirable, like wobble and tremolo, which would not normally be described at vibrato. It may be these that the article is referring to.
I don't know why they pick on the voice, which is so complex and variable, for this regime. String players are actually taught to use vibrato, and it would be relatively easy to analyse both the mechanics and aesthetic function in eg. violin playing. This scientific technique seems to require somebody to say that vibrato is correct in one place, and not in another, but music isn't really like that. I'm sure the scientists will find opinionated people who are prepared to be dogmatic in this kind of way, sometimes one might agree, often not. But at the highest level, there is a flexibility of interpretation - artistry - where people have thoughts, feelings, ideas about the music and use different techniques, consciously or otherwise, to get these across. In so doing, they keep the music alive. The idea of only allowing one way of singing a phrase is a nightmare!
Vibrato is anyway only a tiny part of the available technical armoury. Its use can convey a sense of richness and fullness, and perhaps an elevated emotion, but that emotion could be love or hate, happiness, anger, fear. To be frank, if you have a computer as your singing coach instead of a human being, you are likely to end up sounding like a computer instead of a human being!
I don't suppose you wanted this response, but you can see you got me going!