The Animated Pianist That Plays Like a Person, Just By Listening Along

By Ashley P. Taylor | September 28, 2012 4:08 pm

When we listen to an mp3—or a CD track, a mix tape, a record, even a wax cylinder—we’re conjuring up the sound of a past performance. Now there’s a new computer program that does the reverse, sort of: It takes an audio file and creates a piano-playing cartoon, using sound (or related bits of information) to animate a performance anew.

The fingers of an expert pianist look relaxed as they tickle the ivories, never seeming overexerted or out of place. The computer program is designed to work on the same principle: It “listens to” a midi file and decides how the cartoon should finger each chord in order to put out the least possible effort. In addition to telling the active fingers which keys to press down, it also decides what to do with the idle fingers so that they are optimally relaxed and poised to play their next notes. Looking this at ease is a lot of work.

Right now, the program creates an animated character to accompany a disembodied music file, but the UC Davis computer scientists behind the program think that it could help real-world musicians become more relaxed and therefore, more virtuosic. Would-be piano stars could use a motion-capture camera to record their practice, then compare the data to the program’s ultra-relaxed formula for playing the same song to see whether their hands are in the best possible position. To play the piano better, the researchers suggest, it may help to chill out and watch some cartoons.

[via New Scientist]

CATEGORIZED UNDER: Technology Attacks!
NEW ON DISCOVER
OPEN
CITIZEN SCIENCE
ADVERTISEMENT

Discover's Newsletter

Sign up to get the latest science news delivered weekly right to your inbox!

Discoblog

Quirky, funny, and surprising science news from the edge of the known universe.
ADVERTISEMENT

See More

ADVERTISEMENT
Collapse bottom bar
+

Login to your Account

X
E-mail address:
Password:
Remember me
Forgot your password?
No problem. Click here to have it e-mailed to you.

Not Registered Yet?

Register now for FREE. Registration only takes a few minutes to complete. Register now »