Motion Tracking Gloves Make Music

13.07.2011
Musicians performing at a concert pull off some pretty eccentric dance routines especially their hands. This week at TEDGlobal 2011 in Edinburgh, the Grammy-award wining showed that musicial jazzy hands can also be used to conduct music from the air thanks to motion tracking glove technology.

A team from the University of West England led by Professor Tom Mitchell, a music technology specialist, built Heap's gloves. They were fitted with wireless microphones, an accelerometer, a magnetometer, a gyroscope and a variety of other sensors to track her body movements and hand gestures. With every motion Heap could call for sounds from a multitude of instruments and effects and create a song on the fly.

The sensors on the gloves send the movement data back to a computer that copulates and writes a piece of music in real time. If Heap spread her arms wide it would make the sound louder, bringing them closer would make it quieter quiet, or throwing would trigger a "rock out mode."

According to Mashable, the performance was since Heap became interested in the project after seeing a similar technology from MIT. Researchers want to bring even more enhancements to that the gloves can capture more gestures, play more instruments like the drums, and even bring the audience in to participate in the song creation.

[ and via ]