Not every kind of instrument is accessible to those who want to experience playing them. Some of the instruments are very expensive and not portable. We are building a virtual music instrument controlled solely by hand gestures so that people who are interested in playing multiple instruments that are not physically available. It allows everyone to play and compose with an instrument at a low cost and at any time they desire. In order to maximize our users’ experience, our instrument has
- A under 10ms delay from hand movement to sound production
- A >80% gesture and hand movement recognition accuracy
- A frequency production error between ±3.6Hz
Moreover, it also works in environments as dark as 25 lumens, fits in your backpack, weighs less than a typical laptop, and supports both Windows and macOS. Below is a general block diagram of our instrument:
