Pose Theremin

Using real-time pose estimation to make music with our bodies

A person dancing with dots of their pose estimation Playing music with our body using a camera

Markerless pose estimation using deep neural networks performed in real-time and mapped to sounds using Bonsai. With just a webcam, moving one wrist up and down controls sound frequency (pitch) and the other wrist moving left and right to controls sound amplitude (volume).

Ceci Herbert
Ceci Herbert
Scientific Director

Related