Gestural Instruments Demo
Demo of various digital musical instruments using movement and gesture (2024).
Including:
Joy controller - joystick, 4x buttons and microcontroller (arduino nano)
IMU-gloves - R-IoT (ircam, bitalino, BNO055) IMU
Orb (IMU-ball) - IMU attached to ball
Data-Glove - flex/bend sensors, touch-capacitive buttons, IMU
Modified Gametrak - wireless, motion-sensing (IMU), microcontroller, xyz tethers/strings, keypad.
0:00 - Joy
02:00 - IMU-Gloves (Piano)
03:36 - Orb
04:27 - Data-Glove
05:33 - Modified Gametrak
07:07 - Modified Gametrak - motion
Most instruments are wireless and sending data to Max via a wifi router. Max is interpreting the data and often sending it to Ableton.
DMI = Digital Musical Instruments
NIME = New Instruments for Musical Expression
IMU = Inertial Measurement Unit - accelerometer, gyroscope and magnetometer, used for sensing motion (pitch, roll, yaw)
Max = Max/MSP