This is the final project of my Undergraduate Degree in Informatica Musicale (Computer Science Applied to Music).

The idea is to enhance the modular synth shown at the Museo degli Strumenti Musicali di Milano, allowing people to play with it. Therefore, as in the original synth, the first part of the installation, based on Kinect, is about frequency generation, while the second part – Arduino + IR sensors – is about filtering the generated audio. I tried to define a specific format of installation that could be applied to different context. Talking about strenght and usability of the installation, the main focus was about defining ‘pointing’ or rather the area – on the original synthesizer – where the user is poiting with the arms. The major issues found are due to limits of the Kinect, solved with some algorithms (avg and wavg) and triggers (hysteresis).
Here’s a pic of the synthesizer. The second module has oscillators (white), and is where the first part of the installation takes place.
The last module has filters and is where the sensors should be placed to realize ‘virtual’ filters.

You can read the full disseration here