Contact - Felix Faire.
The installation uses contact microphones, passive sonar and waveform analysis to recognise information of touches. ie where a surface has been hit or how a hand has made contact with the wrist, fingers or the fingernails. The sound received from the contact microphones is digitally “resonated” to produce a melodic note from the original acoustic impulse. The wrist and fingernail hits trigger classic 808 Kick and Clap sounds instantaneously and the audio can be recorded and played back with a custom built loop pedal. The LEAP Motion controller was used to manipulate these sounds with various hand gestures that importantly avoid contact with the table. The projections were designed to visualise the impulses and vibrations generated from playing the Contact table, creating a live audio visual performance instrument.
Piezo sensors and Arduino are used to locate volume transients. Volumes between signals are compared and mapped to X&Y. The mics are connected to an audio interface to process detailed frequency information of surface vibrations in Ableton Live and Max/MSP. Finally the Max patch compares the signals, relative distance value and sends it to Processing via OSC to map to screen. In addition, there is a foot pedal connected to Processing via an Arduino uploaded with firmata.
See also the making of Contact: http://vimeo.com/82721023