The MATRIX is a new musical instrument that gives users a 3-dimensional tactile interface to control music using their hands. It can be used as either a stand alone instrument or in conjunction with a traditional musical keyboard or microphone. The MATRIX generates musical output by mapping a performer's expressive gestures to a variety of sonic parameters. It acts as an input device that directly manipulates the parameters of a synthesis engine (eg. additive, granular, wave-terrain...), or an effect alogrithm (eg. delay, reverb, filter-banks...) in response to the changing shape of the interactive surface. In this way, the MATRIX provides a very intuitive method of manipulating sound with an amount of control that has never before been implemented in real-time.
One mapping uses the individual rods of the MATRIX to directly control the digital waveform of a sound, thereby "sonically sculpting" the timbre of the sound. An example of this technique is shown below in the excerpt from one of my compositions titled Dactylonomy. It is a duet for MIDI keyboard and MATRIX, and utilizes a custom synthesis technique that is actually a cross between Wave-terrain and Scanned synthesis (see "New Musical Mappings for the MATRIX" for more information). The video shows the last 1:30 of the piece, which premiered August 17th, 2002 at the Woodstockhausen Electronic Music Festival in Santa Cruz, California.
Below are some video clips of the MATRIX performing granular synthesis:
Here are the same videos in Windows Media format (1-3MB):
Publications
Control of Signal Processing Algorithms using the MATRIX Interface
Proceedings of the 114th Audio Engineering Society Convention '03 (Amsterdam, The Netherlands, March 22-25, 2003).
New Musical Mappings for the MATRIX Interface
Proceedings of the International Computer Music Conference '02 (Goteborg, Sweden, September 16-21, 2002).
The MATRIX: A New Musical Instrument for Interactive Performance
Proceedings of the International Computer Music Conference '01 (Havana, Cuba, September 17-22, 2001).
Multipurpose Array of Tactile Rods for Interactive eXpression
Conference Abstracts and Applications of SIGGRAPH '01 (Los Angeles, California, USA, August 12-17,
2001).
The MATRIX: A Novel Controller for Musical Expression
New Interfaces for Musical Expression Workshop at CHI '01 (Seattle, Washington, USA, April 1-2,
2001).
My Master's Thesis (26MB PDF)
from MIT describes the design and development of the MATRIX interface.