"Pi" is an interactive audio/visual installation commissioned by Trash City of the Glastonbury Festival to be shown at the festival in June 2008.
Working with arts and technology collective Seeper, our concept was to take a 50ft tent, and convert it into a giant audio/visual instrument - all of the music, audio and visuals inside the tent are generated and controlled purely by the movements of the occupants.
The space was divided into 6 zones. Two of the zones were purely visual, this was the waiting area. Here people could dance, chill, run about and do what they pleased. Two cameras tracked their movement and applied it to the fluid/particles visuals - so people could 'throw' plasma balls at each other, or send colorful waves propagating around the space. The other 4 zones had the same visual interactions, but in addition were also connected to an audio system. Each of these four zones was allocated an instrument type (drums/beats/percussion, pads, bass, strings etc.), and movement within these zones would also trigger notes or beats - depending on precisely where in the zone the movement was triggered. A lot of effort went into designing the sounds and notes triggered to make sure the end result would almost always sound pleasant and not be complete cacophony.
The first psychedelic fluid/particles interaction prototype developed in processing.org:
Camera -> osc/midi interaction tests (developed in Quartz Composer):
The two concepts strung together and written in C++ with openFrameworks:
This is a little teaser for an audio visual interactive installation I'm working on for Glastonbury 2008. It'll be projected around the entire (almost) 65ft interior of a 50ft round tent with multiple channels of audio. Everyone inside will be contributing to the audio/visual experience. Located behind the Laundrettas' crashed plane / laundrette in Trash City, more info at the official site pi.seeper.com
This is the beginnings of a Processing / Java port of the webcam-to-osc/midi app I originally did in Quartz Composer. The source code for the processing version is below, and you can watch (or download) the Quartz Composer version here).
Its quite early days yet and doesn't have all the features I want (scales, realtime sizing of grid etc.), but I'm posting posting it because:
a.) it does work on a basic level,
b.) It was requested on the processing forums and I thought it might be useful...
It doesn't transmit midi, but does transmit OSC, and I'm using OSCulator to forward the OSC messages to midi. I prefer doing it this way because I can have another computer on wifi receive the OSC messages and map to midi (and send to Logic), keeping the CPU on both machines lighter... (or just keep the oscTargetIP as 127.0.0.1 to send the OSC to the same machine and have everything running on one machine. Flexibility is always sweet).
I just returned from a fantastic week in Aldeburgh courtesy of Aldeburgh Music on the New Music New Media 2008 Workshop, and what a week it was...
Working with 14 amazing contemporary musicians - 6 composers and 8 performers, including cellist Olly Coates and pianist Sarah Nicolls - masters of sound-tech Sound Intermedia; and fellow visualists / interactive tech-geeks at Flat-E we delved into some nice Exploration of Audio Visual Diversity.
This is a demonstration of the different signal modes I added to the Mac OSX Wiimote midi driver - WiiToMidi.
None of the demonstrated signals use the IR sensor so the user has complete freedom of movement (can swing in 360s), stand pretty faraway from any received, computer etc. - and the Nunchuk also has the same position, velocity, orientation etc.
WiiToMidi (wii2midi) is an open-source Mac OSX driver to convert Wiimote and Nunchuk (Niintendo Wii motion based controllers) data to midi. Its a Cocoa application based on the DarwiinRemote WiiRemote framework. Mike Verdone wrote the main app transmitting the values and button presses as midi. I added the modules to calculate and transmit an additional 16 midi cc messages. These are for calculating/transmitting the velocity, position offset and orientation for both the wiimote and nunchuk.