This is an introduction to digital interfaces, with a focus on sculptural, spiritual, and experimental approaches to instrument design and interactive objects. This module was designed as part of the New Media + Sound Arts program at Emily Carr University. I try to update these materials each time I teach the course.
This modules uses low cost microcontrollers to sense the physical world, reading button presses, amount of light, temperature, touch, etc. The microcontroller maps these sensor inputs to processes and events on a computer using MIDI messages. It works in the other direction too — the computer can be used to send messages that affect things in the physical world as well, like lights, speakers, relays, and small motors.
This site is intended to be a thorough introduction to one way of connecting sensors and actuators to a computer. There are a number of protocols and platforms that do this — Arduino, Raspberry Pi, Teensy, Bela, and Daisy, just to name a few. I recommend starting with a Pro Micro development board for introductory explorations because they are relatively inexpensive (about $12-16 for the board) and can be configured as a class compliant midi devices, meaning that your computer will automatically recognize the board as a midi device. If you need more inputs, you can upgrade to a number of other boards that are faster and/or have more inputs and outputs.
Free Opinions: The Teensy boards are a bit more expensive and seem more complicated initially, but they are faster and more reliable than the Pro Micros. Teensy even makes an audio adapter that lets you run audio programs on the teensy for stand alone projects, no computer necessary!
That said , if you are doing complex embedded audio processes and audio latency matters for your project, I highly recommend taking a look at Bela — it’s a beautiful platform made specifically for sound.
MIDI (Musical Instrument Digital Interface) is a standard communication protocol created for connecting electronic musical instruments, but it is great for interactive video installations, live performances, and kinetic sculptures as well. MIDI messages can be mapped to a broad range of software — Max/MSP, Pure Data, Ableton Live, Reaper, Mad Mapper, Processing — any program with MIDI input and/or output.
Next we’ll look at the software you will need