Graphic score sonification

INSTALLATION DESCRIPTION

Graphic Score - Flyer with QR codes links to sonification videos
Graphic Score – Flyer with QR codes links to sonification videos

if (find == color) makesound

Installation exposed @ IOMO Galery
Installation exposed @ IOMO Galery

Graphic score sound system, application for tracking shapes and colors and their translation into electronic analog sound parameters. Complete system for studying the synesthesia of shapes and colors with sound.

Display vizual Instalație

Built around a Raspberry PI3 (1) linux mini computer in C ++ using the openFrameworks platform, the application scans the graphic scores, filters them by color and then sonicates the graphic shapes.

mini computer linux Raspberry PI3
mini computer linux Raspberry PI3

The installation presented in this exhibition can analyze graphic compositions in the palette of up to 16 colors, and for 4 electronic instruments simultaneously, the sonication being performed with an analog synthesizer Elektron Analogue 4 MK2 (2) amplified by two active studio monitors (3). Visualization of the color tracking and decoding process can be done on a monitor or projector (4).

Sonificare partituri grafice - Instalație
Componente Instalație Sonificare / Prototype

HOW IT WORKS ?

The concept of sonication goes on the idea of a strip of paper, roll, which runs in one direction, and the graphic reading is done in a narrow area guided by CURENT PLAY CURSOR.

Sonificare partituri grafice - Play buffer & Colors tracking
Play buffer & Colors tracking

Graphic scores are loaded one by one into the system, RPI3 mini computer (Raspberry PI3B +), and played in real time. The graphic scores are composed for 4 electronic instruments distributed on 4 tracks TRACK 01-04.

The application filters the shapes by the 16 colors in the color band placed at the beginning of the graphic score. Each audio track is reserved for 4 colors, 4 x 4 = 16 colors per score.

Sonificare partituri grafice - Sound Maping
Sound Mapping

Shape decoding is translated from pixels into pixels into MIDI (Musical Instrument Digital Interface) signals.

The process of matching colors / sound parameters is called Sound Mapping. From each color you can get several values that correspond to the synthetic sound parameters (Note Trigger, Velocity, Pitch, Panning, Filter, LFO, Delay and Reverb).

IOMO Gallery - Expunere Instalație Sonificare partituri grafice

The installation, under the name if (find == color) makesound, is exhibited at the IOMO gallery, between 08.05-30.05.2021
Address: Băiculești 29, 013193, Bucharest

IOMO Contemporary Art Gallery

Flyer with QR codes links to sonification videos
Flyer with QR codes links to sonification videos
Graphic Score Sonification - Flyers details
Graphic Score Sonification – Flyers details
Graphic Score Sonification - Flyers details QR code
Graphic Score Sonification – Flyers details QR code