Graphic score sonification is the process of translating a graphic score into sound. This can be done by assigning different sounds to different symbols or shapes in the score, or by using a computer program to generate sound based on the visual elements of the score.
Graphic score sonification can be used to create a variety of musical effects. For example, it can be used to create a more abstract or experimental soundscape, or it can be used to create a more literal or realistic representation of the music in the score.
Graphic score sonification is a relatively new field, but it is growing in popularity. It is used by composers, musicians, and artists to create new and innovative forms of music.
Benefits of graphic score sonification:
It can create new and innovative forms of music.
It can be used to represent a wide range of musical concepts.
It can be used to create a more abstract or experimental soundscape.
It can be used to create a more literal or realistic representation of the music in the score.
Challenges of graphic score sonification:
It can be difficult to translate the visual elements of a score into sound.
It can be difficult to create a sonification that accurately reflects the music in the score.
It can be difficult to create a sonification that is both musically interesting and sonically pleasing.
Despite the challenges, graphic score sonification is a promising field with the potential to create new and innovative forms of music.
INSTALLATION DESCRIPTION
if (find == color) makesound
Graphic score sound system, application for tracking shapes and colors and their translation into electronic analog sound parameters. Complete system for studying the synesthesia of shapes and colors with sound.
Installation exposed @ IOMO Galery
Built around a Raspberry PI3 (1) linux mini computer in C ++ using the openFrameworks platform, the application scans the graphic scores, filters them by color and then sonicates the graphic shapes.
The installation presented in this exhibition can analyze graphic compositions in the palette of up to 16 colors, and for 4 electronic instruments simultaneously, the sonication being performed with an analog synthesizer Elektron Analogue 4 MK2 (2) amplified by two active studio monitors (3). Visualization of the color tracking and decoding process can be done on a monitor or projector (4).
HOW IT WORKS ?
The concept of sonication goes on the idea of a strip of paper, roll, which runs in one direction, and the graphic reading is done in a narrow area guided by CURENT PLAY CURSOR.
Graphic scores are loaded one by one into the system, RPI3 mini computer (Raspberry PI3B +), and played in real time. The graphic scores are composed for 4 electronic instruments distributed on 4 tracks TRACK 01-04.
The application filters the shapes by the 16 colors in the color band placed at the beginning of the graphic score. Each audio track is reserved for 4 colors, 4 x 4 = 16 colors per score.
Shape decoding is translated from pixels into pixels into MIDI (Musical Instrument Digital Interface) signals.
The process of matching colors / sound parameters is called Sound Mapping. From each color you can get several values that correspond to the synthetic sound parameters (Note Trigger, Velocity, Pitch, Panning, Filter, LFO, Delay and Reverb).
Flyer with QR codes links to sonification videos
Graphic Score Sonification – Flyers details
Graphic Score Sonification – Flyers details QR code
The installation, under the name if (find == color) makesound, was exhibited at the IOMO gallery, between 08.05-30.05.2021 Address: Băiculești 29, 013193, Bucharest
Are you interested in a printed version, or upscaled to a bigger format, or to see the catalog of other works? contact me or chat with my A.I. Assistent 🙂 (your requests will be processed soon or later).
