Food and Paper: Sound Innovation Engine 1.0

This week's Food and Paper will be given by Bj?rn ?ór Jónsson

Bj?rn ?ór Jónsson - RITMO Food & Paper presentation

Bj?rn ?ór Jónsson - RITMO Food & Paper presentation

Abstract

The presentation focuses on the challenges faced by composers and sound designers when creating and refining new tools to achieve their musical goals. By utilising evolutionary processes, we aim to automate the search for sound discovery in unexplored sonic spaces. We argue that implementing diversity-promoting algorithms can bridge the gap between theoretical realisation and practical accessibility of sounds. In this presentation, we will describe a system for generative sound synthesis that combines Quality Diversity (QD) algorithms with a supervised discriminative model. Inspired by the Innovation Engine algorithm, our research explores different configurations of the generative system and examines the relationship between the chosen sound synthesis approach and the discriminative model. Our results demonstrate that a combination of Compositional Pattern Producing Network (CPPN) + Digital Signal Processing (DSP) graphs, paired with Multi-dimensional Archive of Phenotypic Elites (MAP-Elites) and a deep learning classifier, can produce a wide variety of synthetic sounds. To showcase our findings, we will present the generated sound objects through an online explorer and as rendered sound files. Additionally, we will discuss an experimental application in the context of music composition, demonstrating the creative potential of our discovered sounds.

Bio

Bj?rn is investigating ways to facilitate unbounded discovery of interesting sounds, to supply more sonic material than one can ask for. Curious to know if sounds discovered beyond the boundaries of prompting generative models, trained on existing data, can lead to creations that would otherwise not be conceived. Exploring the application of quality diversity algorithms as a foundation of a sound innovation engine. Looking into methods for the search and discovery of diverse patterns. Pondering how those patterns can be applied to the generation of sound and rhythm. Considering what modes of interaction with the sounds are well suited to open up possibilities for creative discoveries.

Published Jan. 30, 2024 1:45 PM - Last modified Mar. 20, 2024 2:42 PM