AI as mediator between composers, sound designers, and creative media producers

03/02/2023
by   Sebastian Löbbers, et al.
0

Musical professionals who produce material for non-musical stakeholders often face communication challenges in the early ideation stage. Expressing musical ideas can be difficult, especially when domain-specific vocabulary is lacking. This position paper proposes the use of artificial intelligence to facilitate communication between stakeholders and accelerate the consensus-building process. Rather than fully or partially automating the creative process, the aim is to give more time for creativity by reducing time spent on defining the expected outcome. To demonstrate this point, the paper discusses two application scenarios for interactive music systems that are based on the authors' research into gesture-to-sound mapping.

READ FULL TEXT

page 2

page 3

research
10/07/2020

Sonification of Facial Actions for Musical Expression

The central role of the face in social interaction and non-verbal commun...
research
02/18/2019

In a Silent Way: Communication Between AI and Improvising Musicians Beyond Sound

Collaboration is built on trust, and establishing trust with a creative ...
research
09/14/2018

Mugeetion: Musical Interface Using Facial Gesture and Emotion

People feel emotions when listening to music. However, emotions are not ...
research
06/17/2020

Artificial Musical Intelligence: A Survey

Computers have been used to analyze and create music since they were fir...
research
10/07/2020

Designing, Playing, and Performing with a Vision-based Mouth Interface

The role of the face and mouth in speech production as well asnon-verbal...
research
11/26/2020

Interactive Machine Learning of Musical Gesture

This chapter presents an overview of Interactive Machine Learning (IML) ...
research
10/19/2022

Modeling Animal Vocalizations through Synthesizers

Modeling real-world sound is a fundamental problem in the creative use o...

Please sign up or login with your details

Forgot password? Click here to reset