Toward Inverse Control of Physics-Based Sound Synthesis

06/29/2017
by   A. Pfalz, et al.
0

Long Short-Term Memory networks (LSTMs) can be trained to realize inverse control of physics-based sound synthesizers. Physics-based sound synthesizers simulate the laws of physics to produce output sound according to input gesture signals. When a user's gestures are measured in real time, she or he can use them to control physics-based sound synthesizers, thereby creating simulated virtual instruments. An intriguing question is how to program a computer to learn to play such physics-based models. This work demonstrates that LSTMs can be trained to accomplish this inverse control task with four physics-based sound synthesizers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/06/2020

Respiratory Sound Classification Using Long-Short Term Memory

Developing a reliable sound detection and recognition system offers many...
research
11/20/2018

Sound-Stream II: Towards Real-Time Gesture Controlled Articulatory Sound Synthesis

We present an interface involving four degrees-of-freedom (DOF) mechanic...
research
03/29/2023

Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos

Modeling sounds emitted from physical object interactions is critical fo...
research
11/11/2020

Sound Synthesis, Propagation, and Rendering: A Survey

Sound, as a crucial sensory channel, plays a vital role in improving the...
research
09/02/2022

In-Place Gestures Classification via Long-term Memory Augmented Network

In-place gesture-based virtual locomotion techniques enable users to con...
research
03/12/2021

Discovery of Physics and Characterization of Microstructure from Data with Bayesian Hidden Physics Models

There has been a surge in the interest of using machine learning techniq...
research
09/23/2021

Physics-Informed Neural Networks (PINNs) for Sound Field Predictions with Parameterized Sources and Impedance Boundaries

Realistic sound is essential in virtual environments, such as computer g...

Please sign up or login with your details

Forgot password? Click here to reset