Interactive Neural Resonators

05/24/2023
by   Rodrigo Díaz, et al.
0

In this work, we propose a method for the controllable synthesis of real-time contact sounds using neural resonators. Previous works have used physically inspired statistical methods and physical modelling for object materials and excitation signals. Our method incorporates differentiable second-order resonators and estimates their coefficients using a neural network that is conditioned on physical parameters. This allows for interactive dynamic control and the generation of novel sounds in an intuitive manner. We demonstrate the practical implementation of our method and explore its potential creative applications.

READ FULL TEXT
research
05/01/2022

COUCH: Towards Controllable Human-Chair Interactions

Humans interact with an object in many different ways by making contact ...
research
12/16/2021

Object-based synthesis of scraping and rolling sounds based on non-linear physical constraints

Sustained contact interactions like scraping and rolling produce a wide ...
research
07/03/2018

Deep Neural Object Analysis by Interactive Auditory Exploration with a Humanoid Robot

We present a novel approach for interactive auditory object analysis wit...
research
04/24/2018

Feedback Synthesis For Underactuated Systems Using Sequential Second-Order Needle Variations

This paper derives nonlinear feedback control synthesis for general cont...
research
06/28/2022

Expressive, Variable, and Controllable Duration Modelling in TTS

Duration modelling has become an important research problem once more wi...
research
08/11/2023

CaPhy: Capturing Physical Properties for Animatable Human Avatars

We present CaPhy, a novel method for reconstructing animatable human ava...
research
02/06/2015

Interactive 3D Face Stylization Using Sculptural Abstraction

Sculptors often deviate from geometric accuracy in order to enhance the ...

Please sign up or login with your details

Forgot password? Click here to reset