Compositional nonlinear audio signal processing with Volterra series

08/14/2023
by   Jake Araujo-Simon, et al.
0

We develop a compositional theory of nonlinear audio signal processing based on a categorification of the Volterra series. We begin by considering what it would mean for the Volterra series to be functorial with respect to a base category whose objects are temperate distributions and whose morphisms are certain linear transformations. This leads to formulae describing how the outcomes of nonlinear transformations are affected if their input signals are first linearly processed. We then consider how nonlinear audio systems change, and introduce as a model thereof a notion of morphism of Volterra series, which we exhibit as a kind of lens map. We show how morphisms can be parameterized and used to generate indexed families of Volterra series, which are well-suited to model nonstationary or time-varying nonlinear phenomena. We then describe how Volterra series and their morphisms organize into a category, which we call Volt. We exhibit the operations of sum, product, and series composition of Volterra series as monoidal products on Volt and identify, for each in turn, its corresponding universal property. We show, in particular, that the series composition of Volterra series is associative. We then bridge between our framework and a subject at the heart of audio signal processing: time-frequency analysis. Specifically, we show that an equivalence between a certain class of second-order Volterra series and the bilinear time-frequency distributions (TFDs) can be extended to one between certain higher-order Volterra series and the so-called polynomial TFDs. We end with prospects for future work, including the incorporation of nonlinear system identification techniques and the extension of our theory to the settings of compositional graph and topological audio signal processing.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2021

Symplectic Transformations on Wigner Distributions and Time Frequency Signal Design

This work considers uncertainty relations on time frequency distribution...
research
11/03/2020

Quasi Monte Carlo Time-Frequency Analysis

We study signal processing tasks in which the signal is mapped via some ...
research
01/31/2019

End-to-End Probabilistic Inference for Nonstationary Audio Analysis

A typical audio signal processing pipeline includes multiple disjoint an...
research
11/17/2018

Designing nearly tight window for improving time-frequency masking

Many audio signal processing methods are formulated in the time-frequenc...
research
02/08/2020

A Time-Frequency Perspective on Audio Watermarking

Existing audio watermarking methods usually treat the host audio signals...
research
03/01/2017

The Signals and Systems Approach to Animation

Animation is ubiquitous in visualization systems, and a common technique...
research
04/15/2019

Subgeometrically ergodic autoregressions

In this paper we discuss how the notion of subgeometric ergodicity in Ma...

Please sign up or login with your details

Forgot password? Click here to reset