Log Complex Color for Visual Pattern Recognition of Total Sound

07/23/2019
by   Stephen Wedekind, et al.
0

While traditional audio visualization methods depict amplitude intensities vs. time, such as in a time-frequency spectrogram, and while some may use complex phase information to augment the amplitude representation, such as in a reassigned spectrogram, the phase data are not generally represented in their own right. By plotting amplitude intensity as brightness/saturation and phase-cycles as hue-variations, our complex spectrogram method displays both amplitude and phase information simultaneously, making such images canonical visual representations of the source wave. As a result, the original sound may be precisely reconstructed (down to the original phases) from an image, simply by reversing our process. This allows humans to apply our highly developed visual pattern recognition skills to complete audio data in new way.

READ FULL TEXT

page 2

page 3

page 4

page 5

research
03/16/2021

Graphic relation between amplitude and sound intensity level

We present a simple experiment that allows us to demonstrate graphically...
research
06/30/2023

The Human Auditory System and Audio

This work reviews the human auditory system, elucidating some of the spe...
research
11/12/2020

Combining visual contrast information with sound can produce faster decisions

Pierons and Chocholles seminal psychophysical work predicts that human r...
research
06/24/2020

Gamma Boltzmann Machine for Simultaneously Modeling Linear- and Log-amplitude Spectra

In audio applications, one of the most important representations of audi...
research
05/08/2021

Comparative analysis of the original and amplitude permutations

We compare the two basic ordinal patterns, i.e., the original and amplit...
research
09/04/2017

Phase retrieval from noisy data based on sparse approximation of object phase and amplitude

A variational approach to reconstruction of phase and amplitude of a com...
research
04/23/2018

The Future of Prosody: It's about Time

Prosody is usually defined in terms of the three distinct but interactin...

Please sign up or login with your details

Forgot password? Click here to reset