An Artistic Visualization of Music Modeling a Synesthetic Experience

12/15/2020
by   Matthew Joseph Adiletta, et al.
0

This project brings music to sight. Music can be a visual masterpiece. Some people naturally experience a visualization of audio - a condition called synesthesia. The type of synesthesia explored is when sounds create colors in the 'mind's eye.' Project included interviews with people who experience synesthesia, examination of prior art, and topic research to inform project design. Audio input, digital signal processing (including Fast Fourier Transforms (FFTs)) and data manipulation produce arguments required for our visualization. Arguments are then applied to a physics particle simulator which is re-purposed to model a synesthetic experience. The result of the project is a simulator in MAX 8, which generates a visual performance using particles by varying each particle's position, velocity, and color based on parameters extracted via digital processing of input audio.

READ FULL TEXT

page 4

page 6

11/06/2021

Digital Audio Processing Tools for Music Corpus Studies

Digital audio processing tools offer music researchers the opportunity t...
10/25/2018

Analyzing Visual Mappings of Traditional and Alternative Music Notation

In this paper, we postulate that combining the domains of information vi...
11/30/2017

Enabling Embodied Analogies in Intelligent Music Systems

The present methodology is aimed at cross-modal machine learning and use...
11/18/2021

DawDreamer: Bridging the Gap Between Digital Audio Workstations and Python Interfaces

Audio production techniques which previously only existed in GUI-constra...
05/16/2019

Multi Web Audio Sequencer: Collaborative Music Making

Recent advancements in web-based audio systems have enabled sufficiently...
09/21/2021

An Audio Synthesis Framework Derived from Industrial Process Control

Since its conception, digital synthesis has significantly influenced the...