A Network-based Multimodal Data Fusion Approach for Characterizing Dynamic Multimodal Physiological Patterns

01/03/2019
by   Miaolin Fan, et al.
0

Characterizing the dynamic interactive patterns of complex systems helps gain in-depth understanding of how components interrelate with each other while performing certain functions as a whole. In this study, we present a novel multimodal data fusion approach to construct a complex network, which models the interactions of biological subsystems in the human body under emotional states through physiological responses. Joint recurrence plot and temporal network metrics are employed to integrate the multimodal information at the signal level. A benchmark public dataset of is used for evaluating our model.

READ FULL TEXT
research
07/04/2020

Low Rank Fusion based Transformers for Multimodal Sequences

Our senses individually work in a coordinated fashion to express our emo...
research
02/02/2012

Global modeling of transcriptional responses in interaction networks

Motivation: Cell-biological processes are regulated through a complex ne...
research
03/14/2022

A Systematic Review on Affective Computing: Emotion Models, Databases, and Recent Advances

Affective computing plays a key role in human-computer interactions, ent...
research
11/18/2018

Facial Expression and Peripheral Physiology Fusion to Decode Individualized Affective Experience

In this paper, we present a multimodal approach to simultaneously analyz...
research
11/20/2019

The dynamics of the stomatognathic system from 4D multimodal data

The purpose of this chapter is to discuss methods of acquisition, visual...
research
03/20/2021

A novel multimodal fusion network based on a joint coding model for lane line segmentation

There has recently been growing interest in utilizing multimodal sensors...
research
12/10/2018

Machine learning approaches to understand the influence of urban environments on human's physiological response

This research proposes a framework for signal processing and information...

Please sign up or login with your details

Forgot password? Click here to reset