Multi-Modal Data Fusion in Enhancing Human-Machine Interaction for Robotic Applications: A Survey

02/15/2022
by   Tauheed Khan Mohd, et al.
0

Human-machine interaction has been around for several decades now, with new applications emerging every day. One of the major goals that remain to be achieved is designing an interaction similar to how a human interacts with another human. Therefore, there is a need to develop interactive systems that could replicate a more realistic and easier human-machine interaction. On the other hand, developers and researchers need to be aware of state-of-the-art methodologies being used to achieve this goal. We present this survey to provide researchers with state-of-the-art data fusion technologies implemented using multiple inputs to accomplish a task in the robotic application domain. Moreover, the input data modalities are broadly classified into uni-modal and multi-modal systems and their application in myriad industries, including the health care industry, which contributes to the medical industry's future development. It will help the professionals to examine patients using different modalities. The multi-modal systems are differentiated by a combination of inputs used as a single input, e.g., gestures, voice, sensor, and haptic feedback. All these inputs may or may not be fused, which provides another classification of multi-modal systems. The survey concludes with a summary of technologies in use for multi-modal systems.

READ FULL TEXT

page 3

page 5

page 6

page 8

page 9

page 10

page 12

page 35

research
08/13/2019

MEx: Multi-modal Exercises Dataset for Human Activity Recognition

MEx: Multi-modal Exercises Dataset is a multi-sensor, multi-modal datase...
research
01/06/2022

Multi-modal data fusion of Voice and EMG data for Robotic Control

Wearable electronic equipment is constantly evolving and is increasing t...
research
08/26/2021

Network Module Detection from Multi-Modal Node Features with a Greedy Decision Forest for Actionable Explainable AI

Network-based algorithms are used in most domains of research and indust...
research
11/13/2017

A Supervised Learning Concept for Reducing User Interaction in Passenger Cars

In this article an automation system for human-machine-interfaces (HMI) ...
research
08/17/2023

A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation

Body language (BL) refers to the non-verbal communication expressed thro...
research
05/13/2020

Multi-modal Embedding Fusion-based Recommender

Recommendation systems have lately been popularized globally, with prima...
research
08/04/2019

Improving IT Support by Enhancing Incident Management Process with Multi-modal Analysis

IT support services industry is going through a major transformation wit...

Please sign up or login with your details

Forgot password? Click here to reset