Facial gesture interfaces for expression and communication

10/04/2020
by   Michael J. Lyons, et al.
0

Considerable effort has been devoted to the automatic extraction of information about action of the face from image sequences. Within the context of human-computer interaction (HCI) we may distinguish systems that allow expression from those which aim at recognition. Most of the work in facial action processing has been directed at automatically recognizing affect from facial actions. By contrast, facial gesture interfaces, which respond to deliberate facial actions, have received comparatively little attention. This paper reviews several projects on vision-based interfaces that rely on facial action for intentional HCI. Applications to several domains are introduced, including text entry, artistic and musical expression and assistive technology for motor-impaired users.

READ FULL TEXT

page 2

page 4

page 5

03/09/2010

Facial Gesture Recognition Using Correlation And Mahalanobis Distance

Augmenting human computer interaction with automated analysis and synthe...
10/07/2020

Sonification of Facial Actions for Musical Expression

The central role of the face in social interaction and non-verbal commun...
10/04/2020

Input Devices for Musical Expression: Borrowing Tools from HCI

This paper reviews the existing literature on input device evaluation an...
09/19/2019

A High-Fidelity Open Embodied Avatar with Lip Syncing and Expression Capabilities

Embodied avatars as virtual agents have many applications and provide be...
09/23/2019

Deep Multi-Facial patches Aggregation Network for Expression Classification from Face Images

Emotional Intelligence in Human-Computer Interaction has attracted incre...
06/13/2016

Using Virtual Humans to Understand Real Ones

Human interactions are characterized by explicit as well as implicit cha...
10/07/2020

Designing, Playing, and Performing with a Vision-based Mouth Interface

The role of the face and mouth in speech production as well asnon-verbal...