Automated Dyadic Data Recorder (ADDR) Framework and Analysis of Facial Cues in Deceptive Communication

09/07/2017
by   Tayan Sen, et al.
0

We developed an online framework that can automatically pair two crowd-sourced participants, prompt them to follow a research protocol, and record their audio and video on a remote server. The framework comprises two web applications: an Automatic Quality Gatekeeper for ensuring only high quality crowd-sourced participants are recruited for the study, and a Session Controller which directs participants to play a research protocol, such as an interrogation game. This framework was used to run a research study for analyzing facial expressions during honest and deceptive communication using a novel interrogation protocol. The protocol gathers two sets of nonverbal facial cues in participants: features expressed during questions relating to the interrogation topic and features expressed during control questions. The framework and protocol were used to gather 151 dyadic conversations (1.3 million video frames). Interrogators who were lied to expressed the smile-related lip corner puller cue more often than interrogators who were being told the truth, suggesting that facial cues from interrogators may be useful in evaluating the honesty of witnesses in some contexts. Overall, these results demonstrate that this framework is capable of gathering high quality data which can identify statistically significant results in a communication study.

READ FULL TEXT

page 7

page 9

page 17

research
05/16/2020

Predicting Video features from EEG and Vice versa

In this paper we explore predicting facial or lip video features from el...
research
02/25/2022

Human Detection of Political Deepfakes across Transcripts, Audio, and Video

Recent advances in technology for hyper-realistic visual effects provoke...
research
08/29/2023

FurChat: An Embodied Conversational Agent using LLMs, Combining Open and Closed-Domain Dialogue with Facial Expressions

We demonstrate an embodied conversational agent that can function as a r...
research
04/03/2020

Generating Interactive WebSocket Applications in TypeScript

Advancements in mobile device computing power have made interactive web ...
research
10/31/2017

Sentiment Protocol: A Decentralized Protocol Leveraging Crowd Sourced Wisdom

The wisdom of the crowd is a valuable asset in today's society. It is no...
research
01/12/2020

An improvement of the upper bound for GKS communication game

The GKS game was formulated by Justin Gilmer, Michal Koucky, and Michael...
research
08/03/2023

Unmasking Parkinson's Disease with Smile: An AI-enabled Screening Framework

Parkinson's disease (PD) diagnosis remains challenging due to lacking a ...

Please sign up or login with your details

Forgot password? Click here to reset