Werewolf Among Us: A Multimodal Dataset for Modeling Persuasion Behaviors in Social Deduction Games

12/16/2022
by   Bolin Lai, et al.
3

Persuasion modeling is a key building block for conversational agents. Existing works in this direction are limited to analyzing textual dialogue corpus. We argue that visual signals also play an important role in understanding human persuasive behaviors. In this paper, we introduce the first multimodal dataset for modeling persuasion behaviors. Our dataset includes 199 dialogue transcriptions and videos captured in a multi-player social deduction game setting, 26,647 utterance level annotations of persuasion strategy, and game level annotations of deduction game outcomes. We provide extensive experiments to show how dialogue context and visual signals benefit persuasion strategy prediction. We also explore the generalization ability of language models for persuasion modeling and the role of persuasion strategies in predicting social deduction game outcomes. Our dataset, code, and models can be found at https://persuasion-deductiongame.socialai-data.org.

READ FULL TEXT

page 2

page 8

page 13

research
10/16/2021

On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark

Dialogue safety problems severely limit the real-world deployment of neu...
research
05/25/2023

Role-Play with Large Language Models

As dialogue agents become increasingly human-like in their performance, ...
research
12/10/2020

Look Before you Speak: Visually Contextualized Utterances

While most conversational AI systems focus on textual dialogue only, con...
research
11/23/2016

GuessWhat?! Visual object discovery through multi-modal dialogue

We introduce GuessWhat?!, a two-player guessing game as a testbed for re...
research
09/12/2018

Game-Based Video-Context Dialogue

Current dialogue systems focus more on textual and speech context knowle...
research
04/30/2022

Opponent Modeling in Negotiation Dialogues by Related Data Adaptation

Opponent modeling is the task of inferring another party's mental state ...
research
06/16/2023

Listener Model for the PhotoBook Referential Game with CLIPScores as Implicit Reference Chain

PhotoBook is a collaborative dialogue game where two players receive pri...

Please sign up or login with your details

Forgot password? Click here to reset