Conversation Group Detection With Spatio-Temporal Context

06/02/2022
by   Stephanie Tan, et al.
0

In this work, we propose an approach for detecting conversation groups in social scenarios like cocktail parties and networking events, from overhead camera recordings. We posit the detection of conversation groups as a learning problem that could benefit from leveraging the spatial context of the surroundings, and the inherent temporal context in interpersonal dynamics which is reflected in the temporal dynamics in human behavior signals, an aspect that has not been addressed in recent prior works. This motivates our approach which consists of a dynamic LSTM-based deep learning model that predicts continuous pairwise affinity values indicating how likely two people are in the same conversation group. These affinity values are also continuous in time, since relationships and group membership do not occur instantaneously, even though the ground truths of group membership are binary. Using the predicted affinity values, we apply a graph clustering method based on Dominant Set extraction to identify the conversation groups. We benchmark the proposed method against established methods on multiple social interaction datasets. Our results showed that the proposed method improves group detection performance in data that has more temporal granularity in conversation group labels. Additionally, we provide an analysis in the predicted affinity values in relation to the conversation group detection. Finally, we demonstrate the usability of the predicted affinity values in a forecasting framework to predict group membership for a given forecast horizon.

READ FULL TEXT

page 1

page 5

page 12

research
07/24/2019

DANTE: Deep Affinity Network for Clustering Conversational Interactants

We propose a data-driven approach to visually detect conversational grou...
research
11/17/2019

Detecting F-formations Roles in Crowded Social Scenes with Wearables: Combining Proxemics Dynamics using LSTMs

In this paper, we investigate the use of proxemics and dynamics for auto...
research
01/07/2022

Spatio-Temporal Graph Representation Learning for Fraudster Group Detection

Motivated by potential financial gain, companies may hire fraudster grou...
research
11/08/2021

GROWL: Group Detection With Link Prediction

Interaction group detection has been previously addressed with bottom-up...
research
12/18/2018

GD-GAN: Generative Adversarial Networks for Trajectory Prediction and Group Detection in Crowds

This paper presents a novel deep learning framework for human trajectory...
research
06/03/2017

Learning Person Trajectory Representations for Team Activity Analysis

Activity analysis in which multiple people interact across a large space...
research
08/23/2020

Let me join you! Real-time F-formation recognition by a socially aware robot

This paper presents a novel architecture to detect social groups in real...

Please sign up or login with your details

Forgot password? Click here to reset