DeepAI AI Chat
Log In Sign Up

Finding Dory in the Crowd: Detecting Social Interactions using Multi-Modal Mobile Sensing

by   Kleomenis Katevas, et al.

Remembering our day-to-day social interactions is challenging even if you aren't a blue memory challenged fish. The ability to automatically detect and remember these types of interactions is not only beneficial for individuals interested in their behavior in crowded situations, but also of interest to those who analyze crowd behavior. Currently, detecting social interactions is often performed using a variety of methods including ethnographic studies, computer vision techniques and manual annotation-based data analysis. However, mobile phones offer easier means for data collection that is easy to analyze and can preserve the user's privacy. In this work, we present a system for detecting stationary social interactions inside crowds, leveraging multi-modal mobile sensing data such as Bluetooth Smart (BLE), accelerometer and gyroscope. To inform the development of such system, we conducted a study with 24 participants, where we asked them to socialize with each other for 45 minutes. We built a machine learning system based on gradient-boosted trees that predicts both 1:1 and group interactions with 77.8 a 30.2 utilizing a community detection based method, we further detected the various group formation that exist within the crowd. Using mobile phone sensors already carried by the majority of people in a crowd makes our approach particularly well suited to real-life analysis of crowd behaviour and influence strategies.


page 1

page 2

page 3

page 4


EPDA: Enhancing Privacy-Preserving Data Authentication for Mobile Crowd Sensing

As a popular application, mobile crowd sensing systems aim at providing ...

BLEBeacon: A Real-Subject Trial Dataset from Mobile Bluetooth Low Energy Beacons

The BLEBeacon dataset is a collection of Bluetooth Low Energy (BLE) adve...

SIMMC: Situated Interactive Multi-Modal Conversational Data Collection And Evaluation Platform

As digital virtual assistants become ubiquitous, it becomes increasingly...

Trust Evaluation Mechanism for User Recruitment in Mobile Crowd-Sensing in the Internet of Things

Mobile Crowd-Sensing (MCS) has appeared as a prospective solution for la...

Analyzing the Affect of a Group of People Using Multi-modal Framework

Millions of images on the web enable us to explore images from social ev...

Understanding Crowd Behaviors in a Social Event by Passive WiFi Sensing and Data Mining

Understanding crowd behaviors in a large social event is crucial for eve...

Predicting Behavior in Cancer-Afflicted Patient and Spouse Interactions using Speech and Language

Cancer impacts the quality of life of those diagnosed as well as their s...