DeepAI AI Chat
Log In Sign Up

Recognizing Detailed Human Context In-the-Wild from Smartphones and Smartwatches

by   Yonatan Vaizman, et al.
University of California, San Diego

The ability to automatically recognize a person's behavioral context can contribute to health monitoring, aging care and many other domains. Validating context recognition in-the-wild is crucial to promote practical applications that work in real-life settings. We collected over 300k minutes of sensor data with context labels from 60 subjects. Unlike previous studies, our subjects used their own personal phone, in any way that was convenient to them, and engaged in their routine in their natural environments. Unscripted behavior and unconstrained phone usage resulted in situations that are harder to recognize. We demonstrate how fusion of multi-modal sensors is important for resolving such cases. We present a baseline system, and encourage researchers to use our public dataset to compare methods and improve context recognition in-the-wild.


page 6

page 8

page 9

page 10

page 11


Learning behavioral context recognition with multi-stream temporal convolutional networks

Smart devices of everyday use (such as smartphones and wearables) are in...

iQIYI-VID: A Large Dataset for Multi-modal Person Identification

Person identification in the wild is very challenging due to great varia...

A Context Model for Personal Data Streams

We propose a model of the situational context of a person and show how i...

HHAR-net: Hierarchical Human Activity Recognition using Neural Networks

Activity recognition using built-in sensors in smart and wearable device...

A Framework For Identifying Group Behavior Of Wild Animals

Activity recognition and, more generally, behavior inference tasks are g...

Depression Diagnosis and Forecast based on Mobile Phone Sensor Data

Previous studies have shown the correlation between sensor data collecte...

Factors that affect Camera based Self-Monitoring of Vitals in the Wild

The reliability of the results of self monitoring of the vitals in the w...