Behavioural pattern discovery from collections of egocentric photo-streams

08/21/2020
by   Martin Menchon, et al.
7

The automatic discovery of behaviour is of high importance when aiming to assess and improve the quality of life of people. Egocentric images offer a rich and objective description of the daily life of the camera wearer. This work proposes a new method to identify a person's patterns of behaviour from collected egocentric photo-streams. Our model characterizes time-frames based on the context (place, activities and environment objects) that define the images composition. Based on the similarity among the time-frames that describe the collected days for a user, we propose a new unsupervised greedy method to discover the behavioural pattern set based on a novel semantic clustering approach. Moreover, we present a new score metric to evaluate the performance of the proposed algorithm. We validate our method on 104 days and more than 100k images extracted from 7 users. Results show that behavioural patterns can be discovered to characterize the routine of individuals and consequently their lifestyle.

READ FULL TEXT

page 2

page 11

page 12

page 13

research
05/10/2019

Unsupervised routine discovery in egocentric photo-streams

The routine of a person is defined by the occurrence of activities throu...
research
09/16/2020

Eating Habits Discovery in Egocentric Photo-streams

Eating habits are learned throughout the early stages of our lives. Howe...
research
05/10/2019

Hierarchical approach to classify food scenes in egocentric photo-streams

Recent studies have shown that the environment where people eat can affe...
research
04/07/2017

Egocentric Video Description based on Temporally-Linked Sequences

Egocentric vision consists in acquiring images along the day from a firs...
research
05/10/2019

Towards Egocentric Person Re-identification and Social Pattern Analysis

Wearable cameras capture a first-person view of the daily activities of ...
research
09/10/2019

Lifelog Patterns Analyzation using Graph Embedding based on Deep Neural Network

Recently, as the spread of smart devices increases, the amount of data c...
research
08/12/2016

DeepDiary: Automatic Caption Generation for Lifelogging Image Streams

Lifelogging cameras capture everyday life from a first-person perspectiv...

Please sign up or login with your details

Forgot password? Click here to reset