A Data Driven End-to-end Approach for In-the-wild Monitoring of Eating Behavior Using Smartwatches

10/12/2020
by   Konstantinos Kyritsis, et al.
0

The increased worldwide prevalence of obesity has sparked the interest of the scientific community towards tools that objectively and automatically monitor eating behavior. Despite the study of obesity being in the spotlight, such tools can also be used to study eating disorders (e.g. anorexia nervosa) or provide a personalized monitoring platform for patients or athletes. This paper presents a complete framework towards the automated i) modeling of in-meal eating behavior and ii) temporal localization of meals, from raw inertial data collected in-the-wild using commercially available smartwatches. Initially, we present an end-to-end Neural Network which detects food intake events (i.e. bites). The proposed network uses both convolutional and recurrent layers that are trained simultaneously. Subsequently, we show how the distribution of the detected bites throughout the day can be used to estimate the start and end points of meals, using signal processing algorithms. We perform extensive evaluation on each framework part individually. Leave-one-subject-out (LOSO) evaluation shows that our bite detection approach outperforms four state-of-the-art algorithms towards the detection of bites during the course of a meal (0.923 F1 score). Furthermore, LOSO and held-out set experiments regarding the estimation of meal start/end points reveal that the proposed approach outperforms a relevant approach found in the literature (Jaccard Index of 0.820 and 0.821 for the LOSO and heldout experiments, respectively). Experiments are performed using our publicly available FIC and the newly introduced FreeFIC datasets.

READ FULL TEXT

page 1

page 4

page 6

research
05/27/2017

Deep Matching and Validation Network -- An End-to-End Solution to Constrained Image Splicing Localization and Detection

Image splicing is a very common image manipulation technique that is som...
research
05/31/2020

End-to-End Change Detection for High Resolution Drone Images with GAN Architecture

Monitoring large areas is presently feasible with high resolution drone ...
research
04/23/2019

End-to-end Sleep Staging with Raw Single Channel EEG using Deep Residual ConvNets

Humans approximately spend a third of their life sleeping, which makes m...
research
10/30/2016

Compressed Learning: A Deep Neural Network Approach

Compressed Learning (CL) is a joint signal processing and machine learni...
research
07/29/2019

Neural Mention Detection

Mention detection is an important aspect of the annotation task and inte...
research
05/06/2020

Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning

Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that...

Please sign up or login with your details

Forgot password? Click here to reset