uBAM: Unsupervised Behavior Analysis and Magnification using Deep Learning

12/16/2020
by   Biagio Brattoli, et al.
7

Motor behavior analysis is essential to biomedical research and clinical diagnostics as it provides a non-invasive strategy for identifying motor impairment and its change caused by interventions. State-of-the-art instrumented movement analysis is time- and cost-intensive, since it requires placing physical or virtual markers. Besides the effort required for marking keypoints or annotations necessary for training or finetuning a detector, users need to know the interesting behavior beforehand to provide meaningful keypoints. We introduce uBAM, a novel, automatic deep learning algorithm for behavior analysis by discovering and magnifying deviations. We propose an unsupervised learning of posture and behavior representations that enable an objective behavior comparison across subjects. A generative model with novel disentanglement of appearance and behavior magnifies subtle behavior differences across subjects directly in a video without requiring a detour via keypoints or annotations. Evaluations on rodents and human patients with neurological diseases demonstrate the wide applicability of our approach.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 36

page 37

page 39

page 41

06/11/2021

Smart Textiles that Teach: Fabric-Based Haptic Device Improves the Rate of Motor Learning

People learn motor activities best when they are conscious of their erro...
02/02/2017

Eye-Movement behavior identification for AD diagnosis

In the present work, we develop a deep-learning approach for differentia...
07/18/2018

Multi-Task Unsupervised Contextual Learning for Behavioral Annotation

Unsupervised learning has been an attractive method for easily deriving ...
01/29/2019

Health Behavior Change in HCI: Trends, Patterns, and Opportunities

Unhealthy lifestyles could cause many chronic diseases, which bring pati...
03/08/2021

Behavior-Driven Synthesis of Human Dynamics

Generating and representing human behavior are of major importance for v...
09/20/2019

Target-Specific Action Classification for Automated Assessment of Human Motor Behavior from Video

Objective monitoring and assessment of human motor behavior can improve ...
02/19/2019

Personalized On-line Adaptation of Kinematic Synergies for Human-Prosthesis Interfaces

Synergies have been adopted in prosthetic limb applications to reduce co...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.