uBAM: Unsupervised Behavior Analysis and Magnification using Deep Learning

by   Biagio Brattoli, et al.

Motor behavior analysis is essential to biomedical research and clinical diagnostics as it provides a non-invasive strategy for identifying motor impairment and its change caused by interventions. State-of-the-art instrumented movement analysis is time- and cost-intensive, since it requires placing physical or virtual markers. Besides the effort required for marking keypoints or annotations necessary for training or finetuning a detector, users need to know the interesting behavior beforehand to provide meaningful keypoints. We introduce uBAM, a novel, automatic deep learning algorithm for behavior analysis by discovering and magnifying deviations. We propose an unsupervised learning of posture and behavior representations that enable an objective behavior comparison across subjects. A generative model with novel disentanglement of appearance and behavior magnifies subtle behavior differences across subjects directly in a video without requiring a detour via keypoints or annotations. Evaluations on rodents and human patients with neurological diseases demonstrate the wide applicability of our approach.



There are no comments yet.


page 36

page 37

page 39

page 41


Smart Textiles that Teach: Fabric-Based Haptic Device Improves the Rate of Motor Learning

People learn motor activities best when they are conscious of their erro...

Eye-Movement behavior identification for AD diagnosis

In the present work, we develop a deep-learning approach for differentia...

Multi-Task Unsupervised Contextual Learning for Behavioral Annotation

Unsupervised learning has been an attractive method for easily deriving ...

Health Behavior Change in HCI: Trends, Patterns, and Opportunities

Unhealthy lifestyles could cause many chronic diseases, which bring pati...

Behavior-Driven Synthesis of Human Dynamics

Generating and representing human behavior are of major importance for v...

Target-Specific Action Classification for Automated Assessment of Human Motor Behavior from Video

Objective monitoring and assessment of human motor behavior can improve ...

Personalized On-line Adaptation of Kinematic Synergies for Human-Prosthesis Interfaces

Synergies have been adopted in prosthetic limb applications to reduce co...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.