Motion and Region Aware Adversarial Learning for Fall Detection with Thermal Imaging

by   Vineet Mehta, et al.

Automatic fall detection is a vital technology for ensuring health and safety of people. Home based camera systems for fall detection often put people's privacy at risk. Thermal cameras can partially/fully obfuscate facial features, thus preserving the privacy of a person. Another challenge is the less occurrence of falls in comparison to normal activities of daily living. As fall occurs rarely, it is non-trivial to learn algorithms due to class imbalance. To handle these problems, we formulate fall detection as an anomaly detection within an adversarial framework using thermal imaging camera. We present a novel adversarial network that comprise of two channel 3D convolutional auto encoders; one each handling video sequences and optical flow, which then reconstruct the thermal data and the optical flow input sequences. We introduce a differential constraint, a technique to track the region of interest and a joint discriminator to compute the reconstruction error. Larger reconstruction error indicates the occurrence of fall in a video sequence. The experiments on a publicly available thermal fall dataset show the superior results obtained in comparison to standard baseline.


page 3

page 5

page 6


DeepFall -- Non-invasive Fall Detection with Deep Spatio-Temporal Convolutional Autoencoders

Human falls rarely occur; however, detecting falls is very important fro...

Home Activity Monitoring using Low Resolution Infrared Sensor

Action monitoring in a home environment provides important information f...

Multi Visual Modality Fall Detection Dataset

Falls are one of the leading cause of injury-related deaths among the el...

Spatio-Temporal Adversarial Learning for Detecting Unseen Falls

Fall detection is an important problem from both the health and machine ...

Wearable Vision Detection of Environmental Fall Risks using Convolutional Neural Networks

In this paper, a method to detect environmental hazards related to a fal...

Vision-Based Fallen Person Detection for the Elderly

Falls are serious and costly for elderly people. The Centers for Disease...

Providing Confidential Cloud-based Fall Detection from Remote Sensor Data Using Multi-Party Computation

Fall detection systems are concerned with rapidly detecting the occurren...

Please sign up or login with your details

Forgot password? Click here to reset