Towards Accurate Cross-Domain In-Bed Human Pose Estimation

10/07/2021
by   Mohamed Afham, et al.
8

Human behavioral monitoring during sleep is essential for various medical applications. Majority of the contactless human pose estimation algorithms are based on RGB modality, causing ineffectiveness in in-bed pose estimation due to occlusions by blankets and varying illumination conditions. Long-wavelength infrared (LWIR) modality based pose estimation algorithms overcome the aforementioned challenges; however, ground truth pose generations by a human annotator under such conditions are not feasible. A feasible solution to address this issue is to transfer the knowledge learned from images with pose labels and no occlusions, and adapt it towards real world conditions (occlusions due to blankets). In this paper, we propose a novel learning strategy comprises of two-fold data augmentation to reduce the cross-domain discrepancy and knowledge distillation to learn the distribution of unlabeled images in real world conditions. Our experiments and analysis show the effectiveness of our approach over multiple standard human pose estimation baselines.

READ FULL TEXT
research
08/20/2020

Simultaneously-Collected Multimodal Lying Pose Dataset: Towards In-Bed Human Pose Monitoring under Adverse Vision Conditions

Computer vision (CV) has achieved great success in interpreting semantic...
research
03/27/2023

Human Pose Estimation in Extremely Low-Light Conditions

We study human pose estimation in extremely low-light images. This task ...
research
08/22/2022

MetaFi: Device-Free Pose Estimation via Commodity WiFi for Metaverse Avatar Simulation

Avatar refers to a representative of a physical user in the virtual worl...
research
08/16/2019

Cross-Domain Adaptation for Animal Pose Estimation

In this paper, we are interested in pose estimation of animals. Animals ...
research
08/20/2023

OCHID-Fi: Occlusion-Robust Hand Pose Estimation in 3D via RF-Vision

Hand Pose Estimation (HPE) is crucial to many applications, but conventi...
research
02/22/2022

Privacy-Preserving In-Bed Pose Monitoring: A Fusion and Reconstruction Study

Recently, in-bed human pose estimation has attracted the interest of res...
research
05/13/2021

When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarks

Human pose estimation is a fundamental yet challenging task in computer ...

Please sign up or login with your details

Forgot password? Click here to reset