Lightweight 3D Human Pose Estimation Network Training Using Teacher-Student Learning

01/15/2020
by   Dong-Hyun Hwang, et al.
4

We present MoVNect, a lightweight deep neural network to capture 3D human pose using a single RGB camera. To improve the overall performance of the model, we apply the teacher-student learning method based knowledge distillation to 3D human pose estimation. Real-time post-processing makes the CNN output yield temporally stable 3D skeletal information, which can be used in applications directly. We implement a 3D avatar application running on mobile in real-time to demonstrate that our network achieves both high accuracy and fast inference time. Extensive evaluations show the advantages of our lightweight model with the proposed training method over previous 3D pose estimation methods on the Human3.6M dataset and mobile devices.

READ FULL TEXT

page 4

page 7

page 8

research
07/16/2020

Self-supervision on Unlabelled OR Data for Multi-person 2D/3D Human Pose Estimation

2D/3D human pose estimation is needed to develop novel intelligent tools...
research
11/13/2018

Fast Human Pose Estimation

Existing human pose estimation approaches often only consider how to imp...
research
04/21/2021

Orderly Dual-Teacher Knowledge Distillation for Lightweight Human Pose Estimation

Although deep convolution neural networks (DCNN) have achieved excellent...
research
12/17/2020

Invariant Teacher and Equivariant Student for Unsupervised 3D Human Pose Estimation

We propose a novel method based on teacher-student learning framework fo...
research
08/11/2020

Real-Time Sign Language Detection using Human Pose Estimation

We propose a lightweight real-time sign language detection model, as we ...
research
01/11/2022

MobileFaceSwap: A Lightweight Framework for Video Face Swapping

Advanced face swapping methods have achieved appealing results. However,...
research
03/08/2023

Semi-Supervised 2D Human Pose Estimation Driven by Position Inconsistency Pseudo Label Correction Module

In this paper, we delve into semi-supervised 2D human pose estimation. T...

Please sign up or login with your details

Forgot password? Click here to reset