Integrated In-vehicle Monitoring System Using 3D Human Pose Estimation and Seat Belt Segmentation

04/17/2022
by   Ginam Kim, et al.
0

Recently, along with interest in autonomous vehicles, the importance of monitoring systems for both drivers and passengers inside vehicles has been increasing. This paper proposes a novel in-vehicle monitoring system the combines 3D pose estimation, seat-belt segmentation, and seat-belt status classification networks. Our system outputs various information necessary for monitoring by accurately considering the data characteristics of the in-vehicle environment. Specifically, the proposed 3D pose estimation directly estimates the absolute coordinates of keypoints for a driver and passengers, and the proposed seat-belt segmentation is implemented by applying a structure based on the feature pyramid. In addition, we propose a classification task to distinguish between normal and abnormal states of wearing a seat belt using results that combine 3D pose estimation with seat-belt segmentation. These tasks can be learned simultaneously and operate in real-time. Our method was evaluated on a private dataset we newly created and annotated. The experimental results show that our method has significantly high performance that can be applied directly to real in-vehicle monitoring systems.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
05/03/2022

Multitask Network for Joint Object Detection, Semantic Segmentation and Human Pose Estimation in Vehicle Occupancy Monitoring

In order to ensure safe autonomous driving, precise information about th...
research
10/08/2019

NADS-Net: A Nimble Architecture for Driver and Seat Belt Detection via Convolutional Neural Networks

A new convolutional neural network (CNN) architecture for 2D driver/pass...
research
02/02/2023

An Efficient Convex Hull-Based Vehicle Pose Estimation Method for 3D LiDAR

Vehicle pose estimation is essential in the perception technology of aut...
research
08/26/2021

Fast and Flexible Human Pose Estimation with HyperPose

Estimating human pose is an important yet challenging task in multimedia...
research
11/29/2014

A Bayesian Framework for Sparse Representation-Based 3D Human Pose Estimation

A Bayesian framework for 3D human pose estimation from monocular images ...
research
07/23/2015

Human Pose Estimation with Iterative Error Feedback

Hierarchical feature extractors such as Convolutional Networks (ConvNets...
research
03/05/2019

Pose Estimation of Vehicles Over Uneven Terrain

This paper presents a method for pose estimation of off-road vehicles mo...

Please sign up or login with your details

Forgot password? Click here to reset