Evaluation of deep lift pose models for 3D rodent pose estimation based on geometrically triangulated data

by   Indrani Sarkar, et al.

The assessment of laboratory animal behavior is of central interest in modern neuroscience research. Behavior is typically studied in terms of pose changes, which are ideally captured in three dimensions. This requires triangulation over a multi-camera system which view the animal from different angles. However, this is challenging in realistic laboratory setups due to occlusions and other technical constrains. Here we propose the usage of lift-pose models that allow for robust 3D pose estimation of freely moving rodents from a single view camera view. To obtain high-quality training data for the pose-lifting, we first perform geometric calibration in a camera setup involving bottom as well as side views of the behaving animal. We then evaluate the performance of two previously proposed model architectures under given inference perspectives and conclude that reliable 3D pose inference can be obtained using temporal convolutions. With this work we would like to contribute to a more robust and diverse behavior tracking of freely moving rodents for a wide range of experiments and setups in the neuroscience community.


page 1

page 2

page 3

page 4


Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera

We propose the first real-time approach for the egocentric estimation of...

MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision

Recently, huge strides were made in monocular and multi-view pose estima...

ROVO: Robust Omnidirectional Visual Odometryfor Wide-baseline Wide-FOV Camera Systems

In this paper we propose a robust visual odometry system for a wide-base...

ROVO: Robust Omnidirectional Visual Odometry for Wide-baseline Wide-FOV Camera Systems

In this paper we propose a robust visual odometry system for a wide-base...

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution

3D human pose estimation (HPE) is crucial in many fields, such as human ...

A generalizable approach for multi-view 3D human pose regression

Despite the significant improvement in the performance of monocular pose...

AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wild

Animals are capable of extreme agility, yet understanding their complex ...