What My Motion tells me about Your Pose: Self-Supervised Fine-Tuning of Observed Vehicle Orientation Angle

07/29/2020
by   Cédric Picron, et al.
0

The determination of the relative 6 Degree of Freedom (DoF) pose of vehicles around the ego-vehicle from monocular cameras is an important aspect of the perception problem for Autonomous Vehicles (AVs) and Driver Assist Technology (DAT). Current deep learning techniques used for tackling this problem are data hungry, driving the need for unsupervised or self-supervised methods. In this paper, we consider the domain adaptation task of fine-tuning a vehicle orientation estimator on a new domain without labels. By leveraging the ego-motion consistencies obtained from a monocular SLAM method, we show that our self-supervised fine-tuning scheme consistently improves the accuracy of the resulting network. More specifically, when transitioning from Virtual Kitti to nuScenes, up to 70 a supervised method. Our self-supervised method hence allows us to safely transfer vehicle orientation estimators to new domains without requiring expensive new labels.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/26/2021

Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection

Self-driving cars must detect other vehicles and pedestrians in 3D to pl...
research
02/14/2023

MSDA: Monocular Self-supervised Domain Adaptation for 6D Object Pose Estimation

Acquiring labeled 6D poses from real images is an expensive and time-con...
research
12/28/2020

Lattice-Free MMI Adaptation Of Self-Supervised Pretrained Acoustic Models

In this work, we propose lattice-free MMI (LFMMI) for supervised adaptat...
research
08/04/2023

Robust Self-Supervised Extrinsic Self-Calibration

Autonomous vehicles and robots need to operate over a wide variety of sc...
research
07/24/2020

Self-Supervised Learning Across Domains

Human adaptability relies crucially on learning and merging knowledge fr...
research
03/22/2017

Deep MANTA: A Coarse-to-fine Many-Task Network for joint 2D and 3D vehicle analysis from monocular image

In this paper, we present a novel approach, called Deep MANTA (Deep Many...
research
10/21/2021

Weakly Supervised Training of Monocular 3D Object Detectors Using Wide Baseline Multi-view Traffic Camera Data

Accurate 7DoF prediction of vehicles at an intersection is an important ...

Please sign up or login with your details

Forgot password? Click here to reset