MonoCInIS: Camera Independent Monocular 3D Object Detection using Instance Segmentation

10/01/2021
by   Jonas Heylen, et al.
0

Monocular 3D object detection has recently shown promising results, however there remain challenging problems. One of those is the lack of invariance to different camera intrinsic parameters, which can be observed across different 3D object datasets. Little effort has been made to exploit the combination of heterogeneous 3D object datasets. In contrast to general intuition, we show that more data does not automatically guarantee a better performance, but rather, methods need to have a degree of 'camera independence' in order to benefit from large and heterogeneous training data. In this paper we propose a category-level pose estimation method based on instance segmentation, using camera independent geometric reasoning to cope with the varying camera viewpoints and intrinsics of different datasets. Every pixel of an instance predicts the object dimensions, the 3D object reference points projected in 2D image space and, optionally, the local viewing angle. Camera intrinsics are only used outside of the learned network to lift the predicted 2D reference points to 3D. We surpass camera independent methods on the challenging KITTI3D benchmark and show the key benefits compared to camera dependent methods.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 4

page 8

03/28/2018

Pose2Seg: Human Instance Segmentation Without Detection

The general method of image instance segmentation is to perform the obje...
11/28/2016

Object Detection Free Instance Segmentation With Labeling Transformations

Instance segmentation has attracted recent attention in computer vision ...
10/25/2019

Team PFDet's Methods for Open Images Challenge 2019

We present the instance segmentation and the object detection method use...
06/07/2020

CubifAE-3D: Monocular Camera Space Cubification on Autonomous Vehicles for Auto-Encoder based 3D Object Detection

We introduce a method for 3D object detection using a single monocular i...
04/19/2022

Shape-Aware Monocular 3D Object Detection

The detection of 3D objects through a single perspective camera is a cha...
11/14/2019

SimVODIS: Simultaneous Visual Odometry, Object Detection, and Instance Segmentation

Intelligent agents need to understand the surrounding environment to pro...
10/28/2019

Literature Review: Human Segmentation with Static Camera

Our research topic is Human segmentation with static camera. This topic ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.