Gated3D: Monocular 3D Object Detection From Temporal Illumination Cues

by   Frank Julca-Aguilar, et al.

Today's state-of-the-art methods for 3D object detection are based on lidar, stereo, or monocular cameras. Lidar-based methods achieve the best accuracy, but have a large footprint, high cost, and mechanically-limited angular sampling rates, resulting in low spatial resolution at long ranges. Recent approaches based on low-cost monocular or stereo cameras promise to overcome these limitations but struggle in low-light or low-contrast regions as they rely on passive CMOS sensors. In this work, we propose a novel 3D object detection modality that exploits temporal illumination cues from a low-cost monocular gated imager. We propose a novel deep detector architecture, Gated3D, that is tailored to temporal illumination cues from three gated images. Gated images allow us to exploit mature 2D object feature extractors that guide the 3D predictions through a frustum segment estimation. We assess the proposed method on a novel 3D detection dataset that includes gated imagery captured in over 10,000 km of driving data. We validate that our method outperforms state-of-the-art monocular and stereo approaches at long distances. We will release our code and dataset, opening up a new sensor modality as an avenue to replace lidar in autonomous driving.



page 2

page 3

page 5

page 6

page 8


SGM3D: Stereo Guided Monocular 3D Object Detection

Monocular 3D object detection is a critical yet challenging task for aut...

Sparse LiDAR and Stereo Fusion (SLS-Fusion) for Depth Estimationand 3D Object Detection

The ability to accurately detect and localize objects is recognized as b...

RefinedMPL: Refined Monocular PseudoLiDAR for 3D Object Detection in Autonomous Driving

In this paper, we strive for solving the ambiguities arisen by the astou...

Multi-Sensor 3D Object Box Refinement for Autonomous Driving

We propose a 3D object detection system with multi-sensor refinement in ...

Gated2Depth: Real-time Dense Lidar from Gated Images

We present an imaging framework which converts three images from a gated...

Single-Stage Monocular 3D Object Detection with Virtual Cameras

While expensive LiDAR and stereo camera rigs have enabled the developmen...

MonStereo: When Monocular and Stereo Meet at the Tail of 3D Human Localization

Monocular and stereo vision are cost-effective solutions for 3D human lo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.