Active Perception using Light Curtains for Autonomous Driving

by   Siddharth Ancha, et al.
Carnegie Mellon University

Most real-world 3D sensors such as LiDARs perform fixed scans of the entire environment, while being decoupled from the recognition system that processes the sensor data. In this work, we propose a method for 3D object recognition using light curtains, a resource-efficient controllable sensor that measures depth at user-specified locations in the environment. Crucially, we propose using prediction uncertainty of a deep learning based 3D point cloud detector to guide active perception. Given a neural network's uncertainty, we derive an optimization objective to place light curtains using the principle of maximizing information gain. Then, we develop a novel and efficient optimization algorithm to maximize this objective by encoding the physical constraints of the device into a constraint graph and optimizing with dynamic programming. We show how a 3D detector can be trained to detect objects in a scene by sequentially placing uncertainty-guided light curtains to successively improve detection accuracy. Code and details can be found on the project webpage:


page 2

page 9

page 15


Active Safety Envelopes using Light Curtains with Probabilistic Guarantees

To safely navigate unknown environments, robots must accurately perceive...

Active Velocity Estimation using Light Curtains via Self-Supervised Multi-Armed Bandits

To navigate in an environment safely and autonomously, robots must accur...

Learning an Uncertainty-Aware Object Detector for Autonomous Driving

The capability to detect objects is a core part of autonomous driving. D...

Radar Guided Dynamic Visual Attention for Resource-Efficient RGB Object Detection

An autonomous system's perception engine must provide an accurate unders...

Object Finding in Cluttered Scenes Using Interactive Perception

Object finding in clutter is a skill that requires both perception of th...

MAP-NBV: Multi-agent Prediction-guided Next-Best-View Planning for Active 3D Object Reconstruction

We propose MAP-NBV, a prediction-guided active algorithm for 3D reconstr...

Please sign up or login with your details

Forgot password? Click here to reset