Temporal LiDAR Frame Prediction for Autonomous Driving

12/17/2020
by   David Deng, et al.
15

Anticipating the future in a dynamic scene is critical for many fields such as autonomous driving and robotics. In this paper we propose a class of novel neural network architectures to predict future LiDAR frames given previous ones. Since the ground truth in this application is simply the next frame in the sequence, we can train our models in a self-supervised fashion. Our proposed architectures are based on FlowNet3D and Dynamic Graph CNN. We use Chamfer Distance (CD) and Earth Mover's Distance (EMD) as loss functions and evaluation metrics. We train and evaluate our models using the newly released nuScenes dataset, and characterize their performance and complexity with several baselines. Compared to directly using FlowNet3D, our proposed architectures achieve CD and EMD nearly an order of magnitude lower. In addition, we show that our predictions generate reasonable scene flow approximations without using any labelled supervision.

READ FULL TEXT

page 6

page 7

page 13

page 14

page 15

page 16

page 18

page 19

research
04/25/2023

ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds

In this paper, we propose a novel self-supervised motion estimator for L...
research
12/01/2019

Just Go with the Flow: Self-Supervised Scene Flow Estimation

When interacting with highly dynamic environments, scene flow allows aut...
research
10/04/2022

Dfferentiable Raycasting for Self-supervised Occupancy Forecasting

Motion planning for safe autonomous driving requires learning how the en...
research
02/16/2021

LEAD: LiDAR Extender for Autonomous Driving

3D perception using sensors under vehicle industrial standard is the rig...
research
02/19/2021

SLPC: a VRNN-based approach for stochastic lidar prediction and completion in autonomous driving

Predicting future 3D LiDAR pointclouds is a challenging task that is use...
research
03/16/2023

SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Driving

3D scene understanding plays a vital role in vision-based autonomous dri...
research
02/07/2023

Explainable Action Prediction through Self-Supervision on Scene Graphs

This work explores scene graphs as a distilled representation of high-le...

Please sign up or login with your details

Forgot password? Click here to reset