Deep Rigid Instance Scene Flow

04/18/2019
by   Wei-Chiu Ma, et al.
6

In this paper we tackle the problem of scene flow estimation in the context of self-driving. We leverage deep learning techniques as well as strong priors as in our application domain the motion of the scene can be composed by the motion of the robot and the 3D motion of the actors in the scene. We formulate the problem as energy minimization in a deep structured model, which can be solved efficiently in the GPU by unrolling a Gaussian-Newton solver. Our experiments in the challenging KITTI scene flow dataset show that we outperform the state-of-the-art by a very large margin, while being 800 times faster.

READ FULL TEXT

page 2

page 3

page 5

page 8

research
04/06/2016

Exploiting Semantic Information and Deep Matching for Optical Flow

We tackle the problem of estimating optical flow from a monocular camera...
research
07/27/2016

A Continuous Optimization Approach for Efficient and Accurate Scene Flow

We propose a continuous optimization method for solving dense 3D scene f...
research
12/01/2020

RAFT-3D: Scene Flow using Rigid-Motion Embeddings

We address the problem of scene flow: given a pair of stereo or RGB-D vi...
research
10/05/2017

Multiframe Scene Flow with Piecewise Rigid Motion

We introduce a novel multiframe scene flow approach that jointly optimiz...
research
11/19/2020

FlowStep3D: Model Unrolling for Self-Supervised Scene Flow Estimation

Estimating the 3D motion of points in a scene, known as scene flow, is a...
research
06/06/2018

PointFlowNet: Learning Representations for 3D Scene Flow Estimation from Point Clouds

Despite significant progress in image-based 3D scene flow estimation, th...
research
04/04/2023

Re-Evaluating LiDAR Scene Flow for Autonomous Driving

Current methods for self-supervised LiDAR scene flow estimation work poo...

Please sign up or login with your details

Forgot password? Click here to reset