Scene Flow from Point Clouds with or without Learning

by   Jhony Kaesemodel Pontes, et al.

Scene flow is the three-dimensional (3D) motion field of a scene. It provides information about the spatial arrangement and rate of change of objects in dynamic environments. Current learning-based approaches seek to estimate the scene flow directly from point clouds and have achieved state-of-the-art performance. However, supervised learning methods are inherently domain specific and require a large amount of labeled data. Annotation of scene flow on real-world point clouds is expensive and challenging, and the lack of such datasets has recently sparked interest in self-supervised learning methods. How to accurately and robustly learn scene flow representations without labeled real-world data is still an open problem. Here we present a simple and interpretable objective function to recover the scene flow from point clouds. We use the graph Laplacian of a point cloud to regularize the scene flow to be "as-rigid-as-possible". Our proposed objective function can be used with or without learning—as a self-supervisory signal to learn scene flow representations, or as a non-learning-based method in which the scene flow is optimized during runtime. Our approach outperforms related works in many datasets. We also show the immediate applications of our proposed method for two applications: motion segmentation and point cloud densification.


page 1

page 5

page 7

page 12


Self-Supervised Learning of Non-Rigid Residual Flow and Ego-Motion

Most of the current scene flow methods choose to model scene flow as a p...

3D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motion

3D scene flow characterizes how the points at the current time flow to t...

Adversarial Self-Supervised Scene Flow Estimation

This work proposes a metric learning approach for self-supervised scene ...

PointFlowNet: Learning Representations for 3D Scene Flow Estimation from Point Clouds

Despite significant progress in image-based 3D scene flow estimation, th...

Scalable Scene Flow from Point Clouds in the Real World

Autonomous vehicles operate in highly dynamic environments necessitating...

PointFlowHop: Green and Interpretable Scene Flow Estimation from Consecutive Point Clouds

An efficient 3D scene flow estimation method called PointFlowHop is prop...

Self-Supervised Scene Flow Estimation with 4D Automotive Radar

Scene flow allows autonomous vehicles to reason about the arbitrary moti...

Please sign up or login with your details

Forgot password? Click here to reset