DeepAI AI Chat
Log In Sign Up

MOPS-Net: A Matrix Optimization-driven Network forTask-Oriented 3D Point Cloud Downsampling

by   Yue Qian, et al.

Downsampling is a commonly-used technique in 3D point cloudprocessing for saving storage space, transmission bandwidth andcomputational complexity. The classic downsampling methods,such as farthest point sampling and Poisson disk sampling, thoughwidely used for decades, are independent of the subsequent applications, since the downsampled point cloud may compromisetheir performance severely. This paper explores the problem oftask-oriented downsampling, which aims to downsample a pointcloud and maintain the performance of subsequent applications asmuch as possible. We propose MOPS-Net, a novel end-to-end deepneural network which is designed from the perspective of matrixoptimization, making it fundamentally different from the existing deep learning-based methods. Due to its discrete and combinatorial nature, it is difficult to solve the downsampling problem directly. To tackle this challenge, we relax the binary constraint of each variableand lift 3D points to a higher dimensional feature space, in which a constrained and differentiable matrix optimization problem withan implicit objective function is formulated. We then propose a deep neural network architecture to mimic the matrix optimization problem by exploring both the local and the global structures of the input data. With a task network, MOPS-Net can be end-to-endtrained. Moreover, it is permutation-invariant, making it robust to input data. We also extend MOPS-Net such that a single network after one-time training is capable of handling arbitrary downsam-pling ratios. Extensive experimental results show that MOPS-Net can achieve favorable performance against state-of-the-art deeplearning-based method over various tasks, including point cloud classification, retrieval and reconstruction.


page 1

page 2

page 3

page 4


SO-Net: Self-Organizing Network for Point Cloud Analysis

This paper presents SO-Net, a permutation invariant architecture for dee...

HV-Net: Hypervolume Approximation based on DeepSets

In this letter, we propose HV-Net, a new method for hypervolume approxim...

SK-Net: Deep Learning on Point Cloud via End-to-end Discovery of Spatial Keypoints

Since the PointNet was proposed, deep learning on point cloud has been t...

Adaptive Hierarchical Down-Sampling for Point Cloud Classification

While several convolution-like operators have recently been proposed for...

PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsampling

This paper addresses the problem of generating uniform dense point cloud...

A Unified Query-based Paradigm for Point Cloud Understanding

3D point cloud understanding is an important component in autonomous dri...

FloorPP-Net: Reconstructing Floor Plans using Point Pillars for Scan-to-BIM

This paper presents a deep learning-based point cloud processing method ...

Code Repositories


A learned sampling approach for point clouds (CVPR 2019)

view repo