MOPS-Net: A Matrix Optimization-driven Network forTask-Oriented 3D Point Cloud Downsampling

by   Yue Qian, et al.

Downsampling is a commonly-used technique in 3D point cloudprocessing for saving storage space, transmission bandwidth andcomputational complexity. The classic downsampling methods,such as farthest point sampling and Poisson disk sampling, thoughwidely used for decades, are independent of the subsequent applications, since the downsampled point cloud may compromisetheir performance severely. This paper explores the problem oftask-oriented downsampling, which aims to downsample a pointcloud and maintain the performance of subsequent applications asmuch as possible. We propose MOPS-Net, a novel end-to-end deepneural network which is designed from the perspective of matrixoptimization, making it fundamentally different from the existing deep learning-based methods. Due to its discrete and combinatorial nature, it is difficult to solve the downsampling problem directly. To tackle this challenge, we relax the binary constraint of each variableand lift 3D points to a higher dimensional feature space, in which a constrained and differentiable matrix optimization problem withan implicit objective function is formulated. We then propose a deep neural network architecture to mimic the matrix optimization problem by exploring both the local and the global structures of the input data. With a task network, MOPS-Net can be end-to-endtrained. Moreover, it is permutation-invariant, making it robust to input data. We also extend MOPS-Net such that a single network after one-time training is capable of handling arbitrary downsam-pling ratios. Extensive experimental results show that MOPS-Net can achieve favorable performance against state-of-the-art deeplearning-based method over various tasks, including point cloud classification, retrieval and reconstruction.


page 1

page 2

page 3

page 4


SO-Net: Self-Organizing Network for Point Cloud Analysis

This paper presents SO-Net, a permutation invariant architecture for dee...

HV-Net: Hypervolume Approximation based on DeepSets

In this letter, we propose HV-Net, a new method for hypervolume approxim...

SK-Net: Deep Learning on Point Cloud via End-to-end Discovery of Spatial Keypoints

Since the PointNet was proposed, deep learning on point cloud has been t...

Adaptive Hierarchical Down-Sampling for Point Cloud Classification

While several convolution-like operators have recently been proposed for...

PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsampling

This paper addresses the problem of generating uniform dense point cloud...

Searching Dense Point Correspondences via Permutation Matrix Learning

Although 3D point cloud data has received widespread attentions as a gen...

A Unified Query-based Paradigm for Point Cloud Understanding

3D point cloud understanding is an important component in autonomous dri...

Please sign up or login with your details

Forgot password? Click here to reset