3D Point Cloud Feature Explanations Using Gradient-Based Methods

06/09/2020
by   Ananya Gupta, et al.
20

Explainability is an important factor to drive user trust in the use of neural networks for tasks with material impact. However, most of the work done in this area focuses on image analysis and does not take into account 3D data. We extend the saliency methods that have been shown to work on image data to deal with 3D data. We analyse the features in point clouds and voxel spaces and show that edges and corners in 3D data are deemed as important features while planar surfaces are deemed less important. The approach is model-agnostic and can provide useful information about learnt features. Driven by the insight that 3D data is inherently sparse, we visualise the features learnt by a voxel-based classification network and show that these features are also sparse and can be pruned relatively easily, leading to more efficient neural networks. Our results show that the Voxception-ResNet model can be pruned down to 5% of its parameters with negligible loss in accuracy.

READ FULL TEXT

page 4

page 6

page 8

research
09/30/2019

Multi-view PointNet for 3D Scene Understanding

Fusion of 2D images and 3D point clouds is important because information...
research
03/17/2022

Visualizing Global Explanations of Point Cloud DNNs

In the field of autonomous driving and robotics, point clouds are showin...
research
07/28/2021

Surrogate Model-Based Explainability Methods for Point Cloud NNs

In the field of autonomous driving and robotics, point clouds are showin...
research
07/28/2021

Multi Point-Voxel Convolution (MPVConv) for Deep Learning on Point Clouds

The existing 3D deep learning methods adopt either individual point-base...
research
07/26/2022

Explaining Deep Neural Networks for Point Clouds using Gradient-based Visualisations

Explaining decisions made by deep neural networks is a rapidly advancing...
research
12/02/2016

PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation

Point cloud is an important type of geometric data structure. Due to its...

Please sign up or login with your details

Forgot password? Click here to reset