Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloud

08/13/2021
by   Björn Michele, et al.
4

While there has been a number of studies on Zero-Shot Learning (ZSL) for 2D images, its application to 3D data is still recent and scarce, with just a few methods limited to classification. We present the first generative approach for both ZSL and Generalized ZSL (GZSL) on 3D data, that can handle both classification and, for the first time, semantic segmentation. We show that it reaches or outperforms the state of the art on ModelNet40 classification for both inductive ZSL and inductive GZSL. For semantic segmentation, we created three benchmarks for evaluating this new ZSL task, using S3DIS, ScanNet and SemanticKITTI. Our experiments show that our method outperforms strong baselines, which we additionally propose for this task.

READ FULL TEXT

page 7

page 19

research
12/16/2019

Transductive Zero-Shot Learning for 3D Point Cloud Classification

Zero-shot learning, the task of learning to recognize new classes not se...
research
11/13/2022

Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overview

Visual semantic segmentation aims at separating a visual sample into div...
research
11/29/2021

3D Compositional Zero-shot Learning with DeCompositional Consensus

Parts represent a basic unit of geometric and semantic similarity across...
research
06/11/2021

Conterfactual Generative Zero-Shot Semantic Segmentation

zero-shot learning is an essential part of computer vision. As a classic...
research
04/11/2023

SATR: Zero-Shot Semantic Segmentation of 3D Shapes

We explore the task of zero-shot semantic segmentation of 3D shapes by u...
research
05/01/2022

Medical Coding with Biomedical Transformer Ensembles and Zero/Few-shot Learning

Medical coding (MC) is an essential pre-requisite for reliable data retr...
research
11/10/2020

Resource Constrained Dialog Policy Learning via Differentiable Inductive Logic Programming

Motivated by the needs of resource constrained dialog policy learning, w...

Please sign up or login with your details

Forgot password? Click here to reset