Conditional Reconstruction for Open-set Semantic Segmentation

03/02/2022
by   Ian Nunes, et al.
1

Open set segmentation is a relatively new and unexploredtask, with just a handful of methods proposed to model suchtasks.We propose a novel method called CoReSeg thattackles the issue using class conditional reconstruction ofthe input images according to their pixelwise mask. Ourmethod conditions each input pixel to all known classes,expecting higher errors for pixels of unknown classes. Itwas observed that the proposed method produces better se-mantic consistency in its predictions, resulting in cleanersegmentation maps that better fit object boundaries. CoRe-Seg outperforms state-of-the-art methods on the Vaihin-gen and Potsdam ISPRS datasets, while also being com-petitive on the Houston 2018 IEEE GRSS Data Fusiondataset. Official implementation for CoReSeg is availableat:https://github.com/iannunes/CoReSeg.

READ FULL TEXT

page 1

page 2

page 4

research
06/06/2022

FuSS: Fusing Superpixels for Improved Segmentation Consistency

In this work, we propose two different approaches to improve the semanti...
research
03/14/2023

BoundaryCAM: A Boundary-based Refinement Framework for Weakly Supervised Semantic Segmentation of Medical Images

Weakly Supervised Semantic Segmentation (WSSS) with only image-level sup...
research
09/11/2023

Panoptic Vision-Language Feature Fields

Recently, methods have been proposed for 3D open-vocabulary semantic seg...
research
07/20/2020

Improving Semantic Segmentation via Decoupled Body and Edge Supervision

Existing semantic segmentation approaches either aim to improve the obje...
research
05/06/2017

Sparse Representation-based Open Set Recognition

We propose a generalized Sparse Representation- based Classification (SR...
research
05/10/2023

Scan2LoD3: Reconstructing semantic 3D building models at LoD3 using ray casting and Bayesian networks

Reconstructing semantic 3D building models at the level of detail (LoD) ...
research
04/13/2023

VISION DIFFMASK: Faithful Interpretation of Vision Transformers with Differentiable Patch Masking

The lack of interpretability of the Vision Transformer may hinder its us...

Please sign up or login with your details

Forgot password? Click here to reset