Learning Hyperbolic Representations for Unsupervised 3D Segmentation

12/03/2020
by   Joy Hsu, et al.
0

There exists a need for unsupervised 3D segmentation on complex volumetric data, particularly when annotation ability is limited or discovery of new categories is desired. Using the observation that much of 3D volumetric data is innately hierarchical, we propose learning effective representations of 3D patches for unsupervised segmentation through a variational autoencoder (VAE) with a hyperbolic latent space and a proposed gyroplane convolutional layer, which better models the underlying hierarchical structure within a 3D image. We also introduce a hierarchical triplet loss and multi-scale patch sampling scheme to embed relationships across varying levels of granularity. We demonstrate the effectiveness of our hyperbolic representations for unsupervised 3D segmentation on a hierarchical toy dataset, BraTS whole tumor dataset, and cryogenic electron microscopy data.

READ FULL TEXT

page 5

page 6

page 8

page 14

04/30/2020

APo-VAE: Text Generation in Hyperbolic Space

Natural language often exhibits inherent hierarchical structure ingraine...
05/05/2022

Contrastive Multi-view Hyperbolic Hierarchical Clustering

Hierarchical clustering recursively partitions data at an increasingly f...
02/08/2019

A Differentiable Gaussian-like Distribution on Hyperbolic Space for Gradient-Based Learning

Hyperbolic space is a geometry that is known to be well-suited for repre...
03/30/2021

Unsupervised Hyperbolic Representation Learning via Message Passing Auto-Encoders

Most of the existing literature regarding hyperbolic embedding concentra...
01/17/2019

Hierarchical Representations with Poincaré Variational Auto-Encoders

The Variational Auto-Encoder (VAE) model has become widely popular as a ...
08/05/2019

Unsupervised Representations of Pollen in Bright-Field Microscopy

We present the first unsupervised deep learning method for pollen analys...
06/01/2018

Corner-Sharing Tetrahedra for Modeling Micro-Structure

State-of-the-art representations of volumetric multi-scale shape and str...