Unsupervised Representation Learning from Pathology Images with Multi-directional Contrastive Predictive Coding

05/11/2021
by   Jacob Carse, et al.
0

Digital pathology tasks have benefited greatly from modern deep learning algorithms. However, their need for large quantities of annotated data has been identified as a key challenge. This need for data can be countered by using unsupervised learning in situations where data are abundant but access to annotations is limited. Feature representations learned from unannotated data using contrastive predictive coding (CPC) have been shown to enable classifiers to obtain state of the art performance from relatively small amounts of annotated computer vision data. We present a modification to the CPC framework for use with digital pathology patches. This is achieved by introducing an alternative mask for building the latent context and using a multi-directional PixelCNN autoregressor. To demonstrate our proposed method we learn feature representations from the Patch Camelyon histology dataset. We show that our proposed modification can yield improved deep classification of histology patches.

READ FULL TEXT
research
05/22/2019

Data-Efficient Image Recognition with Contrastive Predictive Coding

Large scale deep learning excels when labeled images are abundant, yet d...
research
07/10/2018

Representation Learning with Contrastive Predictive Coding

While supervised learning has enabled great progress in many application...
research
10/23/2019

Semi-Supervised Histology Classification using Deep Multiple Instance Learning and Contrastive Predictive Coding

Convolutional neural networks can be trained to perform histology slide ...
research
04/25/2019

Unsupervised Deep Learning by Neighbourhood Discovery

Deep convolutional neural networks (CNNs) have demonstrated remarkable s...
research
09/17/2020

The Next Big Thing(s) in Unsupervised Machine Learning: Five Lessons from Infant Learning

After a surge in popularity of supervised Deep Learning, the desire to r...
research
09/28/2021

A Contrastive Learning Approach to Auroral Identification and Classification

Unsupervised learning algorithms are beginning to achieve accuracies com...
research
09/11/2015

Learning Sparse Feature Representations using Probabilistic Quadtrees and Deep Belief Nets

Learning sparse feature representations is a useful instrument for solvi...

Please sign up or login with your details

Forgot password? Click here to reset