One Model is All You Need: Multi-Task Learning Enables Simultaneous Histology Image Segmentation and Classification

02/28/2022
by   Simon Graham, et al.
18

The recent surge in performance for image analysis of digitised pathology slides can largely be attributed to the advance of deep learning. Deep models can be used to initially localise various structures in the tissue and hence facilitate the extraction of interpretable features for biomarker discovery. However, these models are typically trained for a single task and therefore scale poorly as we wish to adapt the model for an increasing number of different tasks. Also, supervised deep learning models are very data hungry and therefore rely on large amounts of training data to perform well. In this paper we present a multi-task learning approach for segmentation and classification of nuclei, glands, lumen and different tissue regions that leverages data from multiple independent data sources. While ensuring that our tasks are aligned by the same tissue type and resolution, we enable simultaneous prediction with a single network. As a result of feature sharing, we also show that the learned representation can be used to improve downstream tasks, including nuclear classification and signet ring cell detection. As part of this work, we use a large dataset consisting of over 600K objects for segmentation and 440K patches for classification and make the data publicly available. We use our approach to process the colorectal subset of TCGA, consisting of 599 whole-slide images, to localise 377 million, 900K and 2.1 million nuclei, glands and lumen respectively. We make this resource available to remove a major barrier in the development of explainable models for computational pathology.

READ FULL TEXT

page 4

page 7

page 8

page 13

page 15

page 20

research
05/09/2020

Multi-Task Learning in Histo-pathology for Widely Generalizable Model

In this work we show preliminary results of deep multi-task learning in ...
research
02/23/2022

Nuclei panoptic segmentation and composition regression with multi-task deep neural networks

Nuclear segmentation, classification and quantification within Haematoxy...
research
08/25/2021

Lizard: A Large-Scale Dataset for Colonic Nuclear Instance Segmentation and Classification

The development of deep segmentation models for computational pathology ...
research
02/05/2023

Multi-Task Self-Supervised Learning for Image Segmentation Task

Thanks to breakthroughs in AI and Deep learning methodology, Computer vi...
research
02/18/2021

NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentation

High-resolution mapping of cells and tissue structures provides a founda...
research
06/05/2019

A Feature Transfer Enabled Multi-Task Deep Learning Model on Medical Imaging

Object detection, segmentation and classification are three common tasks...
research
02/03/2021

OmiEmbed: reconstruct comprehensive phenotypic information from multi-omics data using multi-task deep learning

High-dimensional omics data contains intrinsic biomedical information th...

Please sign up or login with your details

Forgot password? Click here to reset