HookNet: multi-resolution convolutional neural networks for semantic segmentation in histopathology whole-slide images

06/22/2020
by   Mart van Rijthoven, et al.
0

We propose HookNet, a semantic segmentation model for histopathology whole-slide images, which combines context and details via multiple branches of encoder-decoder convolutional neural networks. Concentricpatches at multiple resolutions with different fields of view are used to feed different branches of HookNet, and intermediate representations are combined via a hooking mechanism. We describe a framework to design and train HookNet for achieving high-resolution semantic segmentation and introduce constraints to guarantee pixel-wise alignment in feature maps during hooking. We show the advantages of using HookNet in two histopathology image segmentation tasks where tissue type prediction accuracy strongly depends on contextual information, namely (1) multi-class tissue segmentation in breast cancer and, (2) segmentation of tertiary lymphoid structures and germinal centers in lung cancer. Weshow the superiority of HookNet when compared with single-resolution U-Net models working at different resolutions as well as with a recently published multi-resolution model for histopathology image segmentation

READ FULL TEXT

page 2

page 10

page 11

page 12

research
10/21/2022

Valuing Vicinity: Memory attention framework for context-based semantic segmentation in histopathology

The segmentation of histopathological whole slide images into tumourous ...
research
07/25/2017

Residual Conv-Deconv Grid Network for Semantic Segmentation

This paper presents GridNet, a new Convolutional Neural Network (CNN) ar...
research
12/07/2021

Hybrid guiding: A multi-resolution refinement approach for semantic segmentation of gigapixel histopathological images

Histopathological cancer diagnostics has become more complex, and the in...
research
01/03/2020

Segmentation of Cellular Patterns in Confocal Images of Melanocytic Lesions in vivo via a Multiscale Encoder-Decoder Network (MED-Net)

In-vivo optical microscopy is advancing into routine clinical practice f...
research
07/15/2019

CA-RefineNet:A Dual Input WSI Image Segmentation Algorithm Based on Attention

Due to the high resolution of pathological images, the automated semanti...
research
07/15/2019

DA-RefineNet:A Dual Input Whole Slide Image Segmentation Algorithm Based on Attention

Due to the high resolution of pathological images, the automated semanti...
research
11/10/2020

MP-ResNet: Multi-path Residual Network for the Semantic segmentation of High-Resolution PolSAR Images

There are limited studies on the semantic segmentation of high-resolutio...

Please sign up or login with your details

Forgot password? Click here to reset