Generalize Ultrasound Image Segmentation via Instant and Plug Play Style Transfer

01/11/2021
by   Zhendong Liu, et al.
0

Deep segmentation models that generalize to images with unknown appearance are important for real-world medical image analysis. Retraining models leads to high latency and complex pipelines, which are impractical in clinical settings. The situation becomes more severe for ultrasound image analysis because of their large appearance shifts. In this paper, we propose a novel method for robust segmentation under unknown appearance shifts. Our contribution is three-fold. First, we advance a one-stage plug-and-play solution by embedding hierarchical style transfer units into a segmentation architecture. Our solution can remove appearance shifts and perform segmentation simultaneously. Second, we adopt Dynamic Instance Normalization to conduct precise and dynamic style transfer in a learnable manner, rather than previously fixed style normalization. Third, our solution is fast and lightweight for routine clinical adoption. Given 400*400 image input, our solution only needs an additional 0.2ms and 1.92M FLOPs to handle appearance shifts compared to the baseline pipeline. Extensive experiments are conducted on a large dataset from three vendors demonstrate our proposed method enhances the robustness of deep segmentation models.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 4

02/14/2020

Remove Appearance Shift for Ultrasound Image Segmentation via Fast and Universal Style Transfer

Deep Neural Networks (DNNs) suffer from the performance degradation when...
08/01/2021

Style Curriculum Learning for Robust Medical Image Segmentation

The performance of deep segmentation models often degrades due to distri...
09/24/2020

Style-invariant Cardiac Image Segmentation with Test-time Augmentation

Deep models often suffer from severe performance drop due to the appeara...
05/18/2017

Exploring the structure of a real-time, arbitrary neural artistic stylization network

In this paper, we present a method which combines the flexibility of the...
11/16/2019

Dynamic Instance Normalization for Arbitrary Style Transfer

Prior normalization methods rely on affine transformations to produce ar...
01/09/2017

Son of Zorn's Lemma: Targeted Style Transfer Using Instance-aware Semantic Segmentation

Style transfer is an important task in which the style of a source image...
03/03/2018

Stylize Aesthetic QR Code

With the continued proliferation of smart mobile devices, Quick Response...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.