User-Guided Domain Adaptation for Rapid Annotation from User Interactions: A Study on Pathological Liver Segmentation

09/05/2020
by   Ashwin Raju, et al.
0

Mask-based annotation of medical images, especially for 3D data, is a bottleneck in developing reliable machine learning models. Using minimal-labor user interactions (UIs) to guide the annotation is promising, but challenges remain on best harmonizing the mask prediction with the UIs. To address this, we propose the user-guided domain adaptation (UGDA) framework, which uses prediction-based adversarial domain adaptation (PADA) to model the combined distribution of UIs and mask predictions. The UIs are then used as anchors to guide and align the mask prediction. Importantly, UGDA can both learn from unlabelled data and also model the high-level semantic meaning behind different UIs. We test UGDA on annotating pathological livers using a clinically comprehensive dataset of 927 patient studies. Using only extreme-point UIs, we achieve a mean (worst-case) performance of 96.1 (87.0 retain this state-of-the-art performance even when only seeing a fraction of available UIs, demonstrating an ability for robust and reliable UI-guided segmentation with extremely minimal labor demands.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 6

10/02/2019

Weakly supervised segmentation from extreme points

Annotation of medical images has been a major bottleneck for the develop...
04/05/2020

Adversarial-Prediction Guided Multi-task Adaptation for Semantic Segmentation of Electron Microscopy Images

Semantic segmentation is an essential step for electron microscopy (EM) ...
11/24/2021

Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentation

It is valuable to achieve domain adaptation to transfer the learned know...
11/18/2021

Edge-preserving Domain Adaptation for semantic segmentation of Medical Images

Domain Adaptation is a technique to address the lack of massive amounts ...
03/02/2020

Unsupervised Domain Adaptation for Mammogram Image Classification: A Promising Tool for Model Generalization

Generalization is one of the key challenges in the clinical validation a...
12/04/2018

Towards Continuous Domain adaptation for Healthcare

Deep learning algorithms have demonstrated tremendous success on challen...
03/25/2021

CGPart: A Part Segmentation Dataset Based on 3D Computer Graphics Models

Part segmentations provide a rich and detailed part-level description of...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.