Robust Image Segmentation Quality Assessment without Ground Truth

by   Leixin Zhou, et al.

Deep learning based image segmentation methods have achieved great success, even having human-level accuracy in some applications. However, due to the black box nature of deep learning, the best method may fail in some situations. Thus predicting segmentation quality without ground truth would be very crucial especially in clinical practice. Recently, people proposed to train neural networks to estimate the quality score by regression. Although it can achieve promising prediction accuracy, the network suffers robustness problem, e.g. it is vulnerable to adversarial attacks. In this paper, we propose to alleviate this problem by utilizing the difference between the input image and the reconstructed image, which is reconstructed from the segmentation to be assessed. The deep learning based reconstruction network (REC-Net) is trained with the input image masked by the ground truth segmentation against the original input image as the target. The rationale behind is that the trained REC-Net can best reconstruct the input image masked by accurate segmentation. The quality score regression network (REG-Net) is then trained with difference images and the corresponding segmentations as input. In this way, the regression network may have lower chance to overfit to the undesired image features from the original input image, and thus is more robust. Results on ACDC17 dataset demonstrated our method is promising.


page 5

page 6

page 9

page 10


Training Deep Learning based Denoisers without Ground Truth Data

Recent deep learning based denoisers are trained to minimize the mean sq...

ComboNet: Combined 2D 3D Architecture for Aorta Segmentation

3D segmentation with deep learning if trained with full resolution is th...

Real-time Prediction of Segmentation Quality

Recent advances in deep learning based image segmentation methods have e...

QANet - Quality Assurance Network for Microscopy Cell Segmentation

Tools and methods for automatic image segmentation are rapidly developin...

A quality assurance framework for real-time monitoring of deep learning segmentation models in radiotherapy

To safely deploy deep learning models in the clinic, a quality assurance...

Translating Clinical Delineation of Diabetic Foot Ulcers into Machine Interpretable Segmentation

Diabetic foot ulcer is a severe condition that requires close monitoring...

Supervised Deep Learning for Content-Aware Image Retargeting with Fourier Convolutions

Image retargeting aims to alter the size of the image with attention to ...

Please sign up or login with your details

Forgot password? Click here to reset