Conditional Diffusion Models for Weakly Supervised Medical Image Segmentation

06/06/2023
by   Xinrong Hu, et al.
0

Recent advances in denoising diffusion probabilistic models have shown great success in image synthesis tasks. While there are already works exploring the potential of this powerful tool in image semantic segmentation, its application in weakly supervised semantic segmentation (WSSS) remains relatively under-explored. Observing that conditional diffusion models (CDM) is capable of generating images subject to specific distributions, in this work, we utilize category-aware semantic information underlied in CDM to get the prediction mask of the target object with only image-level annotations. More specifically, we locate the desired class by approximating the derivative of the output of CDM w.r.t the input condition. Our method is different from previous diffusion model methods with guidance from an external classifier, which accumulates noises in the background during the reconstruction process. Our method outperforms state-of-the-art CAM and diffusion model methods on two public medical image segmentation datasets, which demonstrates that CDM is a promising tool in WSSS. Also, experiment shows our method is more time-efficient than existing diffusion model methods, making it practical for wider applications.

READ FULL TEXT

page 2

page 7

research
12/17/2022

Annotation by Clicks: A Point-Supervised Contrastive Variance Method for Medical Semantic Segmentation

Medical image segmentation methods typically rely on numerous dense anno...
research
10/16/2019

Deep Semantic Segmentation of Natural and Medical Images: A Review

The (medical) image semantic segmentation task consists of classifying e...
research
12/06/2021

Label-Efficient Semantic Segmentation with Diffusion Models

Denoising diffusion probabilistic models have recently received much res...
research
09/08/2023

From Text to Mask: Localizing Entities Using the Attention of Text-to-Image Diffusion Models

Diffusion models have revolted the field of text-to-image generation rec...
research
09/03/2023

ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Models

Colonoscopy analysis, particularly automatic polyp segmentation and dete...
research
06/15/2021

CT Image Synthesis Using Weakly Supervised Segmentation and Geometric Inter-Label Relations For COVID Image Analysis

While medical image segmentation is an important task for computer aided...
research
05/29/2023

CamoDiffusion: Camouflaged Object Detection via Conditional Diffusion Models

Camouflaged Object Detection (COD) is a challenging task in computer vis...

Please sign up or login with your details

Forgot password? Click here to reset