Diffusion Model for Camouflaged Object Detection

08/01/2023
by   Zhennan Chen, et al.
0

Camouflaged object detection is a challenging task that aims to identify objects that are highly similar to their background. Due to the powerful noise-to-image denoising capability of denoising diffusion models, in this paper, we propose a diffusion-based framework for camouflaged object detection, termed diffCOD, a new framework that considers the camouflaged object segmentation task as a denoising diffusion process from noisy masks to object masks. Specifically, the object mask diffuses from the ground-truth masks to a random distribution, and the designed model learns to reverse this noising process. To strengthen the denoising learning, the input image prior is encoded and integrated into the denoising diffusion model to guide the diffusion process. Furthermore, we design an injection attention module (IAM) to interact conditional semantic features extracted from the image with the diffusion noise embedding via the cross-attention mechanism to enhance denoising learning. Extensive experiments on four widely used COD benchmark datasets demonstrate that the proposed method achieves favorable performance compared to the existing 11 state-of-the-art methods, especially in the detailed texture segmentation of camouflaged objects. Our code will be made publicly available at: https://github.com/ZNan-Chen/diffCOD.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

research
11/17/2022

DiffusionDet: Diffusion Model for Object Detection

We propose DiffusionDet, a new framework that formulates object detectio...
research
05/29/2023

CamoDiffusion: Camouflaged Object Detection via Conditional Diffusion Models

Camouflaged Object Detection (COD) is a challenging task in computer vis...
research
03/31/2023

Diffusion Action Segmentation

Temporal action segmentation is crucial for understanding long-form vide...
research
11/21/2022

Diffusion Denoising Process for Perceptron Bias in Out-of-distribution Detection

Out-of-distribution (OOD) detection is an important task to ensure the r...
research
05/30/2023

DiffMatch: Diffusion Model for Dense Matching

The objective for establishing dense correspondence between paired image...
research
12/06/2022

DiffusionInst: Diffusion Model for Instance Segmentation

Recently, diffusion frameworks have achieved comparable performance with...
research
02/11/2023

Metaphor Detection with Effective Context Denoising

We propose a novel RoBERTa-based model, RoPPT, which introduces a target...

Please sign up or login with your details

Forgot password? Click here to reset