Improving Weakly Supervised Sound Event Detection with Causal Intervention

03/10/2023
by   Yifei Xin, et al.
0

Existing weakly supervised sound event detection (WSSED) work has not explored both types of co-occurrences simultaneously, i.e., some sound events often co-occur, and their occurrences are usually accompanied by specific background sounds, so they would be inevitably entangled, causing misclassification and biased localization results with only clip-level supervision. To tackle this issue, we first establish a structural causal model (SCM) to reveal that the context is the main cause of co-occurrence confounders that mislead the model to learn spurious correlations between frames and clip-level labels. Based on the causal analysis, we propose a causal intervention (CI) method for WSSED to remove the negative impact of co-occurrence confounders by iteratively accumulating every possible context of each class and then re-projecting the contexts to the frame-level features for making the event boundary clearer. Experiments show that our method effectively improves the performance on multiple datasets and can generalize to various baseline models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/21/2021

Improving Weakly-supervised Object Localization via Causal Intervention

The recent emerged weakly supervised object localization (WSOL) methods ...
research
01/03/2023

Further Improving Weakly-supervised Object Localization via Causal Knowledge Distillation

Weakly-supervised object localization aims to indicate the category as w...
research
09/26/2020

Causal Intervention for Weakly-Supervised Semantic Segmentation

We present a causal inference framework to improve Weakly-Supervised Sem...
research
06/21/2021

Affinity Mixup for Weakly Supervised Sound Event Detection

The weakly supervised sound event detection problem is the task of predi...
research
05/24/2019

Disentangled Feature for Weakly Supervised Multi-class Sound Event Detection

We propose a disentangled feature for weakly supervised multiclass sound...
research
09/13/2021

Honey or Poison? Solving the Trigger Curse in Few-shot Event Detection via Causal Intervention

Event detection has long been troubled by the trigger curse: overfitting...
research
03/30/2022

Weakly supervised causal representation learning

Learning high-level causal representations together with a causal model ...

Please sign up or login with your details

Forgot password? Click here to reset