TMR-RD: Training-based Model Refinement and Representation Disagreement for Semi-Supervised Object Detection

Semi-supervised object detection (SSOD) can incorporate limited labeled data and large amounts of unlabeled data to improve the performance and generalization of existing object detectors. Despite many advances, recent SSOD methods are still challenged by noisy/misleading pseudo-labels, classical exponential moving average (EMA) strategy, and the consensus of Teacher-Student models in the latter stages of training. This paper proposes a novel training-based model refinement (TMR) stage and a simple yet effective representation disagreement (RD) strategy to address the limitations of classical EMA and the consensus problem. The TMR stage of Teacher-Student models optimizes the lightweight scaling operation to refine the model's weights and prevent overfitting or forgetting learned patterns from unlabeled data. Meanwhile, the RD strategy helps keep these models diverged to encourage the student model to explore complementary representations. In addition, we use cascade regression to generate more reliable pseudo-labels for supervising the student model. Extensive experiments demonstrate the superior performance of our approach over state-of-the-art SSOD methods. Specifically, the proposed approach outperforms the Unbiased-Teacher method by an average mAP margin of 4.6 MS-COCO dataset, respectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/19/2021

Humble Teachers Teach Better Students for Semi-Supervised Object Detection

We propose a semi-supervised approach for contemporary object detectors ...
research
12/06/2022

Semi-Supervised Object Detection with Object-wise Contrastive Learning and Regression Uncertainty

Semi-supervised object detection (SSOD) aims to boost detection performa...
research
06/14/2022

Label Matching Semi-Supervised Object Detection

Semi-supervised object detection has made significant progress with the ...
research
09/04/2022

Consistent Teacher Provides Better Supervision in Semi-supervised Object Detection

In this study, we dive deep into the unique challenges in semi-supervise...
research
11/10/2021

Advancing Brain Metastases Detection in T1-Weighted Contrast-Enhanced 3D MRI using Noisy Student-based Training

The detection of brain metastases (BM) in their early stages could have ...
research
06/14/2021

Kaizen: Continuously improving teacher using Exponential Moving Average for semi-supervised speech recognition

In this paper, we introduce the Kaizen framework that uses a continuousl...
research
02/23/2023

Uncertainty Guided Ensemble Self-Training for Semi-Supervised Global Field Reconstruction

Recovering a globally accurate complex physics field from limited sensor...

Please sign up or login with your details

Forgot password? Click here to reset