Joint Learning of Feature Extraction and Cost Aggregation for Semantic Correspondence

04/05/2022
by   Jiwon Kim, et al.
0

Establishing dense correspondences across semantically similar images is one of the challenging tasks due to the significant intra-class variations and background clutters. To solve these problems, numerous methods have been proposed, focused on learning feature extractor or cost aggregation independently, which yields sub-optimal performance. In this paper, we propose a novel framework for jointly learning feature extraction and cost aggregation for semantic correspondence. By exploiting the pseudo labels from each module, the networks consisting of feature extraction and cost aggregation modules are simultaneously learned in a boosting fashion. Moreover, to ignore unreliable pseudo labels, we present a confidence-aware contrastive loss function for learning the networks in a weakly-supervised manner. We demonstrate our competitive results on standard benchmarks for semantic correspondence.

READ FULL TEXT

page 3

page 4

research
03/30/2022

Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labels

Establishing dense correspondences across semantically similar images re...
research
05/13/2021

DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision

We introduce DiscoBox, a novel framework that jointly learns instance se...
research
10/29/2018

Recurrent Transformer Networks for Semantic Correspondence

We present recurrent transformer networks (RTNs) for obtaining dense cor...
research
02/27/2023

Self Correspondence Distillation for End-to-End Weakly-Supervised Semantic Segmentation

Efficiently training accurate deep models for weakly supervised semantic...
research
05/10/2023

Weakly-supervised ROI extraction method based on contrastive learning for remote sensing images

ROI extraction is an active but challenging task in remote sensing becau...
research
02/12/2021

DeepPseudo: Deep Pseudo-code Generation via Transformer and Code Feature Extraction

Pseudo-code written by natural language is helpful for novice developers...
research
06/04/2021

Semantic Correspondence with Transformers

We propose a novel cost aggregation network, called Cost Aggregation wit...

Please sign up or login with your details

Forgot password? Click here to reset