Alert button

Joint Learning of Feature Extraction and Cost Aggregation for Semantic Correspondence

Apr 05, 2022
Jiwon Kim, Youngjo Min, Mira Kim, Seungryong Kim

Figure 1 for Joint Learning of Feature Extraction and Cost Aggregation for Semantic Correspondence
Figure 2 for Joint Learning of Feature Extraction and Cost Aggregation for Semantic Correspondence
Figure 3 for Joint Learning of Feature Extraction and Cost Aggregation for Semantic Correspondence
Figure 4 for Joint Learning of Feature Extraction and Cost Aggregation for Semantic Correspondence

Share this with someone who'll enjoy it:

Establishing dense correspondences across semantically similar images is one of the challenging tasks due to the significant intra-class variations and background clutters. To solve these problems, numerous methods have been proposed, focused on learning feature extractor or cost aggregation independently, which yields sub-optimal performance. In this paper, we propose a novel framework for jointly learning feature extraction and cost aggregation for semantic correspondence. By exploiting the pseudo labels from each module, the networks consisting of feature extraction and cost aggregation modules are simultaneously learned in a boosting fashion. Moreover, to ignore unreliable pseudo labels, we present a confidence-aware contrastive loss function for learning the networks in a weakly-supervised manner. We demonstrate our competitive results on standard benchmarks for semantic correspondence.

* IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2022  
View paper onarxiv icon

Share this with someone who'll enjoy it: