Alert button

Bridging Diversity and Uncertainty in Active learning with Self-Supervised Pre-Training

Add code
Bookmark button
Alert button
Mar 06, 2024
Paul Doucet, Benjamin Estermann, Till Aczel, Roger Wattenhofer

Figure 1 for Bridging Diversity and Uncertainty in Active learning with Self-Supervised Pre-Training
Figure 2 for Bridging Diversity and Uncertainty in Active learning with Self-Supervised Pre-Training
Figure 3 for Bridging Diversity and Uncertainty in Active learning with Self-Supervised Pre-Training
Figure 4 for Bridging Diversity and Uncertainty in Active learning with Self-Supervised Pre-Training

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

This study addresses the integration of diversity-based and uncertainty-based sampling strategies in active learning, particularly within the context of self-supervised pre-trained models. We introduce a straightforward heuristic called TCM that mitigates the cold start problem while maintaining strong performance across various data levels. By initially applying TypiClust for diversity sampling and subsequently transitioning to uncertainty sampling with Margin, our approach effectively combines the strengths of both strategies. Our experiments demonstrate that TCM consistently outperforms existing methods across various datasets in both low and high data regimes.

* Accepted at ICLR 2024 Workshop on Practical Machine Learning for Low Resource Settings (PML4LRS)  
View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon