Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


Improved Baselines with Momentum Contrastive Learning

Mar 09, 2020
Xinlei Chen, Haoqi Fan, Ross Girshick, Kaiming He



Contrastive unsupervised learning has recently shown encouraging progress, e.g., in Momentum Contrast (MoCo) and SimCLR. In this note, we verify the effectiveness of two of SimCLR's design improvements by implementing them in the MoCo framework. With simple modifications to MoCo---namely, using an MLP projection head and more data augmentation---we establish stronger baselines that outperform SimCLR and do not require large training batches. We hope this will make state-of-the-art unsupervised learning research more accessible. Code will be made public.

* Tech report, 2 pages + references 


Share this with someone who'll enjoy it:

   Access Paper Source



Share this with someone who'll enjoy it: