Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Ari S. Morcos

Width Transfer: On the (In)variance of Width Optimization


Apr 24, 2021
Ting-Wu Chin, Diana Marculescu, Ari S. Morcos

* Full paper accepted at CVPR Workshops 2021; a 4-page abridged version is accepted at ICLR 2021 NAS Workshop 

  Access Paper or Ask Questions

Leveraging background augmentations to encourage semantic focus in self-supervised contrastive learning


Mar 23, 2021
Chaitanya K. Ryali, David J. Schwab, Ari S. Morcos

* Technical Report 

  Access Paper or Ask Questions

Reservoir Transformer


Dec 30, 2020
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela


  Access Paper or Ask Questions

Are all negatives created equal in contrastive instance discrimination?


Oct 25, 2020
Tiffany Tianhui Cai, Jonathan Frankle, David J. Schwab, Ari S. Morcos

* Fixed author name error 

  Access Paper or Ask Questions

PareCO: Pareto-aware Channel Optimization for Slimmable Neural Networks


Jul 23, 2020
Ting-Wu Chin, Ari S. Morcos, Diana Marculescu

* preprint, 4-page abridged versions have been accepted at non-archival venues including RealML and DMMLSys workshops at ICML'20 and DLP-KDD and AdvML workshops at KDD'20 

  Access Paper or Ask Questions

On the relationship between class selectivity, dimensionality, and robustness


Jul 08, 2020
Matthew L. Leavitt, Ari S. Morcos


  Access Paper or Ask Questions

Plan2Vec: Unsupervised Representation Learning by Latent Plans


May 07, 2020
Ge Yang, Amy Zhang, Ari S. Morcos, Joelle Pineau, Pieter Abbeel, Roberto Calandra

* Proceedings of Machine Learning Research, the 2nd Annual Conference on Learning for Dynamics and Control (2020) Volume 120, 1-12 
* code available at https://geyang.github.io/plan2vec 

  Access Paper or Ask Questions

Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs


Feb 29, 2020
Jonathan Frankle, David J. Schwab, Ari S. Morcos


  Access Paper or Ask Questions

The Early Phase of Neural Network Training


Feb 24, 2020
Jonathan Frankle, David J. Schwab, Ari S. Morcos

* ICLR 2020 Camera Ready. Available on OpenReview at https://openreview.net/forum?id=Hkl1iRNFwS 

  Access Paper or Ask Questions

The Generalization-Stability Tradeoff in Neural Network Pruning


Jun 09, 2019
Brian R. Bartoldson, Ari S. Morcos, Adrian Barbu, Gordon Erlebacher


  Access Paper or Ask Questions

One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers


Jun 06, 2019
Ari S. Morcos, Haonan Yu, Michela Paganini, Yuandong Tian


  Access Paper or Ask Questions

Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP


Jun 06, 2019
Haonan Yu, Sergey Edunov, Yuandong Tian, Ari S. Morcos


  Access Paper or Ask Questions

Learning to Make Analogies by Contrasting Abstract Relational Structure


Jan 31, 2019
Felix Hill, Adam Santoro, David G. T. Barrett, Ari S. Morcos, Timothy Lillicrap


  Access Paper or Ask Questions

Analyzing biological and artificial neural networks: challenges with opportunities for synergy?


Oct 31, 2018
David G. T. Barrett, Ari S. Morcos, Jakob H. Macke


  Access Paper or Ask Questions

Insights on representational similarity in neural networks with canonical correlation


Oct 23, 2018
Ari S. Morcos, Maithra Raghu, Samy Bengio

* NIPS 2018 

  Access Paper or Ask Questions

Measuring abstract reasoning in neural networks


Jul 11, 2018
David G. T. Barrett, Felix Hill, Adam Santoro, Ari S. Morcos, Timothy Lillicrap

* ICML 2018 

  Access Paper or Ask Questions

Human-level performance in first-person multiplayer games with population-based deep reinforcement learning


Jul 03, 2018
Max Jaderberg, Wojciech M. Czarnecki, Iain Dunning, Luke Marris, Guy Lever, Antonio Garcia Castaneda, Charles Beattie, Neil C. Rabinowitz, Ari S. Morcos, Avraham Ruderman, Nicolas Sonnerat, Tim Green, Louise Deason, Joel Z. Leibo, David Silver, Demis Hassabis, Koray Kavukcuoglu, Thore Graepel


  Access Paper or Ask Questions

Pooling is neither necessary nor sufficient for appropriate deformation stability in CNNs


May 25, 2018
Avraham Ruderman, Neil C. Rabinowitz, Ari S. Morcos, Daniel Zoran

* NIPS 2018 submission 

  Access Paper or Ask Questions

On the importance of single directions for generalization


May 22, 2018
Ari S. Morcos, David G. T. Barrett, Neil C. Rabinowitz, Matthew Botvinick

* ICLR 2018 conference paper; added additional methodological details 

  Access Paper or Ask Questions