Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

Geoffrey Hinton

University of Toronto

Big Self-Supervised Models are Strong Semi-Supervised Learners

Jun 17, 2020
Ting Chen, Simon Kornblith, Kevin Swersky, Mohammad Norouzi, Geoffrey Hinton

* code and pretrained models at https://github.com/google-research/simclr 

  Access Model/Code and Paper
Imputer: Sequence Modelling via Imputation and Dynamic Programming

Feb 20, 2020
William Chan, Chitwan Saharia, Geoffrey Hinton, Mohammad Norouzi, Navdeep Jaitly

* preprint 

  Access Model/Code and Paper
Deflecting Adversarial Attacks

Feb 18, 2020
Yao Qin, Nicholas Frosst, Colin Raffel, Garrison Cottrell, Geoffrey Hinton


  Access Model/Code and Paper
A Simple Framework for Contrastive Learning of Visual Representations

Feb 13, 2020
Ting Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey Hinton


  Access Model/Code and Paper
Subclass Distillation

Feb 10, 2020
Rafael MĂŒller, Simon Kornblith, Geoffrey Hinton

* Under review 

  Access Model/Code and Paper
NASA: Neural Articulated Shape Approximation

Dec 06, 2019
Timothy Jeruzalski, Boyang Deng, Mohammad Norouzi, JP Lewis, Geoffrey Hinton, Andrea Tagliasacchi


  Access Model/Code and Paper
CvxNets: Learnable Convex Decomposition

Sep 12, 2019
Boyang Deng, Kyle Genova, Soroosh Yazdani, Sofien Bouaziz, Geoffrey Hinton, Andrea Tagliasacchi


  Access Model/Code and Paper
Lookahead Optimizer: k steps forward, 1 step back

Jul 19, 2019
Michael R. Zhang, James Lucas, Geoffrey Hinton, Jimmy Ba

* 8 pages 

  Access Model/Code and Paper
Detecting and Diagnosing Adversarial Images with Class-Conditional Capsule Reconstructions

Jul 05, 2019
Yao Qin, Nicholas Frosst, Sara Sabour, Colin Raffel, Garrison Cottrell, Geoffrey Hinton


  Access Model/Code and Paper
When Does Label Smoothing Help?

Jun 06, 2019
Rafael MĂŒller, Simon Kornblith, Geoffrey Hinton

* Under review 

  Access Model/Code and Paper
Cerberus: A Multi-headed Derenderer

May 28, 2019
Boyang Deng, Simon Kornblith, Geoffrey Hinton


  Access Model/Code and Paper
Similarity of Neural Network Representations Revisited

May 14, 2019
Simon Kornblith, Mohammad Norouzi, Honglak Lee, Geoffrey Hinton

* Accepted to ICML 2019 

  Access Model/Code and Paper
Analyzing and Improving Representations with the Soft Nearest Neighbor Loss

Feb 05, 2019
Nicholas Frosst, Nicolas Papernot, Geoffrey Hinton


  Access Model/Code and Paper
DARCCC: Detecting Adversaries by Reconstruction from Class Conditional Capsules

Nov 16, 2018
Nicholas Frosst, Sara Sabour, Geoffrey Hinton

* To be presented at NIPS 2018 Workshop on Security in Machine Learning 

  Access Model/Code and Paper
Distilling a Neural Network Into a Soft Decision Tree

Nov 27, 2017
Nicholas Frosst, Geoffrey Hinton

* presented at the CEX workshop at AI*IA 2017 conference 

  Access Model/Code and Paper
Regularizing Neural Networks by Penalizing Confident Output Distributions

Jan 23, 2017
Gabriel Pereyra, George Tucker, Jan Chorowski, Ɓukasz Kaiser, Geoffrey Hinton

* Submitted to ICLR 2017 

  Access Model/Code and Paper
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

Jan 23, 2017
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, Jeff Dean


  Access Model/Code and Paper
Using Fast Weights to Attend to the Recent Past

Dec 05, 2016
Jimmy Ba, Geoffrey Hinton, Volodymyr Mnih, Joel Z. Leibo, Catalin Ionescu

* Added [Schmidhuber 1993] citation to the last paragraph of the introduction. Fixed typo appendix A.1 uniform initialization to 1/\sqrt{H} 

  Access Model/Code and Paper
Grammar as a Foreign Language

Jun 09, 2015
Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, Geoffrey Hinton


  Access Model/Code and Paper
Distilling the Knowledge in a Neural Network

Mar 09, 2015
Geoffrey Hinton, Oriol Vinyals, Jeff Dean

* NIPS 2014 Deep Learning Workshop 

  Access Model/Code and Paper
Speech Recognition with Deep Recurrent Neural Networks

Mar 22, 2013
Alex Graves, Abdel-rahman Mohamed, Geoffrey Hinton

* To appear in ICASSP 2013 

  Access Model/Code and Paper
Deep Lambertian Networks

Jun 27, 2012
Yichuan Tang, Ruslan Salakhutdinov, Geoffrey Hinton

* Appears in Proceedings of the 29th International Conference on Machine Learning (ICML 2012) 

  Access Model/Code and Paper
Deep Mixtures of Factor Analysers

Jun 18, 2012
Yichuan Tang, Ruslan Salakhutdinov, Geoffrey Hinton

* ICML2012 

  Access Model/Code and Paper