Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Geoffrey Hinton

Geoffrey Hinton

University of Toronto

How to represent part-whole hierarchies in a neural network


Feb 25, 2021
Geoffrey Hinton

* 43 pages, 5 figures 

  Access Paper or Ask Questions

Canonical Capsules: Unsupervised Capsules in Canonical Pose


Dec 08, 2020
Weiwei Sun, Andrea Tagliasacchi, Boyang Deng, Sara Sabour, Soroosh Yazdani, Geoffrey Hinton, Kwang Moo Yi

* The first two authors contributed equally to this work 

  Access Paper or Ask Questions

Teaching with Commentaries


Nov 05, 2020
Aniruddh Raghu, Maithra Raghu, Simon Kornblith, David Duvenaud, Geoffrey Hinton


  Access Paper or Ask Questions

Big Self-Supervised Models are Strong Semi-Supervised Learners


Jun 17, 2020
Ting Chen, Simon Kornblith, Kevin Swersky, Mohammad Norouzi, Geoffrey Hinton

* code and pretrained models at https://github.com/google-research/simclr 

  Access Paper or Ask Questions

Imputer: Sequence Modelling via Imputation and Dynamic Programming


Feb 20, 2020
William Chan, Chitwan Saharia, Geoffrey Hinton, Mohammad Norouzi, Navdeep Jaitly

* preprint 

  Access Paper or Ask Questions

Deflecting Adversarial Attacks


Feb 18, 2020
Yao Qin, Nicholas Frosst, Colin Raffel, Garrison Cottrell, Geoffrey Hinton


  Access Paper or Ask Questions

A Simple Framework for Contrastive Learning of Visual Representations


Feb 13, 2020
Ting Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey Hinton


  Access Paper or Ask Questions

Subclass Distillation


Feb 10, 2020
Rafael Müller, Simon Kornblith, Geoffrey Hinton

* Under review 

  Access Paper or Ask Questions

NASA: Neural Articulated Shape Approximation


Dec 06, 2019
Timothy Jeruzalski, Boyang Deng, Mohammad Norouzi, JP Lewis, Geoffrey Hinton, Andrea Tagliasacchi


  Access Paper or Ask Questions

CvxNets: Learnable Convex Decomposition


Sep 12, 2019
Boyang Deng, Kyle Genova, Soroosh Yazdani, Sofien Bouaziz, Geoffrey Hinton, Andrea Tagliasacchi


  Access Paper or Ask Questions

Lookahead Optimizer: k steps forward, 1 step back


Jul 19, 2019
Michael R. Zhang, James Lucas, Geoffrey Hinton, Jimmy Ba

* 8 pages 

  Access Paper or Ask Questions

Detecting and Diagnosing Adversarial Images with Class-Conditional Capsule Reconstructions


Jul 05, 2019
Yao Qin, Nicholas Frosst, Sara Sabour, Colin Raffel, Garrison Cottrell, Geoffrey Hinton


  Access Paper or Ask Questions

When Does Label Smoothing Help?


Jun 06, 2019
Rafael Müller, Simon Kornblith, Geoffrey Hinton

* Under review 

  Access Paper or Ask Questions

Cerberus: A Multi-headed Derenderer


May 28, 2019
Boyang Deng, Simon Kornblith, Geoffrey Hinton


  Access Paper or Ask Questions

Similarity of Neural Network Representations Revisited


May 14, 2019
Simon Kornblith, Mohammad Norouzi, Honglak Lee, Geoffrey Hinton

* Accepted to ICML 2019 

  Access Paper or Ask Questions

Analyzing and Improving Representations with the Soft Nearest Neighbor Loss


Feb 05, 2019
Nicholas Frosst, Nicolas Papernot, Geoffrey Hinton


  Access Paper or Ask Questions

DARCCC: Detecting Adversaries by Reconstruction from Class Conditional Capsules


Nov 16, 2018
Nicholas Frosst, Sara Sabour, Geoffrey Hinton

* To be presented at NIPS 2018 Workshop on Security in Machine Learning 

  Access Paper or Ask Questions

Distilling a Neural Network Into a Soft Decision Tree


Nov 27, 2017
Nicholas Frosst, Geoffrey Hinton

* presented at the CEX workshop at AI*IA 2017 conference 

  Access Paper or Ask Questions

Regularizing Neural Networks by Penalizing Confident Output Distributions


Jan 23, 2017
Gabriel Pereyra, George Tucker, Jan Chorowski, Łukasz Kaiser, Geoffrey Hinton

* Submitted to ICLR 2017 

  Access Paper or Ask Questions

Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer


Jan 23, 2017
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, Jeff Dean


  Access Paper or Ask Questions

Using Fast Weights to Attend to the Recent Past


Dec 05, 2016
Jimmy Ba, Geoffrey Hinton, Volodymyr Mnih, Joel Z. Leibo, Catalin Ionescu

* Added [Schmidhuber 1993] citation to the last paragraph of the introduction. Fixed typo appendix A.1 uniform initialization to 1/\sqrt{H} 

  Access Paper or Ask Questions

Grammar as a Foreign Language


Jun 09, 2015
Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, Geoffrey Hinton


  Access Paper or Ask Questions

Distilling the Knowledge in a Neural Network


Mar 09, 2015
Geoffrey Hinton, Oriol Vinyals, Jeff Dean

* NIPS 2014 Deep Learning Workshop 

  Access Paper or Ask Questions

Speech Recognition with Deep Recurrent Neural Networks


Mar 22, 2013
Alex Graves, Abdel-rahman Mohamed, Geoffrey Hinton

* To appear in ICASSP 2013 

  Access Paper or Ask Questions

Deep Lambertian Networks


Jun 27, 2012
Yichuan Tang, Ruslan Salakhutdinov, Geoffrey Hinton

* Appears in Proceedings of the 29th International Conference on Machine Learning (ICML 2012) 

  Access Paper or Ask Questions

Deep Mixtures of Factor Analysers


Jun 18, 2012
Yichuan Tang, Ruslan Salakhutdinov, Geoffrey Hinton

* ICML2012 

  Access Paper or Ask Questions