Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Yoshua Bengio

Yoshua Bengio

Neural Production Systems


Mar 02, 2021
Anirudh Goyal, Aniket Didolkar, Nan Rosemary Ke, Charles Blundell, Philippe Beaudoin, Nicolas Heess, Michael Mozer, Yoshua Bengio


  Access Paper or Ask Questions

Coordination Among Neural Modules Through a Shared Global Workspace


Mar 01, 2021
Anirudh Goyal, Aniket Didolkar, Alex Lamb, Kartikeya Badola, Nan Rosemary Ke, Nasim Rahaman, Jonathan Binas, Charles Blundell, Michael Mozer, Yoshua Bengio


  Access Paper or Ask Questions

Learning Neural Generative Dynamics for Molecular Conformation Generation


Feb 28, 2021
Minkai Xu, Shitong Luo, Yoshua Bengio, Jian Peng, Jian Tang

Figure 1 for Learning Neural Generative Dynamics for Molecular Conformation Generation
Figure 2 for Learning Neural Generative Dynamics for Molecular Conformation Generation
Figure 3 for Learning Neural Generative Dynamics for Molecular Conformation Generation
Figure 4 for Learning Neural Generative Dynamics for Molecular Conformation Generation
* Accepted by ICLR 2021 
  Access Paper or Ask Questions

Transformers with Competitive Ensembles of Independent Mechanisms


Feb 27, 2021
Alex Lamb, Di He, Anirudh Goyal, Guolin Ke, Chien-Feng Liao, Mirco Ravanelli, Yoshua Bengio

Figure 1 for Transformers with Competitive Ensembles of Independent Mechanisms
Figure 2 for Transformers with Competitive Ensembles of Independent Mechanisms
Figure 3 for Transformers with Competitive Ensembles of Independent Mechanisms
Figure 4 for Transformers with Competitive Ensembles of Independent Mechanisms
* Under Review, ICML 2021 
  Access Paper or Ask Questions

Towards Causal Representation Learning


Feb 22, 2021
Bernhard Schölkopf, Francesco Locatello, Stefan Bauer, Nan Rosemary Ke, Nal Kalchbrenner, Anirudh Goyal, Yoshua Bengio

Figure 1 for Towards Causal Representation Learning
Figure 2 for Towards Causal Representation Learning
Figure 3 for Towards Causal Representation Learning
Figure 4 for Towards Causal Representation Learning
* Special Issue of Proceedings of the IEEE - Advances in Machine Learning and Deep Neural Networks 
  Access Paper or Ask Questions

DEUP: Direct Epistemic Uncertainty Prediction


Feb 16, 2021
Moksh Jain, Salem Lahlou, Hadi Nekoei, Victor Butoi, Paul Bertin, Jarrid Rector-Brooks, Maksym Korablyov, Yoshua Bengio

Figure 1 for DEUP: Direct Epistemic Uncertainty Prediction
Figure 2 for DEUP: Direct Epistemic Uncertainty Prediction
Figure 3 for DEUP: Direct Epistemic Uncertainty Prediction
Figure 4 for DEUP: Direct Epistemic Uncertainty Prediction

  Access Paper or Ask Questions

Structured Sparsity Inducing Adaptive Optimizers for Deep Learning


Feb 07, 2021
Tristan Deleu, Yoshua Bengio

Figure 1 for Structured Sparsity Inducing Adaptive Optimizers for Deep Learning
Figure 2 for Structured Sparsity Inducing Adaptive Optimizers for Deep Learning
Figure 3 for Structured Sparsity Inducing Adaptive Optimizers for Deep Learning
Figure 4 for Structured Sparsity Inducing Adaptive Optimizers for Deep Learning

  Access Paper or Ask Questions

Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Bias


Jan 14, 2021
Axel Laborieux, Maxence Ernoult, Benjamin Scellier, Yoshua Bengio, Julie Grollier, Damien Querlioz

Figure 1 for Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Bias
Figure 2 for Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Bias
Figure 3 for Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Bias
Figure 4 for Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Bias
* NeurIPS 2020 Workshop : "Beyond Backpropagation Novel Ideas for Training Neural Architectures". arXiv admin note: substantial text overlap with arXiv:2006.03824 
  Access Paper or Ask Questions

Machine Learning for Glacier Monitoring in the Hindu Kush Himalaya


Dec 09, 2020
Shimaa Baraka, Benjamin Akera, Bibek Aryal, Tenzing Sherpa, Finu Shresta, Anthony Ortiz, Kris Sankaran, Juan Lavista Ferres, Mir Matin, Yoshua Bengio

Figure 1 for Machine Learning for Glacier Monitoring in the Hindu Kush Himalaya
Figure 2 for Machine Learning for Glacier Monitoring in the Hindu Kush Himalaya
Figure 3 for Machine Learning for Glacier Monitoring in the Hindu Kush Himalaya
Figure 4 for Machine Learning for Glacier Monitoring in the Hindu Kush Himalaya
* Accepted for a spotlight talk and a poster at the Tackling Climate Change with Machine Learning workshop at NeurIPS 2020 
  Access Paper or Ask Questions

Inductive Biases for Deep Learning of Higher-Level Cognition


Dec 07, 2020
Anirudh Goyal, Yoshua Bengio

Figure 1 for Inductive Biases for Deep Learning of Higher-Level Cognition
* This document contains a review of authors research as part of the requirement of AG's predoctoral exam, an overview of the main contributions of the authors few recent papers (co-authored with several other co-authors) as well as a vision of proposed future research 
  Access Paper or Ask Questions

RetroGNN: Approximating Retrosynthesis by Graph Neural Networks for De Novo Drug Design


Nov 25, 2020
Cheng-Hao Liu, Maksym Korablyov, Stanisław Jastrzębski, Paweł Włodarczyk-Pruszyński, Yoshua Bengio, Marwin H. S. Segler

Figure 1 for RetroGNN: Approximating Retrosynthesis by Graph Neural Networks for De Novo Drug Design
Figure 2 for RetroGNN: Approximating Retrosynthesis by Graph Neural Networks for De Novo Drug Design
Figure 3 for RetroGNN: Approximating Retrosynthesis by Graph Neural Networks for De Novo Drug Design
Figure 4 for RetroGNN: Approximating Retrosynthesis by Graph Neural Networks for De Novo Drug Design
* Machine Learning for Molecules Workshop at NeurIPS 2020 
  Access Paper or Ask Questions

Gradient Starvation: A Learning Proclivity in Neural Networks


Nov 23, 2020
Mohammad Pezeshki, Sékou-Oumar Kaba, Yoshua Bengio, Aaron Courville, Doina Precup, Guillaume Lajoie

Figure 1 for Gradient Starvation: A Learning Proclivity in Neural Networks
Figure 2 for Gradient Starvation: A Learning Proclivity in Neural Networks
Figure 3 for Gradient Starvation: A Learning Proclivity in Neural Networks
Figure 4 for Gradient Starvation: A Learning Proclivity in Neural Networks

  Access Paper or Ask Questions

COVI-AgentSim: an Agent-based Model for Evaluating Methods of Digital Contact Tracing


Oct 30, 2020
Prateek Gupta, Tegan Maharaj, Martin Weiss, Nasim Rahaman, Hannah Alsdurf, Abhinav Sharma, Nanor Minoyan, Soren Harnois-Leblanc, Victor Schmidt, Pierre-Luc St. Charles, Tristan Deleu, Andrew Williams, Akshay Patel, Meng Qu, Olexa Bilaniuk, Gaétan Marceau Caron, Pierre Luc Carrier, Satya Ortiz-Gagné, Marc-Andre Rousseau, David Buckeridge, Joumana Ghosn, Yang Zhang, Bernhard Schölkopf, Jian Tang, Irina Rish, Christopher Pal, Joanna Merckx, Eilif B. Muller, Yoshua Bengio

Figure 1 for COVI-AgentSim: an Agent-based Model for Evaluating Methods of Digital Contact Tracing
Figure 2 for COVI-AgentSim: an Agent-based Model for Evaluating Methods of Digital Contact Tracing
Figure 3 for COVI-AgentSim: an Agent-based Model for Evaluating Methods of Digital Contact Tracing
Figure 4 for COVI-AgentSim: an Agent-based Model for Evaluating Methods of Digital Contact Tracing

  Access Paper or Ask Questions

Predicting Infectiousness for Proactive Contact Tracing


Oct 23, 2020
Yoshua Bengio, Prateek Gupta, Tegan Maharaj, Nasim Rahaman, Martin Weiss, Tristan Deleu, Eilif Muller, Meng Qu, Victor Schmidt, Pierre-Luc St-Charles, Hannah Alsdurf, Olexa Bilanuik, David Buckeridge, Gáetan Marceau Caron, Pierre-Luc Carrier, Joumana Ghosn, Satya Ortiz-Gagne, Chris Pal, Irina Rish, Bernhard Schölkopf, Abhinav Sharma, Jian Tang, Andrew Williams

Figure 1 for Predicting Infectiousness for Proactive Contact Tracing
Figure 2 for Predicting Infectiousness for Proactive Contact Tracing
Figure 3 for Predicting Infectiousness for Proactive Contact Tracing
Figure 4 for Predicting Infectiousness for Proactive Contact Tracing

  Access Paper or Ask Questions

NU-GAN: High resolution neural upsampling with GAN


Oct 22, 2020
Rithesh Kumar, Kundan Kumar, Vicki Anand, Yoshua Bengio, Aaron Courville

Figure 1 for NU-GAN: High resolution neural upsampling with GAN
Figure 2 for NU-GAN: High resolution neural upsampling with GAN
Figure 3 for NU-GAN: High resolution neural upsampling with GAN

  Access Paper or Ask Questions

Cross-Modal Information Maximization for Medical Imaging: CMIM


Oct 20, 2020
Tristan Sylvain, Francis Dutil, Tess Berthier, Lisa Di Jorio, Margaux Luck, Devon Hjelm, Yoshua Bengio

Figure 1 for Cross-Modal Information Maximization for Medical Imaging: CMIM
Figure 2 for Cross-Modal Information Maximization for Medical Imaging: CMIM
Figure 3 for Cross-Modal Information Maximization for Medical Imaging: CMIM

  Access Paper or Ask Questions

Neural Function Modules with Sparse Arguments: A Dynamic Approach to Integrating Information across Layers


Oct 15, 2020
Alex Lamb, Anirudh Goyal, Agnieszka Słowik, Michael Mozer, Philippe Beaudoin, Yoshua Bengio

Figure 1 for Neural Function Modules with Sparse Arguments: A Dynamic Approach to Integrating Information across Layers
Figure 2 for Neural Function Modules with Sparse Arguments: A Dynamic Approach to Integrating Information across Layers
Figure 3 for Neural Function Modules with Sparse Arguments: A Dynamic Approach to Integrating Information across Layers
Figure 4 for Neural Function Modules with Sparse Arguments: A Dynamic Approach to Integrating Information across Layers

  Access Paper or Ask Questions

CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning


Oct 08, 2020
Ossama Ahmed, Frederik Träuble, Anirudh Goyal, Alexander Neitz, Manuel Wüthrich, Yoshua Bengio, Bernhard Schölkopf, Stefan Bauer

Figure 1 for CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning
Figure 2 for CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning
Figure 3 for CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning
Figure 4 for CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning
* The first two authors contributed equally 
  Access Paper or Ask Questions

RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphs


Oct 08, 2020
Meng Qu, Junkun Chen, Louis-Pascal Xhonneux, Yoshua Bengio, Jian Tang

Figure 1 for RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphs
Figure 2 for RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphs
Figure 3 for RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphs
Figure 4 for RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphs

  Access Paper or Ask Questions

Visual Concept Reasoning Networks


Aug 26, 2020
Taesup Kim, Sungwoong Kim, Yoshua Bengio

Figure 1 for Visual Concept Reasoning Networks
Figure 2 for Visual Concept Reasoning Networks
Figure 3 for Visual Concept Reasoning Networks
Figure 4 for Visual Concept Reasoning Networks
* Preprint 
  Access Paper or Ask Questions

Deriving Differential Target Propagation from Iterating Approximate Inverses


Aug 17, 2020
Yoshua Bengio


  Access Paper or Ask Questions

Mastering Rate based Curriculum Learning


Aug 14, 2020
Lucas Willems, Salem Lahlou, Yoshua Bengio

Figure 1 for Mastering Rate based Curriculum Learning
Figure 2 for Mastering Rate based Curriculum Learning
Figure 3 for Mastering Rate based Curriculum Learning
Figure 4 for Mastering Rate based Curriculum Learning

  Access Paper or Ask Questions

BabyAI 1.1


Jul 24, 2020
David Yu-Tung Hui, Maxime Chevalier-Boisvert, Dzmitry Bahdanau, Yoshua Bengio

Figure 1 for BabyAI 1.1
Figure 2 for BabyAI 1.1
Figure 3 for BabyAI 1.1
Figure 4 for BabyAI 1.1
* 9 pages, 1 figure, technical report 
  Access Paper or Ask Questions

Revisiting Fundamentals of Experience Replay


Jul 13, 2020
William Fedus, Prajit Ramachandran, Rishabh Agarwal, Yoshua Bengio, Hugo Larochelle, Mark Rowland, Will Dabney

Figure 1 for Revisiting Fundamentals of Experience Replay
Figure 2 for Revisiting Fundamentals of Experience Replay
Figure 3 for Revisiting Fundamentals of Experience Replay
Figure 4 for Revisiting Fundamentals of Experience Replay
* Published at ICML 2020. First two authors contributed equally and code available at https://github.com/google-research/google-research/tree/master/experience_replay 
  Access Paper or Ask Questions

S2RMs: Spatially Structured Recurrent Modules


Jul 13, 2020
Nasim Rahaman, Anirudh Goyal, Muhammad Waleed Gondal, Manuel Wuthrich, Stefan Bauer, Yash Sharma, Yoshua Bengio, Bernhard Schölkopf

Figure 1 for S2RMs: Spatially Structured Recurrent Modules
Figure 2 for S2RMs: Spatially Structured Recurrent Modules
Figure 3 for S2RMs: Spatially Structured Recurrent Modules
Figure 4 for S2RMs: Spatially Structured Recurrent Modules

  Access Paper or Ask Questions

Rethinking Distributional Matching Based Domain Adaptation


Jul 03, 2020
Bo Li, Yezhen Wang, Tong Che, Shanghang Zhang, Sicheng Zhao, Pengfei Xu, Wei Zhou, Yoshua Bengio, Kurt Keutzer

Figure 1 for Rethinking Distributional Matching Based Domain Adaptation
Figure 2 for Rethinking Distributional Matching Based Domain Adaptation
Figure 3 for Rethinking Distributional Matching Based Domain Adaptation
Figure 4 for Rethinking Distributional Matching Based Domain Adaptation
* Preprint version 
  Access Paper or Ask Questions

Object Files and Schemata: Factorizing Declarative and Procedural Knowledge in Dynamical Systems


Jun 30, 2020
Anirudh Goyal, Alex Lamb, Phanideep Gampa, Philippe Beaudoin, Sergey Levine, Charles Blundell, Yoshua Bengio, Michael Mozer

Figure 1 for Object Files and Schemata: Factorizing Declarative and Procedural Knowledge in Dynamical Systems
Figure 2 for Object Files and Schemata: Factorizing Declarative and Procedural Knowledge in Dynamical Systems
Figure 3 for Object Files and Schemata: Factorizing Declarative and Procedural Knowledge in Dynamical Systems
Figure 4 for Object Files and Schemata: Factorizing Declarative and Procedural Knowledge in Dynamical Systems
* Under Review, NeurIPS 2020 
  Access Paper or Ask Questions