Alert button
Picture for Surya Ganguli

Surya Ganguli

Alert button

Disentangling with Biological Constraints: A Theory of Functional Cell Types

Sep 30, 2022
James C. R. Whittington, Will Dorrell, Surya Ganguli, Timothy E. J. Behrens

Figure 1 for Disentangling with Biological Constraints: A Theory of Functional Cell Types
Figure 2 for Disentangling with Biological Constraints: A Theory of Functional Cell Types
Figure 3 for Disentangling with Biological Constraints: A Theory of Functional Cell Types
Figure 4 for Disentangling with Biological Constraints: A Theory of Functional Cell Types
Viaarxiv icon

Beyond neural scaling laws: beating power law scaling via data pruning

Jun 29, 2022
Ben Sorscher, Robert Geirhos, Shashank Shekhar, Surya Ganguli, Ari S. Morcos

Figure 1 for Beyond neural scaling laws: beating power law scaling via data pruning
Figure 2 for Beyond neural scaling laws: beating power law scaling via data pruning
Figure 3 for Beyond neural scaling laws: beating power law scaling via data pruning
Figure 4 for Beyond neural scaling laws: beating power law scaling via data pruning
Viaarxiv icon

Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks

Jun 02, 2022
Mansheej Paul, Brett W. Larsen, Surya Ganguli, Jonathan Frankle, Gintare Karolina Dziugaite

Figure 1 for Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks
Figure 2 for Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks
Figure 3 for Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks
Figure 4 for Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks
Viaarxiv icon

MetaMorph: Learning Universal Controllers with Transformers

Mar 22, 2022
Agrim Gupta, Linxi Fan, Surya Ganguli, Li Fei-Fei

Figure 1 for MetaMorph: Learning Universal Controllers with Transformers
Figure 2 for MetaMorph: Learning Universal Controllers with Transformers
Figure 3 for MetaMorph: Learning Universal Controllers with Transformers
Figure 4 for MetaMorph: Learning Universal Controllers with Transformers
Viaarxiv icon

Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion

Jul 19, 2021
Daniel Kunin, Javier Sagastuy-Brena, Lauren Gillespie, Eshed Margalit, Hidenori Tanaka, Surya Ganguli, Daniel L. K. Yamins

Figure 1 for Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion
Figure 2 for Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion
Figure 3 for Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion
Figure 4 for Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion
Viaarxiv icon

Deep Learning on a Data Diet: Finding Important Examples Early in Training

Jul 15, 2021
Mansheej Paul, Surya Ganguli, Gintare Karolina Dziugaite

Figure 1 for Deep Learning on a Data Diet: Finding Important Examples Early in Training
Figure 2 for Deep Learning on a Data Diet: Finding Important Examples Early in Training
Figure 3 for Deep Learning on a Data Diet: Finding Important Examples Early in Training
Figure 4 for Deep Learning on a Data Diet: Finding Important Examples Early in Training
Viaarxiv icon

How many degrees of freedom do we need to train deep networks: a loss landscape perspective

Jul 13, 2021
Brett W. Larsen, Stanislav Fort, Nic Becker, Surya Ganguli

Figure 1 for How many degrees of freedom do we need to train deep networks: a loss landscape perspective
Figure 2 for How many degrees of freedom do we need to train deep networks: a loss landscape perspective
Figure 3 for How many degrees of freedom do we need to train deep networks: a loss landscape perspective
Figure 4 for How many degrees of freedom do we need to train deep networks: a loss landscape perspective
Viaarxiv icon

Understanding self-supervised Learning Dynamics without Contrastive Pairs

Feb 12, 2021
Yuandong Tian, Xinlei Chen, Surya Ganguli

Figure 1 for Understanding self-supervised Learning Dynamics without Contrastive Pairs
Figure 2 for Understanding self-supervised Learning Dynamics without Contrastive Pairs
Figure 3 for Understanding self-supervised Learning Dynamics without Contrastive Pairs
Figure 4 for Understanding self-supervised Learning Dynamics without Contrastive Pairs
Viaarxiv icon

Embodied Intelligence via Learning and Evolution

Feb 03, 2021
Agrim Gupta, Silvio Savarese, Surya Ganguli, Li Fei-Fei

Figure 1 for Embodied Intelligence via Learning and Evolution
Figure 2 for Embodied Intelligence via Learning and Evolution
Figure 3 for Embodied Intelligence via Learning and Evolution
Figure 4 for Embodied Intelligence via Learning and Evolution
Viaarxiv icon

Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics

Dec 08, 2020
Daniel Kunin, Javier Sagastuy-Brena, Surya Ganguli, Daniel L. K. Yamins, Hidenori Tanaka

Figure 1 for Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
Figure 2 for Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
Figure 3 for Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
Figure 4 for Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
Viaarxiv icon