Picture for Ohad Shamir

Ohad Shamir

Implicit Regularization Towards Rank Minimization in ReLU Networks

Add code
Jan 30, 2022
Figure 1 for Implicit Regularization Towards Rank Minimization in ReLU Networks
Figure 2 for Implicit Regularization Towards Rank Minimization in ReLU Networks
Figure 3 for Implicit Regularization Towards Rank Minimization in ReLU Networks
Viaarxiv icon

Replay For Safety

Add code
Dec 08, 2021
Figure 1 for Replay For Safety
Figure 2 for Replay For Safety
Viaarxiv icon

Convergence Results For Q-Learning With Experience Replay

Add code
Dec 08, 2021
Figure 1 for Convergence Results For Q-Learning With Experience Replay
Figure 2 for Convergence Results For Q-Learning With Experience Replay
Figure 3 for Convergence Results For Q-Learning With Experience Replay
Viaarxiv icon

A Stochastic Newton Algorithm for Distributed Convex Optimization

Add code
Oct 07, 2021
Figure 1 for A Stochastic Newton Algorithm for Distributed Convex Optimization
Figure 2 for A Stochastic Newton Algorithm for Distributed Convex Optimization
Figure 3 for A Stochastic Newton Algorithm for Distributed Convex Optimization
Figure 4 for A Stochastic Newton Algorithm for Distributed Convex Optimization
Viaarxiv icon

On Margin Maximization in Linear and ReLU Networks

Add code
Oct 07, 2021
Figure 1 for On Margin Maximization in Linear and ReLU Networks
Figure 2 for On Margin Maximization in Linear and ReLU Networks
Figure 3 for On Margin Maximization in Linear and ReLU Networks
Viaarxiv icon

On the Optimal Memorization Power of ReLU Neural Networks

Add code
Oct 07, 2021
Viaarxiv icon

Random Shuffling Beats SGD Only After Many Epochs on Ill-Conditioned Problems

Add code
Jun 12, 2021
Figure 1 for Random Shuffling Beats SGD Only After Many Epochs on Ill-Conditioned Problems
Figure 2 for Random Shuffling Beats SGD Only After Many Epochs on Ill-Conditioned Problems
Viaarxiv icon

Learning a Single Neuron with Bias Using Gradient Descent

Add code
Jun 02, 2021
Figure 1 for Learning a Single Neuron with Bias Using Gradient Descent
Figure 2 for Learning a Single Neuron with Bias Using Gradient Descent
Viaarxiv icon

Oracle Complexity in Nonsmooth Nonconvex Optimization

Add code
Apr 14, 2021
Figure 1 for Oracle Complexity in Nonsmooth Nonconvex Optimization
Figure 2 for Oracle Complexity in Nonsmooth Nonconvex Optimization
Figure 3 for Oracle Complexity in Nonsmooth Nonconvex Optimization
Figure 4 for Oracle Complexity in Nonsmooth Nonconvex Optimization
Viaarxiv icon

Size and Depth Separation in Approximating Natural Functions with Neural Networks

Add code
Feb 03, 2021
Viaarxiv icon