Picture for Ohad Shamir

Ohad Shamir

Initialization-Dependent Sample Complexity of Linear Predictors and Neural Networks

May 25, 2023
Roey Magen, Ohad Shamir

* 30 pages

Access Paper or Ask Questions

From Tempered to Benign Overfitting in ReLU Neural Networks

May 24, 2023
Guy Kornowski, Gilad Yehudai, Ohad Shamir

* 43 pages

Access Paper or Ask Questions

Deterministic Nonsmooth Nonconvex Optimization

Feb 16, 2023
Michael I. Jordan, Guy Kornowski, Tianyi Lin, Ohad Shamir, Manolis Zampetakis

* This work supersedes arxiv:2209.12463 and arxiv:2209.10346[Section 3], with major additional results

Access Paper or Ask Questions

On the Complexity of Finding Small Subgradients in Nonsmooth Optimization

Sep 21, 2022
Guy Kornowski, Ohad Shamir

Figure 1 for On the Complexity of Finding Small Subgradients in Nonsmooth Optimization

* 18 pages

Access Paper or Ask Questions

The Sample Complexity of One-Hidden-Layer Neural Networks

Feb 13, 2022
Gal Vardi, Ohad Shamir, Nathan Srebro

Figure 1 for The Sample Complexity of One-Hidden-Layer Neural Networks

* 34 pages

Access Paper or Ask Questions

The Implicit Bias of Benign Overfitting

Feb 13, 2022
Ohad Shamir

Figure 1 for The Implicit Bias of Benign Overfitting

* Some minor edits

Access Paper or Ask Questions

Gradient Methods Provably Converge to Non-Robust Networks

Feb 09, 2022
Gal Vardi, Gilad Yehudai, Ohad Shamir

Figure 1 for Gradient Methods Provably Converge to Non-Robust Networks

Figure 2 for Gradient Methods Provably Converge to Non-Robust Networks

Access Paper or Ask Questions

Width is Less Important than Depth in ReLU Neural Networks

Feb 08, 2022
Gal Vardi, Gilad Yehudai, Ohad Shamir

Access Paper or Ask Questions

Implicit Regularization Towards Rank Minimization in ReLU Networks

Jan 30, 2022
Nadav Timor, Gal Vardi, Ohad Shamir

Figure 1 for Implicit Regularization Towards Rank Minimization in ReLU Networks

Figure 2 for Implicit Regularization Towards Rank Minimization in ReLU Networks

Figure 3 for Implicit Regularization Towards Rank Minimization in ReLU Networks

Access Paper or Ask Questions