Picture for Hossein Mobahi

Hossein Mobahi

Google Research

Neglected Hessian component explains mysteries in Sharpness regularization

Add code
Jan 24, 2024
Viaarxiv icon

On the Foundations of Shortcut Learning

Add code
Oct 24, 2023
Viaarxiv icon

Sharpness-Aware Minimization Leads to Low-Rank Features

Add code
May 25, 2023
Viaarxiv icon

On student-teacher deviations in distillation: does it pay to disobey?

Add code
Jan 30, 2023
Viaarxiv icon

Sharpness-Aware Minimization Improves Language Model Generalization

Add code
Oct 16, 2021
Figure 1 for Sharpness-Aware Minimization Improves Language Model Generalization
Figure 2 for Sharpness-Aware Minimization Improves Language Model Generalization
Figure 3 for Sharpness-Aware Minimization Improves Language Model Generalization
Figure 4 for Sharpness-Aware Minimization Improves Language Model Generalization
Viaarxiv icon

The Low-Rank Simplicity Bias in Deep Networks

Add code
Mar 18, 2021
Figure 1 for The Low-Rank Simplicity Bias in Deep Networks
Figure 2 for The Low-Rank Simplicity Bias in Deep Networks
Figure 3 for The Low-Rank Simplicity Bias in Deep Networks
Figure 4 for The Low-Rank Simplicity Bias in Deep Networks
Viaarxiv icon

NeurIPS 2020 Competition: Predicting Generalization in Deep Learning

Add code
Dec 14, 2020
Figure 1 for NeurIPS 2020 Competition: Predicting Generalization in Deep Learning
Viaarxiv icon

Data Augmentation via Structured Adversarial Perturbations

Add code
Nov 05, 2020
Figure 1 for Data Augmentation via Structured Adversarial Perturbations
Figure 2 for Data Augmentation via Structured Adversarial Perturbations
Figure 3 for Data Augmentation via Structured Adversarial Perturbations
Figure 4 for Data Augmentation via Structured Adversarial Perturbations
Viaarxiv icon

A Unifying View on Implicit Bias in Training Linear Neural Networks

Add code
Oct 06, 2020
Figure 1 for A Unifying View on Implicit Bias in Training Linear Neural Networks
Figure 2 for A Unifying View on Implicit Bias in Training Linear Neural Networks
Viaarxiv icon

Sharpness-Aware Minimization for Efficiently Improving Generalization

Add code
Oct 03, 2020
Figure 1 for Sharpness-Aware Minimization for Efficiently Improving Generalization
Figure 2 for Sharpness-Aware Minimization for Efficiently Improving Generalization
Figure 3 for Sharpness-Aware Minimization for Efficiently Improving Generalization
Figure 4 for Sharpness-Aware Minimization for Efficiently Improving Generalization
Viaarxiv icon