Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed

Stabilizing Bi-Level Hyperparameter Optimization using Moreau-Yosida Regularization

Jul 27, 2020
Sauptik Dhar, Unmesh Kurup, Mohak Shah

This research proposes to use the Moreau-Yosida envelope to stabilize the convergence behavior of bi-level Hyperparameter optimization solvers, and introduces the new algorithm called Moreau-Yosida regularized Hyperparameter Optimization (MY-HPO) algorithm. Theoretical analysis on the correctness of the MY-HPO solution and initial convergence analysis is also provided. Our empirical results show significant improvement in loss values for a fixed computation budget, compared to the state-of-art bi-level HPO solvers.

* AutoML, Hyperparameter Optimization (HPO), Bi-Level Optimization, Alternating Direction Method of Multipliers (ADMM) 

Share this with someone who'll enjoy it:

   Access Paper Source

Share this with someone who'll enjoy it: