Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Parallel Coordinate Descent for L1-Regularized Loss Minimization

Add code

May 26, 2011
Joseph K. Bradley, Aapo Kyrola, Danny Bickson, Carlos Guestrin

Share this with someone who'll enjoy it:

We propose Shotgun, a parallel coordinate descent algorithm for minimizing L1-regularized losses. Though coordinate descent seems inherently sequential, we prove convergence bounds for Shotgun which predict linear speedups, up to a problem-dependent limit. We present a comprehensive empirical study of Shotgun for Lasso and sparse logistic regression. Our theoretical predictions on the potential for parallelism closely match behavior on real data. Shotgun outperforms other published solvers on a range of large problems, proving to be one of the most scalable algorithms for L1.

* In the 28th International Conference on Machine Learning, July 2011, Washington, USA 

   Access Paper Source

Share this with someone who'll enjoy it: