FourierSAT: A Fourier Expansion-Based Algebraic Framework for Solving Hybrid Boolean Constraints

Dec 02, 2019
Anastasios Kyrillidis, Anshumali Shrivastava, Moshe Y. Vardi, Zhiwei Zhang

* The paper was accepted by Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI 2020) 

  Access Model/Code and Paper

Optimal Mini-Batch Size Selection for Fast Gradient Descent

Nov 15, 2019
Michael P. Perrone, Haidar Khan, Changhoan Kim, Anastasios Kyrillidis, Jerry Quinn, Valentina Salapura

  Access Model/Code and Paper

Negative sampling in semi-supervised learning

Nov 12, 2019
John Chen, Vatsal Shah, Anastasios Kyrillidis

  Access Model/Code and Paper

Learning Sparse Distributions using Iterative Hard Thresholding

Nov 07, 2019
Jacky Y. Zhang, Rajiv Khanna, Anastasios Kyrillidis, Oluwasanmi Koyejo

* NeurIPS 2019 

  Access Model/Code and Paper

Decaying momentum helps neural network training

Oct 11, 2019
John Chen, Anastasios Kyrillidis

  Access Model/Code and Paper

Distributed Learning of Deep Neural Networks using Independent Subnet Training

Oct 04, 2019
Binhang Yuan, Anastasios Kyrillidis, Christopher M. Jermaine

  Access Model/Code and Paper

SysML: The New Frontier of Machine Learning Systems

May 01, 2019
Alexander Ratner, Dan Alistarh, Gustavo Alonso, David G. Andersen, Peter Bailis, Sarah Bird, Nicholas Carlini, Bryan Catanzaro, Jennifer Chayes, Eric Chung, Bill Dally, Jeff Dean, Inderjit S. Dhillon, Alexandros Dimakis, Pradeep Dubey, Charles Elkan, Grigori Fursin, Gregory R. Ganger, Lise Getoor, Phillip B. Gibbons, Garth A. Gibson, Joseph E. Gonzalez, Justin Gottschlich, Song Han, Kim Hazelwood, Furong Huang, Martin Jaggi, Kevin Jamieson, Michael I. Jordan, Gauri Joshi, Rania Khalaf, Jason Knight, Jakub Konečný, Tim Kraska, Arun Kumar, Anastasios Kyrillidis, Aparna Lakshmiratan, Jing Li, Samuel Madden, H. Brendan McMahan, Erik Meijer, Ioannis Mitliagkas, Rajat Monga, Derek Murray, Kunle Olukotun, Dimitris Papailiopoulos, Gennady Pekhimenko, Theodoros Rekatsinas, Afshin Rostamizadeh, Christopher Ré, Christopher De Sa, Hanie Sedghi, Siddhartha Sen, Virginia Smith, Alex Smola, Dawn Song, Evan Sparks, Ion Stoica, Vivienne Sze, Madeleine Udell, Joaquin Vanschoren, Shivaram Venkataraman, Rashmi Vinayak, Markus Weimer, Andrew Gordon Wilson, Eric Xing, Matei Zaharia, Ce Zhang, Ameet Talwalkar

  Access Model/Code and Paper

Compressing Gradient Optimizers via Count-Sketches

Feb 26, 2019
Ryan Spring, Anastasios Kyrillidis, Vijai Mohan, Anshumali Shrivastava

* Initially submitted to WWW 2019 (November 2018) 

  Access Model/Code and Paper

Minimum norm solutions do not always generalize well for over-parameterized problems

Nov 16, 2018
Vatsal Shah, Anastasios Kyrillidis, Sujay Sanghavi

  Access Model/Code and Paper

Run Procrustes, Run! On the convergence of accelerated Procrustes Flow

Sep 12, 2018
Anastasios Kyrillidis, Shashanka Ubaru, Georgios Kollias, Kristofer Bouchard

* 33 pages, footnote 7 removed from previous version, improved constants 

  Access Model/Code and Paper

Implicit regularization and solution uniqueness in over-parameterized matrix sensing

Jun 06, 2018
Anastasios Kyrillidis, Amir Kalev

* 12 pages 

  Access Model/Code and Paper

Simple and practical algorithms for $\ell_p$-norm low-rank approximation

May 24, 2018
Anastasios Kyrillidis

* 16 pages, 11 figures, to appear in UAI 2018 

  Access Model/Code and Paper

Approximate Newton-based statistical inference using only stochastic gradients

May 23, 2018
Tianyang Li, Anastasios Kyrillidis, Liu Liu, Constantine Caramanis

  Access Model/Code and Paper

IHT dies hard: Provable accelerated Iterative Hard Thresholding

Dec 26, 2017
Rajiv Khanna, Anastasios Kyrillidis

* 22 pages, accepted to AISTATS 2018 

  Access Model/Code and Paper

Statistical inference using SGD

Nov 19, 2017
Tianyang Li, Liu Liu, Anastasios Kyrillidis, Constantine Caramanis

* To appear in AAAI 2018 

  Access Model/Code and Paper

Algorithms for Learning Sparse Additive Models with Interactions in High Dimensions

May 08, 2017
Hemant Tyagi, Anastasios Kyrillidis, Bernd Gärtner, Andreas Krause

* To appear in Information and Inference: A Journal of the IMA. Made following changes after review process: (a) Corrected typos throughout the text. (b) Corrected choice of sampling distribution in Section 5, see eqs. (5.2), (5.3). (c) More detailed comparison with existing work in Section 8. (d) Added Section B in appendix on roots of cubic equation 

  Access Model/Code and Paper

A single-phase, proximal path-following framework

Dec 25, 2016
Quoc Tran-Dinh, Anastasios Kyrillidis, Volkan Cevher

* 26 pages, 2 figures, 4 tables (This is the first revision. The original one was uploaded on arxiv on March 5, 2016 

  Access Model/Code and Paper

Finding Low-Rank Solutions via Non-Convex Matrix Factorization, Efficiently and Provably

Oct 29, 2016
Dohyung Park, Anastasios Kyrillidis, Constantine Caramanis, Sujay Sanghavi

* 45 pages 

  Access Model/Code and Paper

Provable Burer-Monteiro factorization for a class of norm-constrained matrix problems

Oct 01, 2016
Dohyung Park, Anastasios Kyrillidis, Srinadh Bhojanapalli, Constantine Caramanis, Sujay Sanghavi

* 28 pages 

  Access Model/Code and Paper

Non-square matrix sensing without spurious local minima via the Burer-Monteiro approach

Sep 27, 2016
Dohyung Park, Anastasios Kyrillidis, Constantine Caramanis, Sujay Sanghavi

* 14 pages, no figures 

  Access Model/Code and Paper

A simple and provable algorithm for sparse diagonal CCA

May 29, 2016
Megasthenis Asteris, Anastasios Kyrillidis, Oluwasanmi Koyejo, Russell Poldrack

* To appear at ICML 2016, 14 pages, 4 figures 

  Access Model/Code and Paper

Learning Sparse Additive Models with Interactions in High Dimensions

Apr 18, 2016
Hemant Tyagi, Anastasios Kyrillidis, Bernd Gärtner, Andreas Krause

* 23 pages, to appear in Proceedings of the 19th International Conference on Artificial Intelligence and Statistics (AISTATS) 2016 

  Access Model/Code and Paper

Dropping Convexity for Faster Semi-definite Optimization

Apr 16, 2016
Srinadh Bhojanapalli, Anastasios Kyrillidis, Sujay Sanghavi

* 40 pages 

  Access Model/Code and Paper

Convex block-sparse linear regression with expanders -- provably

Apr 03, 2016
Anastasios Kyrillidis, Bubacarr Bah, Rouzbeh Hasheminezhad, Quoc Tran-Dinh, Luca Baldassarre, Volkan Cevher

* 12 pages, 6 figures, to appear at AISTATS 

  Access Model/Code and Paper

Trading-off variance and complexity in stochastic gradient descent

Mar 22, 2016
Vatsal Shah, Megasthenis Asteris, Anastasios Kyrillidis, Sujay Sanghavi

* 14 pages, 13 figures, first edition on 9th of October 2015 

  Access Model/Code and Paper

Bipartite Correlation Clustering -- Maximizing Agreements

Mar 09, 2016
Megasthenis Asteris, Anastasios Kyrillidis, Dimitris Papailiopoulos, Alexandros G. Dimakis

* To appear in AISTATS 2016 

  Access Model/Code and Paper

Sparse PCA via Bipartite Matchings

Aug 04, 2015
Megasthenis Asteris, Dimitris Papailiopoulos, Anastasios Kyrillidis, Alexandros G. Dimakis

  Access Model/Code and Paper