Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Martin Jaggi

On Second-order Optimization Methods for Federated Learning


Sep 06, 2021
Sebastian Bischoff, Stephan GĂĽnnemann, Martin Jaggi, Sebastian U. Stich

* ICML 2021 Workshop "Beyond first-order methods in ML systems" 

  Access Paper or Ask Questions

Semantic Perturbations with Normalizing Flows for Improved Generalization


Aug 18, 2021
Oguz Kaan Yuksel, Sebastian U. Stich, Martin Jaggi, Tatjana Chavdarova

* In Proceedings of the IEEE International Conference on Computer Vision 

  Access Paper or Ask Questions

A Field Guide to Federated Optimization


Jul 14, 2021
Jianyu Wang, Zachary Charles, Zheng Xu, Gauri Joshi, H. Brendan McMahan, Blaise Aguera y Arcas, Maruan Al-Shedivat, Galen Andrew, Salman Avestimehr, Katharine Daly, Deepesh Data, Suhas Diggavi, Hubert Eichner, Advait Gadhikar, Zachary Garrett, Antonious M. Girgis, Filip Hanzely, Andrew Hard, Chaoyang He, Samuel Horvath, Zhouyuan Huo, Alex Ingerman, Martin Jaggi, Tara Javidi, Peter Kairouz, Satyen Kale, Sai Praneeth Karimireddy, Jakub Konecny, Sanmi Koyejo, Tian Li, Luyang Liu, Mehryar Mohri, Hang Qi, Sashank J. Reddi, Peter Richtarik, Karan Singhal, Virginia Smith, Mahdi Soltanolkotabi, Weikang Song, Ananda Theertha Suresh, Sebastian U. Stich, Ameet Talwalkar, Hongyi Wang, Blake Woodworth, Shanshan Wu, Felix X. Yu, Honglin Yuan, Manzil Zaheer, Mi Zhang, Tong Zhang, Chunxiang Zheng, Chen Zhu, Wennan Zhu


  Access Paper or Ask Questions

IFedAvg: Interpretable Data-Interoperability for Federated Learning


Jul 14, 2021
David Roschewitz, Mary-Anne Hartley, Luca Corinzia, Martin Jaggi


  Access Paper or Ask Questions

Implicit Gradient Alignment in Distributed and Federated Learning


Jun 25, 2021
Yatin Dandi, Luis Barba, Martin Jaggi


  Access Paper or Ask Questions

Simultaneous Training of Partially Masked Neural Networks


Jun 16, 2021
Amirkeivan Mohtashami, Martin Jaggi, Sebastian U. Stich


  Access Paper or Ask Questions

Lightweight Cross-Lingual Sentence Representation Learning


Jun 12, 2021
Zhuoyuan Mao, Prakhar Gupta, Chenhui Chu, Martin Jaggi, Sadao Kurohashi

* ACL 2021 

  Access Paper or Ask Questions

Obtaining Better Static Word Embeddings Using Contextual Embedding Models


Jun 08, 2021
Prakhar Gupta, Martin Jaggi

* ACL 2021 accept 

  Access Paper or Ask Questions

Federated Learning for Malware Detection in IoT Devices


Apr 15, 2021
Valerian Rey, Pedro Miguel Sánchez Sánchez, Alberto Huertas Celdrán, Gérôme Bovet, Martin Jaggi


  Access Paper or Ask Questions

Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates


Mar 03, 2021
Sebastian U. Stich, Amirkeivan Mohtashami, Martin Jaggi

* Proceedings of the 24th International Conference on Artificial Intelligence and Statistics (AISTATS) 2021 

  Access Paper or Ask Questions

Consensus Control for Decentralized Deep Learning


Feb 09, 2021
Lingjing Kong, Tao Lin, Anastasia Koloskova, Martin Jaggi, Sebastian U. Stich

* LK and TL contribute equally 

  Access Paper or Ask Questions

Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data


Feb 09, 2021
Tao Lin, Sai Praneeth Karimireddy, Sebastian U. Stich, Martin Jaggi


  Access Paper or Ask Questions

Exact Optimization of Conformal Predictors via Incremental and Decremental Learning


Feb 05, 2021
Giovanni Cherubin, Konstantinos Chatzikokolakis, Martin Jaggi


  Access Paper or Ask Questions

Learning from History for Byzantine Robust Optimization


Dec 18, 2020
Sai Praneeth Karimireddy, Lie He, Martin Jaggi

* 22 pages, 5 figures 

  Access Paper or Ask Questions

A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!


Nov 03, 2020
Dmitry Kovalev, Anastasia Koloskova, Martin Jaggi, Peter Richtarik, Sebastian U. Stich


  Access Paper or Ask Questions

Sparse Communication for Training Deep Networks


Sep 19, 2020
Negar Foroutan Eghlidi, Martin Jaggi


  Access Paper or Ask Questions

Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning


Aug 08, 2020
Sai Praneeth Karimireddy, Martin Jaggi, Satyen Kale, Mehryar Mohri, Sashank J. Reddi, Sebastian U. Stich, Ananda Theertha Suresh


  Access Paper or Ask Questions

PowerGossip: Practical Low-Rank Communication Compression in Decentralized Deep Learning


Aug 04, 2020
Thijs Vogels, Sai Praneeth Karimireddy, Martin Jaggi


  Access Paper or Ask Questions

Multi-Head Attention: Collaborate Instead of Concatenate


Jun 29, 2020
Jean-Baptiste Cordonnier, Andreas Loukas, Martin Jaggi


  Access Paper or Ask Questions

Taming GANs with Lookahead


Jun 25, 2020
Tatjana Chavdarova, Matteo Pagliardini, Martin Jaggi, Francois Fleuret


  Access Paper or Ask Questions

Byzantine-Robust Learning on Heterogeneous Datasets via Resampling


Jun 23, 2020
Lie He, Sai Praneeth Karimireddy, Martin Jaggi


  Access Paper or Ask Questions

Dynamic Model Pruning with Feedback


Jun 12, 2020
Tao Lin, Sebastian U. Stich, Luis Barba, Daniil Dmitriev, Martin Jaggi

* appearing at ICLR 2020 

  Access Paper or Ask Questions

Ensemble Distillation for Robust Model Fusion in Federated Learning


Jun 12, 2020
Tao Lin, Lingjing Kong, Sebastian U. Stich, Martin Jaggi


  Access Paper or Ask Questions

Extrapolation for Large-batch Training in Deep Learning


Jun 10, 2020
Tao Lin, Lingjing Kong, Sebastian U. Stich, Martin Jaggi


  Access Paper or Ask Questions

Secure Byzantine-Robust Machine Learning


Jun 08, 2020
Lie He, Sai Praneeth Karimireddy, Martin Jaggi


  Access Paper or Ask Questions

Masking as an Efficient Alternative to Finetuning for Pretrained Language Models


Apr 26, 2020
Mengjie Zhao, Tao Lin, Martin Jaggi, Hinrich SchĂĽtze


  Access Paper or Ask Questions

Data Parallelism in Training Sparse Neural Networks


Mar 25, 2020
Namhoon Lee, Philip H. S. Torr, Martin Jaggi

* ICLR 2020 workshop on PML4DC: Learning under limited/low resource scenarios 

  Access Paper or Ask Questions

A Unified Theory of Decentralized SGD with Changing Topology and Local Updates


Mar 23, 2020
Anastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi, Sebastian U. Stich


  Access Paper or Ask Questions