Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Martin Jaggi

Martin Jaggi

EPFL

Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates

Mar 03, 2021
Sebastian U. Stich, Amirkeivan Mohtashami, Martin Jaggi

Figure 1 for Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates

Figure 2 for Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates

Figure 3 for Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates

Figure 4 for Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates

* Proceedings of the 24th International Conference on Artificial Intelligence and Statistics (AISTATS) 2021

Access Paper or Ask Questions

Consensus Control for Decentralized Deep Learning

Feb 09, 2021
Lingjing Kong, Tao Lin, Anastasia Koloskova, Martin Jaggi, Sebastian U. Stich

Figure 1 for Consensus Control for Decentralized Deep Learning

Figure 2 for Consensus Control for Decentralized Deep Learning

Figure 3 for Consensus Control for Decentralized Deep Learning

Figure 4 for Consensus Control for Decentralized Deep Learning

* LK and TL contribute equally

Access Paper or Ask Questions

Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data

Feb 09, 2021
Tao Lin, Sai Praneeth Karimireddy, Sebastian U. Stich, Martin Jaggi

Figure 1 for Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data

Figure 2 for Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data

Figure 3 for Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data

Figure 4 for Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data

Access Paper or Ask Questions

Exact Optimization of Conformal Predictors via Incremental and Decremental Learning

Feb 05, 2021
Giovanni Cherubin, Konstantinos Chatzikokolakis, Martin Jaggi

Figure 1 for Exact Optimization of Conformal Predictors via Incremental and Decremental Learning

Figure 2 for Exact Optimization of Conformal Predictors via Incremental and Decremental Learning

Figure 3 for Exact Optimization of Conformal Predictors via Incremental and Decremental Learning

Figure 4 for Exact Optimization of Conformal Predictors via Incremental and Decremental Learning

Access Paper or Ask Questions

Learning from History for Byzantine Robust Optimization

Dec 18, 2020
Sai Praneeth Karimireddy, Lie He, Martin Jaggi

Figure 1 for Learning from History for Byzantine Robust Optimization

Figure 2 for Learning from History for Byzantine Robust Optimization

Figure 3 for Learning from History for Byzantine Robust Optimization

Figure 4 for Learning from History for Byzantine Robust Optimization

* 22 pages, 5 figures

Access Paper or Ask Questions

A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!

Nov 03, 2020
Dmitry Kovalev, Anastasia Koloskova, Martin Jaggi, Peter Richtarik, Sebastian U. Stich

Figure 1 for A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!

Figure 2 for A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!

Figure 3 for A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!

Figure 4 for A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!

Access Paper or Ask Questions

Sparse Communication for Training Deep Networks

Sep 19, 2020
Negar Foroutan Eghlidi, Martin Jaggi

Figure 1 for Sparse Communication for Training Deep Networks

Figure 2 for Sparse Communication for Training Deep Networks

Figure 3 for Sparse Communication for Training Deep Networks

Access Paper or Ask Questions

PowerGossip: Practical Low-Rank Communication Compression in Decentralized Deep Learning

Aug 04, 2020
Thijs Vogels, Sai Praneeth Karimireddy, Martin Jaggi

Access Paper or Ask Questions

Multi-Head Attention: Collaborate Instead of Concatenate

Jun 29, 2020
Jean-Baptiste Cordonnier, Andreas Loukas, Martin Jaggi

Figure 1 for Multi-Head Attention: Collaborate Instead of Concatenate

Figure 2 for Multi-Head Attention: Collaborate Instead of Concatenate

Figure 3 for Multi-Head Attention: Collaborate Instead of Concatenate

Figure 4 for Multi-Head Attention: Collaborate Instead of Concatenate

Access Paper or Ask Questions

Taming GANs with Lookahead

Jun 25, 2020
Tatjana Chavdarova, Matteo Pagliardini, Martin Jaggi, Francois Fleuret

Figure 1 for Taming GANs with Lookahead

Figure 2 for Taming GANs with Lookahead

Figure 3 for Taming GANs with Lookahead

Figure 4 for Taming GANs with Lookahead

Access Paper or Ask Questions

Byzantine-Robust Learning on Heterogeneous Datasets via Resampling

Jun 23, 2020
Lie He, Sai Praneeth Karimireddy, Martin Jaggi

Figure 1 for Byzantine-Robust Learning on Heterogeneous Datasets via Resampling

Figure 2 for Byzantine-Robust Learning on Heterogeneous Datasets via Resampling

Figure 3 for Byzantine-Robust Learning on Heterogeneous Datasets via Resampling

Figure 4 for Byzantine-Robust Learning on Heterogeneous Datasets via Resampling

Access Paper or Ask Questions

Dynamic Model Pruning with Feedback

Jun 12, 2020
Tao Lin, Sebastian U. Stich, Luis Barba, Daniil Dmitriev, Martin Jaggi

Figure 1 for Dynamic Model Pruning with Feedback

Figure 2 for Dynamic Model Pruning with Feedback

Figure 3 for Dynamic Model Pruning with Feedback

Figure 4 for Dynamic Model Pruning with Feedback

* appearing at ICLR 2020

Access Paper or Ask Questions

Ensemble Distillation for Robust Model Fusion in Federated Learning

Jun 12, 2020
Tao Lin, Lingjing Kong, Sebastian U. Stich, Martin Jaggi

Figure 1 for Ensemble Distillation for Robust Model Fusion in Federated Learning

Figure 2 for Ensemble Distillation for Robust Model Fusion in Federated Learning

Figure 3 for Ensemble Distillation for Robust Model Fusion in Federated Learning

Figure 4 for Ensemble Distillation for Robust Model Fusion in Federated Learning

Access Paper or Ask Questions

Extrapolation for Large-batch Training in Deep Learning

Jun 10, 2020
Tao Lin, Lingjing Kong, Sebastian U. Stich, Martin Jaggi

Figure 1 for Extrapolation for Large-batch Training in Deep Learning

Figure 2 for Extrapolation for Large-batch Training in Deep Learning

Figure 3 for Extrapolation for Large-batch Training in Deep Learning

Figure 4 for Extrapolation for Large-batch Training in Deep Learning

Access Paper or Ask Questions

Secure Byzantine-Robust Machine Learning

Jun 08, 2020
Lie He, Sai Praneeth Karimireddy, Martin Jaggi

Figure 1 for Secure Byzantine-Robust Machine Learning

Figure 2 for Secure Byzantine-Robust Machine Learning

Figure 3 for Secure Byzantine-Robust Machine Learning

Access Paper or Ask Questions

Masking as an Efficient Alternative to Finetuning for Pretrained Language Models

Apr 26, 2020
Mengjie Zhao, Tao Lin, Martin Jaggi, Hinrich Schütze

Figure 1 for Masking as an Efficient Alternative to Finetuning for Pretrained Language Models

Figure 2 for Masking as an Efficient Alternative to Finetuning for Pretrained Language Models

Figure 3 for Masking as an Efficient Alternative to Finetuning for Pretrained Language Models

Figure 4 for Masking as an Efficient Alternative to Finetuning for Pretrained Language Models

Access Paper or Ask Questions

Data Parallelism in Training Sparse Neural Networks

Mar 25, 2020
Namhoon Lee, Philip H. S. Torr, Martin Jaggi

Figure 1 for Data Parallelism in Training Sparse Neural Networks

Figure 2 for Data Parallelism in Training Sparse Neural Networks

Figure 3 for Data Parallelism in Training Sparse Neural Networks

Figure 4 for Data Parallelism in Training Sparse Neural Networks

* ICLR 2020 workshop on PML4DC: Learning under limited/low resource scenarios

Access Paper or Ask Questions

A Unified Theory of Decentralized SGD with Changing Topology and Local Updates

Mar 23, 2020
Anastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi, Sebastian U. Stich

Figure 1 for A Unified Theory of Decentralized SGD with Changing Topology and Local Updates

Figure 2 for A Unified Theory of Decentralized SGD with Changing Topology and Local Updates

Figure 3 for A Unified Theory of Decentralized SGD with Changing Topology and Local Updates

Figure 4 for A Unified Theory of Decentralized SGD with Changing Topology and Local Updates

Access Paper or Ask Questions

Robust Cross-lingual Embeddings from Parallel Sentences

Dec 28, 2019
Ali Sabet, Prakhar Gupta, Jean-Baptiste Cordonnier, Robert West, Martin Jaggi

Figure 1 for Robust Cross-lingual Embeddings from Parallel Sentences

Figure 2 for Robust Cross-lingual Embeddings from Parallel Sentences

Figure 3 for Robust Cross-lingual Embeddings from Parallel Sentences

Figure 4 for Robust Cross-lingual Embeddings from Parallel Sentences

Access Paper or Ask Questions

Advances and Open Problems in Federated Learning

Dec 10, 2019
Peter Kairouz, H. Brendan McMahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Keith Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, Rafael G. L. D'Oliveira, Salim El Rouayheb, David Evans, Josh Gardner, Zachary Garrett, Adrià Gascón, Badih Ghazi, Phillip B. Gibbons, Marco Gruteser, Zaid Harchaoui, Chaoyang He, Lie He, Zhouyuan Huo, Ben Hutchinson, Justin Hsu, Martin Jaggi, Tara Javidi, Gauri Joshi, Mikhail Khodak, Jakub Konečný, Aleksandra Korolova, Farinaz Koushanfar, Sanmi Koyejo, Tancrède Lepoint, Yang Liu, Prateek Mittal, Mehryar Mohri, Richard Nock, Ayfer Özgür, Rasmus Pagh, Mariana Raykova, Hang Qi, Daniel Ramage, Ramesh Raskar, Dawn Song, Weikang Song, Sebastian U. Stich, Ziteng Sun, Ananda Theertha Suresh, Florian Tramèr, Praneeth Vepakomma, Jianyu Wang, Li Xiong, Zheng Xu, Qiang Yang, Felix X. Yu, Han Yu, Sen Zhao

Figure 1 for Advances and Open Problems in Federated Learning

Figure 2 for Advances and Open Problems in Federated Learning

Figure 3 for Advances and Open Problems in Federated Learning

Figure 4 for Advances and Open Problems in Federated Learning

Access Paper or Ask Questions

On the Relationship between Self-Attention and Convolutional Layers

Nov 08, 2019
Jean-Baptiste Cordonnier, Andreas Loukas, Martin Jaggi

Figure 1 for On the Relationship between Self-Attention and Convolutional Layers

Figure 2 for On the Relationship between Self-Attention and Convolutional Layers

Figure 3 for On the Relationship between Self-Attention and Convolutional Layers

Figure 4 for On the Relationship between Self-Attention and Convolutional Layers

Access Paper or Ask Questions

On the Tunability of Optimizers in Deep Learning

Oct 25, 2019
Prabhu Teja Sivaprasad, Florian Mai, Thijs Vogels, Martin Jaggi, François Fleuret

Figure 1 for On the Tunability of Optimizers in Deep Learning

Figure 2 for On the Tunability of Optimizers in Deep Learning

Figure 3 for On the Tunability of Optimizers in Deep Learning

Figure 4 for On the Tunability of Optimizers in Deep Learning

* Under review at ICLR 2020. 16 pages, 8 figures

Access Paper or Ask Questions

Model Fusion via Optimal Transport

Oct 12, 2019
Sidak Pal Singh, Martin Jaggi

Figure 1 for Model Fusion via Optimal Transport

Figure 2 for Model Fusion via Optimal Transport

Figure 3 for Model Fusion via Optimal Transport

Figure 4 for Model Fusion via Optimal Transport

* Accepted at NeurIPS 2019: Optimal Transport & Machine Learning workshop

Access Paper or Ask Questions

Decentralized Deep Learning with Arbitrary Communication Compression

Jul 22, 2019
Anastasia Koloskova, Tao Lin, Sebastian U. Stich, Martin Jaggi

Figure 1 for Decentralized Deep Learning with Arbitrary Communication Compression

Figure 2 for Decentralized Deep Learning with Arbitrary Communication Compression

Figure 3 for Decentralized Deep Learning with Arbitrary Communication Compression

Figure 4 for Decentralized Deep Learning with Arbitrary Communication Compression

Access Paper or Ask Questions

Correlating Twitter Language with Community-Level Health Outcomes

Jun 24, 2019
Arno Schneuwly, Ralf Grubenmann, Séverine Rion Logean, Mark Cieliebak, Martin Jaggi

Figure 1 for Correlating Twitter Language with Community-Level Health Outcomes

Figure 2 for Correlating Twitter Language with Community-Level Health Outcomes

Figure 3 for Correlating Twitter Language with Community-Level Health Outcomes

Figure 4 for Correlating Twitter Language with Community-Level Health Outcomes

* ACL SMM4H Workshop (Social Media Mining for Health Applications)

Access Paper or Ask Questions

PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

May 31, 2019
Thijs Vogels, Sai Praneeth Karimireddy, Martin Jaggi

Figure 1 for PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Figure 2 for PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Figure 3 for PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Figure 4 for PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Access Paper or Ask Questions

On Linear Learning with Manycore Processors

May 03, 2019
Eliza Wszola, Celestine Mendler-Dünner, Martin Jaggi, Markus Püschel

Figure 1 for On Linear Learning with Manycore Processors

Figure 2 for On Linear Learning with Manycore Processors

Figure 3 for On Linear Learning with Manycore Processors

Figure 4 for On Linear Learning with Manycore Processors

Access Paper or Ask Questions