Alert button
Picture for Nikoli Dryden

Nikoli Dryden

Alert button

ETH Zürich

Motif Prediction with Graph Neural Networks

Jun 03, 2021
Maciej Besta, Raphael Grob, Cesare Miglioli, Nicola Bernold, Grzegorz Kwasniewski, Gabriel Gjini, Raghavendra Kanakagiri, Saleh Ashkboos, Lukas Gianinazzi, Nikoli Dryden, Torsten Hoefler

Figure 1 for Motif Prediction with Graph Neural Networks
Figure 2 for Motif Prediction with Graph Neural Networks
Figure 3 for Motif Prediction with Graph Neural Networks
Viaarxiv icon

Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks

Jan 31, 2021
Torsten Hoefler, Dan Alistarh, Tal Ben-Nun, Nikoli Dryden, Alexandra Peste

Figure 1 for Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks
Figure 2 for Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks
Figure 3 for Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks
Figure 4 for Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks
Viaarxiv icon

Clairvoyant Prefetching for Distributed Machine Learning I/O

Jan 21, 2021
Roman Böhringer, Nikoli Dryden, Tal Ben-Nun, Torsten Hoefler

Figure 1 for Clairvoyant Prefetching for Distributed Machine Learning I/O
Figure 2 for Clairvoyant Prefetching for Distributed Machine Learning I/O
Figure 3 for Clairvoyant Prefetching for Distributed Machine Learning I/O
Figure 4 for Clairvoyant Prefetching for Distributed Machine Learning I/O
Viaarxiv icon

The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs with Hybrid Parallelism

Jul 25, 2020
Yosuke Oyama, Naoya Maruyama, Nikoli Dryden, Erin McCarthy, Peter Harrington, Jan Balewski, Satoshi Matsuoka, Peter Nugent, Brian Van Essen

Viaarxiv icon

Data Movement Is All You Need: A Case Study on Optimizing Transformers

Jul 02, 2020
Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Shigang Li, Torsten Hoefler

Figure 1 for Data Movement Is All You Need: A Case Study on Optimizing Transformers
Figure 2 for Data Movement Is All You Need: A Case Study on Optimizing Transformers
Figure 3 for Data Movement Is All You Need: A Case Study on Optimizing Transformers
Figure 4 for Data Movement Is All You Need: A Case Study on Optimizing Transformers
Viaarxiv icon

Shapeshifter Networks: Cross-layer Parameter Sharing for Scalable and Effective Deep Learning

Jun 18, 2020
Bryan A. Plummer, Nikoli Dryden, Julius Frost, Torsten Hoefler, Kate Saenko

Figure 1 for Shapeshifter Networks: Cross-layer Parameter Sharing for Scalable and Effective Deep Learning
Figure 2 for Shapeshifter Networks: Cross-layer Parameter Sharing for Scalable and Effective Deep Learning
Figure 3 for Shapeshifter Networks: Cross-layer Parameter Sharing for Scalable and Effective Deep Learning
Figure 4 for Shapeshifter Networks: Cross-layer Parameter Sharing for Scalable and Effective Deep Learning
Viaarxiv icon

Deep Learning for Post-Processing Ensemble Weather Forecasts

May 18, 2020
Peter Grönquist, Chengyuan Yao, Tal Ben-Nun, Nikoli Dryden, Peter Dueben, Shigang Li, Torsten Hoefler

Figure 1 for Deep Learning for Post-Processing Ensemble Weather Forecasts
Figure 2 for Deep Learning for Post-Processing Ensemble Weather Forecasts
Figure 3 for Deep Learning for Post-Processing Ensemble Weather Forecasts
Figure 4 for Deep Learning for Post-Processing Ensemble Weather Forecasts
Viaarxiv icon

Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging

Apr 30, 2020
Shigang Li, Tal Ben-Nun, Dan Alistarh, Salvatore Di Girolamo, Nikoli Dryden, Torsten Hoefler

Figure 1 for Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging
Figure 2 for Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging
Figure 3 for Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging
Figure 4 for Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging
Viaarxiv icon

Predicting Weather Uncertainty with Deep Convnets

Dec 04, 2019
Peter Grönquist, Tal Ben-Nun, Nikoli Dryden, Peter Dueben, Luca Lavarini, Shigang Li, Torsten Hoefler

Figure 1 for Predicting Weather Uncertainty with Deep Convnets
Figure 2 for Predicting Weather Uncertainty with Deep Convnets
Figure 3 for Predicting Weather Uncertainty with Deep Convnets
Figure 4 for Predicting Weather Uncertainty with Deep Convnets
Viaarxiv icon