Alert button
Picture for Romain Egele

Romain Egele

Alert button

Optimizing Distributed Training on Frontier for Large Language Models

Dec 21, 2023
Sajal Dash, Isaac Lyngaas, Junqi Yin, Xiao Wang, Romain Egele, Guojing Cong, Feiyi Wang, Prasanna Balaprakash

Viaarxiv icon

Parallel Multi-Objective Hyperparameter Optimization with Uniform Normalization and Bounded Objectives

Sep 26, 2023
Romain Egele, Tyler Chang, Yixuan Sun, Venkatram Vishwanath, Prasanna Balaprakash

Viaarxiv icon

Is One Epoch All You Need For Multi-Fidelity Hyperparameter Optimization?

Jul 28, 2023
Romain Egele, Isabelle Guyon, Yixuan Sun, Prasanna Balaprakash

Figure 1 for Is One Epoch All You Need For Multi-Fidelity Hyperparameter Optimization?
Figure 2 for Is One Epoch All You Need For Multi-Fidelity Hyperparameter Optimization?
Figure 3 for Is One Epoch All You Need For Multi-Fidelity Hyperparameter Optimization?
Figure 4 for Is One Epoch All You Need For Multi-Fidelity Hyperparameter Optimization?
Viaarxiv icon

Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles

Feb 20, 2023
Romit Maulik, Romain Egele, Krishnan Raghavan, Prasanna Balaprakash

Figure 1 for Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles
Figure 2 for Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles
Figure 3 for Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles
Figure 4 for Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles
Viaarxiv icon

HPC Storage Service Autotuning Using Variational-Autoencoder-Guided Asynchronous Bayesian Optimization

Oct 03, 2022
Matthieu Dorier, Romain Egele, Prasanna Balaprakash, Jaehoon Koo, Sandeep Madireddy, Srinivasan Ramesh, Allen D. Malony, Rob Ross

Figure 1 for HPC Storage Service Autotuning Using Variational-Autoencoder-Guided Asynchronous Bayesian Optimization
Figure 2 for HPC Storage Service Autotuning Using Variational-Autoencoder-Guided Asynchronous Bayesian Optimization
Figure 3 for HPC Storage Service Autotuning Using Variational-Autoencoder-Guided Asynchronous Bayesian Optimization
Figure 4 for HPC Storage Service Autotuning Using Variational-Autoencoder-Guided Asynchronous Bayesian Optimization
Viaarxiv icon

Asynchronous Distributed Bayesian Optimization at HPC Scale

Jul 04, 2022
Romain Egele, Joceran Gouneau, Venkatram Vishwanath, Isabelle Guyon, Prasanna Balaprakash

Figure 1 for Asynchronous Distributed Bayesian Optimization at HPC Scale
Figure 2 for Asynchronous Distributed Bayesian Optimization at HPC Scale
Figure 3 for Asynchronous Distributed Bayesian Optimization at HPC Scale
Figure 4 for Asynchronous Distributed Bayesian Optimization at HPC Scale
Viaarxiv icon

AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification

Oct 26, 2021
Romain Egele, Romit Maulik, Krishnan Raghavan, Prasanna Balaprakash, Bethany Lusch

Figure 1 for AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification
Figure 2 for AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification
Figure 3 for AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification
Figure 4 for AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification
Viaarxiv icon

AgEBO-Tabular: Joint Neural Architecture and Hyperparameter Search with Autotuned Data-Parallel Training for Tabular Data

Oct 30, 2020
Romain Egele, Prasanna Balaprakash, Venkatram Vishwanath, Isabelle Guyon, Zhengying Liu

Figure 1 for AgEBO-Tabular: Joint Neural Architecture and Hyperparameter Search with Autotuned Data-Parallel Training for Tabular Data
Figure 2 for AgEBO-Tabular: Joint Neural Architecture and Hyperparameter Search with Autotuned Data-Parallel Training for Tabular Data
Figure 3 for AgEBO-Tabular: Joint Neural Architecture and Hyperparameter Search with Autotuned Data-Parallel Training for Tabular Data
Figure 4 for AgEBO-Tabular: Joint Neural Architecture and Hyperparameter Search with Autotuned Data-Parallel Training for Tabular Data
Viaarxiv icon

Scalable Reinforcement-Learning-Based Neural Architecture Search for Cancer Deep Learning Research

Sep 01, 2019
Prasanna Balaprakash, Romain Egele, Misha Salim, Stefan Wild, Venkatram Vishwanath, Fangfang Xia, Tom Brettin, Rick Stevens

Figure 1 for Scalable Reinforcement-Learning-Based Neural Architecture Search for Cancer Deep Learning Research
Figure 2 for Scalable Reinforcement-Learning-Based Neural Architecture Search for Cancer Deep Learning Research
Figure 3 for Scalable Reinforcement-Learning-Based Neural Architecture Search for Cancer Deep Learning Research
Figure 4 for Scalable Reinforcement-Learning-Based Neural Architecture Search for Cancer Deep Learning Research
Viaarxiv icon