Alert button
Picture for Junqi Yin

Junqi Yin

Alert button

The Case for Co-Designing Model Architectures with Hardware

Add code
Bookmark button
Alert button
Jan 30, 2024
Quentin Anthony, Jacob Hatef, Deepak Narayanan, Stella Biderman, Stas Bekman, Junqi Yin, Aamir Shafi, Hari Subramoni, Dhabaleswar Panda

Viaarxiv icon

Optimizing Distributed Training on Frontier for Large Language Models

Add code
Bookmark button
Alert button
Dec 21, 2023
Sajal Dash, Isaac Lyngaas, Junqi Yin, Xiao Wang, Romain Egele, Guojing Cong, Feiyi Wang, Prasanna Balaprakash

Viaarxiv icon

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies

Add code
Bookmark button
Alert button
Oct 11, 2023
Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang, Conglong Li, Shiyang Chen, Chengming Zhang, Masahiro Tanaka, Xiaoxia Wu, Jeff Rasley, Ammar Ahmad Awan, Connor Holmes, Martin Cai, Adam Ghanem, Zhongzhu Zhou, Yuxiong He, Pete Luferenko, Divya Kumar, Jonathan Weyn, Ruixiong Zhang, Sylwester Klocek, Volodymyr Vragov, Mohammed AlQuraishi, Gustaf Ahdritz, Christina Floristean, Cristina Negri, Rao Kotamarthi, Venkatram Vishwanath, Arvind Ramanathan, Sam Foreman, Kyle Hippe, Troy Arcomano, Romit Maulik, Maxim Zvyagin, Alexander Brace, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael Irvin, J. Gregory Pauloski, Logan Ward, Valerie Hayot, Murali Emani, Zhen Xie, Diangen Lin, Maulik Shukla, Ian Foster, James J. Davis, Michael E. Papka, Thomas Brettin, Prasanna Balaprakash, Gina Tourassi, John Gounley, Heidi Hanson, Thomas E Potok, Massimiliano Lupo Pasini, Kate Evans, Dan Lu, Dalton Lunga, Junqi Yin, Sajal Dash, Feiyi Wang, Mallikarjun Shankar, Isaac Lyngaas, Xiao Wang, Guojing Cong, Pei Zhang, Ming Fan, Siyan Liu, Adolfy Hoisie, Shinjae Yoo, Yihui Ren, William Tang, Kyle Felker, Alexey Svyatkovskiy, Hang Liu, Ashwin Aji, Angela Dalton, Michael Schulte, Karl Schulz, Yuntian Deng, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Anima Anandkumar, Rick Stevens

Figure 1 for DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Figure 2 for DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Figure 3 for DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Figure 4 for DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Viaarxiv icon

Atomic structure generation from reconstructing structural fingerprints

Add code
Bookmark button
Alert button
Jul 27, 2022
Victor Fung, Shuyi Jia, Jiaxin Zhang, Sirui Bi, Junqi Yin, P. Ganesh

Figure 1 for Atomic structure generation from reconstructing structural fingerprints
Figure 2 for Atomic structure generation from reconstructing structural fingerprints
Figure 3 for Atomic structure generation from reconstructing structural fingerprints
Figure 4 for Atomic structure generation from reconstructing structural fingerprints
Viaarxiv icon

Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks

Add code
Bookmark button
Alert button
Jul 25, 2022
Massimiliano Lupo Pasini, Junqi Yin

Figure 1 for Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks
Figure 2 for Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks
Figure 3 for Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks
Figure 4 for Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks
Viaarxiv icon

MLPerf HPC: A Holistic Benchmark Suite for Scientific Machine Learning on HPC Systems

Add code
Bookmark button
Alert button
Oct 26, 2021
Steven Farrell, Murali Emani, Jacob Balma, Lukas Drescher, Aleksandr Drozd, Andreas Fink, Geoffrey Fox, David Kanter, Thorsten Kurth, Peter Mattson, Dawei Mu, Amit Ruhela, Kento Sato, Koichi Shirahata, Tsuguchika Tabaru, Aristeidis Tsaris, Jan Balewski, Ben Cumming, Takumi Danjo, Jens Domke, Takaaki Fukai, Naoto Fukumoto, Tatsuya Fukushi, Balazs Gerofi, Takumi Honda, Toshiyuki Imamura, Akihiko Kasagi, Kentaro Kawakami, Shuhei Kudo, Akiyoshi Kuroda, Maxime Martinasso, Satoshi Matsuoka, Henrique Mendonça, Kazuki Minami, Prabhat Ram, Takashi Sawada, Mallikarjun Shankar, Tom St. John, Akihiro Tabuchi, Venkatram Vishwanath, Mohamed Wahib, Masafumi Yamazaki, Junqi Yin

Figure 1 for MLPerf HPC: A Holistic Benchmark Suite for Scientific Machine Learning on HPC Systems
Figure 2 for MLPerf HPC: A Holistic Benchmark Suite for Scientific Machine Learning on HPC Systems
Figure 3 for MLPerf HPC: A Holistic Benchmark Suite for Scientific Machine Learning on HPC Systems
Figure 4 for MLPerf HPC: A Holistic Benchmark Suite for Scientific Machine Learning on HPC Systems
Viaarxiv icon

Stable Anderson Acceleration for Deep Learning

Add code
Bookmark button
Alert button
Oct 26, 2021
Massimiliano Lupo Pasini, Junqi Yin, Viktor Reshniak, Miroslav Stoyanov

Figure 1 for Stable Anderson Acceleration for Deep Learning
Figure 2 for Stable Anderson Acceleration for Deep Learning
Figure 3 for Stable Anderson Acceleration for Deep Learning
Figure 4 for Stable Anderson Acceleration for Deep Learning
Viaarxiv icon

Neural network based order parameter for phase transitions and its applications in high-entropy alloys

Add code
Bookmark button
Alert button
Sep 12, 2021
Junqi Yin, Zongrui Pei, Michael Gao

Figure 1 for Neural network based order parameter for phase transitions and its applications in high-entropy alloys
Figure 2 for Neural network based order parameter for phase transitions and its applications in high-entropy alloys
Figure 3 for Neural network based order parameter for phase transitions and its applications in high-entropy alloys
Figure 4 for Neural network based order parameter for phase transitions and its applications in high-entropy alloys
Viaarxiv icon

Scalable Balanced Training of Conditional Generative Adversarial Neural Networks on Image Data

Add code
Bookmark button
Alert button
Feb 21, 2021
Massimiliano Lupo Pasini, Vittorio Gabbi, Junqi Yin, Simona Perotto, Nouamane Laanait

Figure 1 for Scalable Balanced Training of Conditional Generative Adversarial Neural Networks on Image Data
Figure 2 for Scalable Balanced Training of Conditional Generative Adversarial Neural Networks on Image Data
Figure 3 for Scalable Balanced Training of Conditional Generative Adversarial Neural Networks on Image Data
Figure 4 for Scalable Balanced Training of Conditional Generative Adversarial Neural Networks on Image Data
Viaarxiv icon

Data optimization for large batch distributed training of deep neural networks

Add code
Bookmark button
Alert button
Dec 18, 2020
Shubhankar Gahlot, Junqi Yin, Mallikarjun Shankar

Figure 1 for Data optimization for large batch distributed training of deep neural networks
Figure 2 for Data optimization for large batch distributed training of deep neural networks
Figure 3 for Data optimization for large batch distributed training of deep neural networks
Figure 4 for Data optimization for large batch distributed training of deep neural networks
Viaarxiv icon