Alert button
Picture for Alexey Svyatkovskiy

Alexey Svyatkovskiy

Alert button

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies

Oct 11, 2023
Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang, Conglong Li, Shiyang Chen, Chengming Zhang, Masahiro Tanaka, Xiaoxia Wu, Jeff Rasley, Ammar Ahmad Awan, Connor Holmes, Martin Cai, Adam Ghanem, Zhongzhu Zhou, Yuxiong He, Pete Luferenko, Divya Kumar, Jonathan Weyn, Ruixiong Zhang, Sylwester Klocek, Volodymyr Vragov, Mohammed AlQuraishi, Gustaf Ahdritz, Christina Floristean, Cristina Negri, Rao Kotamarthi, Venkatram Vishwanath, Arvind Ramanathan, Sam Foreman, Kyle Hippe, Troy Arcomano, Romit Maulik, Maxim Zvyagin, Alexander Brace, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael Irvin, J. Gregory Pauloski, Logan Ward, Valerie Hayot, Murali Emani, Zhen Xie, Diangen Lin, Maulik Shukla, Ian Foster, James J. Davis, Michael E. Papka, Thomas Brettin, Prasanna Balaprakash, Gina Tourassi, John Gounley, Heidi Hanson, Thomas E Potok, Massimiliano Lupo Pasini, Kate Evans, Dan Lu, Dalton Lunga, Junqi Yin, Sajal Dash, Feiyi Wang, Mallikarjun Shankar, Isaac Lyngaas, Xiao Wang, Guojing Cong, Pei Zhang, Ming Fan, Siyan Liu, Adolfy Hoisie, Shinjae Yoo, Yihui Ren, William Tang, Kyle Felker, Alexey Svyatkovskiy, Hang Liu, Ashwin Aji, Angela Dalton, Michael Schulte, Karl Schulz, Yuntian Deng, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Anima Anandkumar, Rick Stevens

Figure 1 for DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Figure 2 for DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Figure 3 for DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Figure 4 for DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Viaarxiv icon

Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation

Oct 03, 2023
Benjamin Steenhoek, Michele Tufano, Neel Sundaresan, Alexey Svyatkovskiy

Figure 1 for Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation
Figure 2 for Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation
Figure 3 for Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation
Figure 4 for Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation
Viaarxiv icon

Code Execution with Pre-trained Language Models

May 08, 2023
Chenxiao Liu, Shuai Lu, Weizhu Chen, Daxin Jiang, Alexey Svyatkovskiy, Shengyu Fu, Neel Sundaresan, Nan Duan

Figure 1 for Code Execution with Pre-trained Language Models
Figure 2 for Code Execution with Pre-trained Language Models
Figure 3 for Code Execution with Pre-trained Language Models
Figure 4 for Code Execution with Pre-trained Language Models
Viaarxiv icon

Exploring and Evaluating Personalized Models for Code Generation

Aug 29, 2022
Andrei Zlotchevski, Dawn Drain, Alexey Svyatkovskiy, Colin Clement, Neel Sundaresan, Michele Tufano

Figure 1 for Exploring and Evaluating Personalized Models for Code Generation
Figure 2 for Exploring and Evaluating Personalized Models for Code Generation
Figure 3 for Exploring and Evaluating Personalized Models for Code Generation
Figure 4 for Exploring and Evaluating Personalized Models for Code Generation
Viaarxiv icon

AdaptivePaste: Code Adaptation through Learning Semantics-aware Variable Usage Representations

May 23, 2022
Xiaoyu Liu, Jinu Jang, Neel Sundaresan, Miltiadis Allamanis, Alexey Svyatkovskiy

Figure 1 for AdaptivePaste: Code Adaptation through Learning Semantics-aware Variable Usage Representations
Figure 2 for AdaptivePaste: Code Adaptation through Learning Semantics-aware Variable Usage Representations
Figure 3 for AdaptivePaste: Code Adaptation through Learning Semantics-aware Variable Usage Representations
Figure 4 for AdaptivePaste: Code Adaptation through Learning Semantics-aware Variable Usage Representations
Viaarxiv icon

CodeReviewer: Pre-Training for Automating Code Review Activities

Mar 17, 2022
Zhiyu Li, Shuai Lu, Daya Guo, Nan Duan, Shailesh Jannu, Grant Jenks, Deep Majumder, Jared Green, Alexey Svyatkovskiy, Shengyu Fu, Neel Sundaresan

Figure 1 for CodeReviewer: Pre-Training for Automating Code Review Activities
Figure 2 for CodeReviewer: Pre-Training for Automating Code Review Activities
Figure 3 for CodeReviewer: Pre-Training for Automating Code Review Activities
Figure 4 for CodeReviewer: Pre-Training for Automating Code Review Activities
Viaarxiv icon

ReACC: A Retrieval-Augmented Code Completion Framework

Mar 15, 2022
Shuai Lu, Nan Duan, Hojae Han, Daya Guo, Seung-won Hwang, Alexey Svyatkovskiy

Figure 1 for ReACC: A Retrieval-Augmented Code Completion Framework
Figure 2 for ReACC: A Retrieval-Augmented Code Completion Framework
Figure 3 for ReACC: A Retrieval-Augmented Code Completion Framework
Figure 4 for ReACC: A Retrieval-Augmented Code Completion Framework
Viaarxiv icon

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy

Sep 17, 2021
Colin B. Clement, Shuai Lu, Xiaoyu Liu, Michele Tufano, Dawn Drain, Nan Duan, Neel Sundaresan, Alexey Svyatkovskiy

Figure 1 for Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy
Figure 2 for Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy
Figure 3 for Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy
Figure 4 for Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy
Viaarxiv icon

MergeBERT: Program Merge Conflict Resolution via Neural Transformers

Sep 08, 2021
Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri

Figure 1 for MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Figure 2 for MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Figure 3 for MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Figure 4 for MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Viaarxiv icon

Learning to Generate Code Sketches

Jun 18, 2021
Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltiadis Allamanis

Figure 1 for Learning to Generate Code Sketches
Figure 2 for Learning to Generate Code Sketches
Figure 3 for Learning to Generate Code Sketches
Figure 4 for Learning to Generate Code Sketches
Viaarxiv icon