Alert button
Picture for Bing Xiang

Bing Xiang

Alert button

Benchmarking Diverse-Modal Entity Linking with Generative Models

May 27, 2023
Sijia Wang, Alexander Hanbo Li, Henry Zhu, Sheng Zhang, Chung-Wei Hang, Pramuditha Perera, Jie Ma, William Wang, Zhiguo Wang, Vittorio Castelli, Bing Xiang, Patrick Ng

Figure 1 for Benchmarking Diverse-Modal Entity Linking with Generative Models
Figure 2 for Benchmarking Diverse-Modal Entity Linking with Generative Models
Figure 3 for Benchmarking Diverse-Modal Entity Linking with Generative Models
Figure 4 for Benchmarking Diverse-Modal Entity Linking with Generative Models
Viaarxiv icon

UNITE: A Unified Benchmark for Text-to-SQL Evaluation

May 26, 2023
Wuwei Lan, Zhiguo Wang, Anuj Chauhan, Henghui Zhu, Alexander Li, Jiang Guo, Sheng Zhang, Chung-Wei Hang, Joseph Lilien, Yiqun Hu, Lin Pan, Mingwen Dong, Jun Wang, Jiarong Jiang, Stephen Ash, Vittorio Castelli, Patrick Ng, Bing Xiang

Figure 1 for UNITE: A Unified Benchmark for Text-to-SQL Evaluation
Figure 2 for UNITE: A Unified Benchmark for Text-to-SQL Evaluation
Figure 3 for UNITE: A Unified Benchmark for Text-to-SQL Evaluation
Viaarxiv icon

Greener yet Powerful: Taming Large Code Generation Models with Quantization

Mar 09, 2023
Xiaokai Wei, Sujan Gonugondla, Wasi Ahmad, Shiqi Wang, Baishakhi Ray, Haifeng Qian, Xiaopeng Li, Varun Kumar, Zijian Wang, Yuchen Tian, Qing Sun, Ben Athiwaratkun, Mingyue Shang, Murali Krishna Ramanathan, Parminder Bhatia, Bing Xiang

Figure 1 for Greener yet Powerful: Taming Large Code Generation Models with Quantization
Figure 2 for Greener yet Powerful: Taming Large Code Generation Models with Quantization
Figure 3 for Greener yet Powerful: Taming Large Code Generation Models with Quantization
Figure 4 for Greener yet Powerful: Taming Large Code Generation Models with Quantization
Viaarxiv icon

Linear Spaces of Meanings: the Compositional Language of VLMs

Feb 28, 2023
Matthew Trager, Pramuditha Perera, Luca Zancato, Alessandro Achille, Parminder Bhatia, Bing Xiang, Stefano Soatto

Figure 1 for Linear Spaces of Meanings: the Compositional Language of VLMs
Figure 2 for Linear Spaces of Meanings: the Compositional Language of VLMs
Figure 3 for Linear Spaces of Meanings: the Compositional Language of VLMs
Figure 4 for Linear Spaces of Meanings: the Compositional Language of VLMs
Viaarxiv icon

STREET: A Multi-Task Structured Reasoning and Explanation Benchmark

Feb 13, 2023
Danilo Ribeiro, Shen Wang, Xiaofei Ma, Henry Zhu, Rui Dong, Deguang Kong, Juliette Burger, Anjelica Ramos, William Wang, Zhiheng Huang, George Karypis, Bing Xiang, Dan Roth

Figure 1 for STREET: A Multi-Task Structured Reasoning and Explanation Benchmark
Figure 2 for STREET: A Multi-Task Structured Reasoning and Explanation Benchmark
Figure 3 for STREET: A Multi-Task Structured Reasoning and Explanation Benchmark
Figure 4 for STREET: A Multi-Task Structured Reasoning and Explanation Benchmark
Viaarxiv icon

Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness

Jan 21, 2023
Shuaichen Chang, Jun Wang, Mingwen Dong, Lin Pan, Henghui Zhu, Alexander Hanbo Li, Wuwei Lan, Sheng Zhang, Jiarong Jiang, Joseph Lilien, Steve Ash, William Yang Wang, Zhiguo Wang, Vittorio Castelli, Patrick Ng, Bing Xiang

Figure 1 for Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness
Figure 2 for Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness
Figure 3 for Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness
Figure 4 for Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness
Viaarxiv icon

ReCode: Robustness Evaluation of Code Generation Models

Dec 20, 2022
Shiqi Wang, Zheng Li, Haifeng Qian, Chenghao Yang, Zijian Wang, Mingyue Shang, Varun Kumar, Samson Tan, Baishakhi Ray, Parminder Bhatia, Ramesh Nallapati, Murali Krishna Ramanathan, Dan Roth, Bing Xiang

Figure 1 for ReCode: Robustness Evaluation of Code Generation Models
Figure 2 for ReCode: Robustness Evaluation of Code Generation Models
Figure 3 for ReCode: Robustness Evaluation of Code Generation Models
Figure 4 for ReCode: Robustness Evaluation of Code Generation Models
Viaarxiv icon

CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context

Dec 20, 2022
Yangruibo Ding, Zijian Wang, Wasi Uddin Ahmad, Murali Krishna Ramanathan, Ramesh Nallapati, Parminder Bhatia, Dan Roth, Bing Xiang

Figure 1 for CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
Figure 2 for CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
Figure 3 for CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
Figure 4 for CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
Viaarxiv icon

Importance of Synthesizing High-quality Data for Text-to-SQL Parsing

Dec 17, 2022
Yiyun Zhao, Jiarong Jiang, Yiqun Hu, Wuwei Lan, Henry Zhu, Anuj Chauhan, Alexander Li, Lin Pan, Jun Wang, Chung-Wei Hang, Sheng Zhang, Marvin Dong, Joe Lilien, Patrick Ng, Zhiguo Wang, Vittorio Castelli, Bing Xiang

Figure 1 for Importance of Synthesizing High-quality Data for Text-to-SQL Parsing
Figure 2 for Importance of Synthesizing High-quality Data for Text-to-SQL Parsing
Figure 3 for Importance of Synthesizing High-quality Data for Text-to-SQL Parsing
Figure 4 for Importance of Synthesizing High-quality Data for Text-to-SQL Parsing
Viaarxiv icon

Multi-lingual Evaluation of Code Generation Models

Oct 26, 2022
Ben Athiwaratkun, Sanjay Krishna Gouda, Zijian Wang, Xiaopeng Li, Yuchen Tian, Ming Tan, Wasi Uddin Ahmad, Shiqi Wang, Qing Sun, Mingyue Shang, Sujan Kumar Gonugondla, Hantian Ding, Varun Kumar, Nathan Fulton, Arash Farahani, Siddhartha Jain, Robert Giaquinto, Haifeng Qian, Murali Krishna Ramanathan, Ramesh Nallapati, Baishakhi Ray, Parminder Bhatia, Sudipta Sengupta, Dan Roth, Bing Xiang

Figure 1 for Multi-lingual Evaluation of Code Generation Models
Figure 2 for Multi-lingual Evaluation of Code Generation Models
Figure 3 for Multi-lingual Evaluation of Code Generation Models
Figure 4 for Multi-lingual Evaluation of Code Generation Models
Viaarxiv icon