Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Percy Liang

CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities


Jan 18, 2022
Mina Lee, Percy Liang, Qian Yang

* Published as a conference paper at CHI 2022 

  Access Paper or Ask Questions

Extending the WILDS Benchmark for Unsupervised Adaptation


Dec 09, 2021
Shiori Sagawa, Pang Wei Koh, Tony Lee, Irena Gao, Sang Michael Xie, Kendrick Shen, Ananya Kumar, Weihua Hu, Michihiro Yasunaga, Henrik Marklund, Sara Beery, Etienne David, Ian Stavness, Wei Guo, Jure Leskovec, Kate Saenko, Tatsunori Hashimoto, Sergey Levine, Chelsea Finn, Percy Liang


  Access Paper or Ask Questions

An Explanation of In-context Learning as Implicit Bayesian Inference


Nov 14, 2021
Sang Michael Xie, Aditi Raghunathan, Percy Liang, Tengyu Ma


  Access Paper or Ask Questions

LILA: Language-Informed Latent Actions


Nov 05, 2021
Siddharth Karamcheti, Megha Srivastava, Percy Liang, Dorsa Sadigh

* Accepted at the 5th Conference on Robot Learning (CoRL). Joint first authorship. 21 Pages, 11 Figures 

  Access Paper or Ask Questions

Large Language Models Can Be Strong Differentially Private Learners


Oct 12, 2021
Xuechen Li, Florian Tramèr, Percy Liang, Tatsunori Hashimoto

* 29 pages 

  Access Paper or Ask Questions

Conditional probing: measuring usable information beyond a baseline


Sep 19, 2021
John Hewitt, Kawin Ethayarajh, Percy Liang, Christopher D. Manning

* EMNLP 2021 + typo fixes 

  Access Paper or Ask Questions

LM-Critic: Language Models for Unsupervised Grammatical Error Correction


Sep 14, 2021
Michihiro Yasunaga, Jure Leskovec, Percy Liang

* EMNLP 2021. Code & data available at https://github.com/michiyasunaga/LM-Critic 

  Access Paper or Ask Questions

No True State-of-the-Art? OOD Detection Methods are Inconsistent across Datasets


Sep 12, 2021
Fahim Tajwar, Ananya Kumar, Sang Michael Xie, Percy Liang

* ICML Workshop on Uncertainty & Robustness in Deep Learning, 2021 

  Access Paper or Ask Questions

On the Opportunities and Risks of Foundation Models


Aug 18, 2021
Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Kohd, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christopher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, Percy Liang

* Authored by the Center for Research on Foundation Models (CRFM) at the Stanford Institute for Human-Centered Artificial Intelligence (HAI) 

  Access Paper or Ask Questions

Just Train Twice: Improving Group Robustness without Training Group Information


Jul 19, 2021
Evan Zheran Liu, Behzad Haghgoo, Annie S. Chen, Aditi Raghunathan, Pang Wei Koh, Shiori Sagawa, Percy Liang, Chelsea Finn

* International Conference on Machine Learning (ICML), 2021 

  Access Paper or Ask Questions

Codified audio language modeling learns useful representations for music information retrieval


Jul 12, 2021
Rodrigo Castellon, Chris Donahue, Percy Liang

* To appear in the proceedings of ISMIR 2021 

  Access Paper or Ask Questions

Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalization


Jul 09, 2021
John Miller, Rohan Taori, Aditi Raghunathan, Shiori Sagawa, Pang Wei Koh, Vaishaal Shankar, Percy Liang, Yair Carmon, Ludwig Schmidt


  Access Paper or Ask Questions

Break-It-Fix-It: Unsupervised Learning for Program Repair


Jun 22, 2021
Michihiro Yasunaga, Percy Liang

* ICML 2021. Code & data available at https://github.com/michiyasunaga/bifi 

  Access Paper or Ask Questions

Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Quality


Jun 12, 2021
Mina Lee, Chris Donahue, Robin Jia, Alexander Iyabor, Percy Liang

* Published as a conference paper at NAACL 2021 

  Access Paper or Ask Questions

QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering


Apr 13, 2021
Michihiro Yasunaga, Hongyu Ren, Antoine Bosselut, Percy Liang, Jure Leskovec

* NAACL 2021. Code & data available at https://github.com/michiyasunaga/qagnn 

  Access Paper or Ask Questions

Can Small and Synthetic Benchmarks Drive Modeling Innovation? A Retrospective Study of Question Answering Modeling Approaches


Feb 01, 2021
Nelson F. Liu, Tony Lee, Robin Jia, Percy Liang

* 40 pages, 13 figures; preprint 

  Access Paper or Ask Questions

Prefix-Tuning: Optimizing Continuous Prompts for Generation


Jan 01, 2021
Xiang Lisa Li, Percy Liang


  Access Paper or Ask Questions

In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustness


Dec 16, 2020
Sang Michael Xie, Ananya Kumar, Robbie Jones, Fereshte Khani, Tengyu Ma, Percy Liang


  Access Paper or Ask Questions

WILDS: A Benchmark of in-the-Wild Distribution Shifts


Dec 14, 2020
Pang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Yasunaga, Richard Lanas Phillips, Sara Beery, Jure Leskovec, Anshul Kundaje, Emma Pierson, Sergey Levine, Chelsea Finn, Percy Liang


  Access Paper or Ask Questions

Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Bases


Dec 13, 2020
Yu Gu, Sue Kase, Michelle Vanni, Brian Sadler, Percy Liang, Xifeng Yan, Yu Su


  Access Paper or Ask Questions

Removing Spurious Features can Hurt Accuracy and Affect Groups Disproportionately


Dec 07, 2020
Fereshte Khani, Percy Liang


  Access Paper or Ask Questions

Enabling certification of verification-agnostic networks via memory-efficient semidefinite programming


Nov 03, 2020
Sumanth Dathathri, Krishnamurthy Dvijotham, Alexey Kurakin, Aditi Raghunathan, Jonathan Uesato, Rudy Bunel, Shreya Shankar, Jacob Steinhardt, Ian Goodfellow, Percy Liang, Pushmeet Kohli


  Access Paper or Ask Questions

Selective Classification Can Magnify Disparities Across Groups


Oct 27, 2020
Erik Jones, Shiori Sagawa, Pang Wei Koh, Ananya Kumar, Percy Liang


  Access Paper or Ask Questions