Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Percy Liang

On the Opportunities and Risks of Foundation Models


Aug 18, 2021
Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Kohd, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christopher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, Percy Liang

* Authored by the Center for Research on Foundation Models (CRFM) at the Stanford Institute for Human-Centered Artificial Intelligence (HAI) 

  Access Paper or Ask Questions

Just Train Twice: Improving Group Robustness without Training Group Information


Jul 19, 2021
Evan Zheran Liu, Behzad Haghgoo, Annie S. Chen, Aditi Raghunathan, Pang Wei Koh, Shiori Sagawa, Percy Liang, Chelsea Finn

* International Conference on Machine Learning (ICML), 2021 

  Access Paper or Ask Questions

Codified audio language modeling learns useful representations for music information retrieval


Jul 12, 2021
Rodrigo Castellon, Chris Donahue, Percy Liang

* To appear in the proceedings of ISMIR 2021 

  Access Paper or Ask Questions

Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalization


Jul 09, 2021
John Miller, Rohan Taori, Aditi Raghunathan, Shiori Sagawa, Pang Wei Koh, Vaishaal Shankar, Percy Liang, Yair Carmon, Ludwig Schmidt


  Access Paper or Ask Questions

Break-It-Fix-It: Unsupervised Learning for Program Repair


Jun 22, 2021
Michihiro Yasunaga, Percy Liang

* ICML 2021. Code & data available at https://github.com/michiyasunaga/bifi 

  Access Paper or Ask Questions

Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Quality


Jun 12, 2021
Mina Lee, Chris Donahue, Robin Jia, Alexander Iyabor, Percy Liang

* Published as a conference paper at NAACL 2021 

  Access Paper or Ask Questions

QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering


Apr 13, 2021
Michihiro Yasunaga, Hongyu Ren, Antoine Bosselut, Percy Liang, Jure Leskovec

* NAACL 2021. Code & data available at https://github.com/michiyasunaga/qagnn 

  Access Paper or Ask Questions

Can Small and Synthetic Benchmarks Drive Modeling Innovation? A Retrospective Study of Question Answering Modeling Approaches


Feb 01, 2021
Nelson F. Liu, Tony Lee, Robin Jia, Percy Liang

* 40 pages, 13 figures; preprint 

  Access Paper or Ask Questions

Prefix-Tuning: Optimizing Continuous Prompts for Generation


Jan 01, 2021
Xiang Lisa Li, Percy Liang


  Access Paper or Ask Questions

In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustness


Dec 16, 2020
Sang Michael Xie, Ananya Kumar, Robbie Jones, Fereshte Khani, Tengyu Ma, Percy Liang


  Access Paper or Ask Questions

WILDS: A Benchmark of in-the-Wild Distribution Shifts


Dec 14, 2020
Pang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Yasunaga, Richard Lanas Phillips, Sara Beery, Jure Leskovec, Anshul Kundaje, Emma Pierson, Sergey Levine, Chelsea Finn, Percy Liang


  Access Paper or Ask Questions

Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Bases


Dec 13, 2020
Yu Gu, Sue Kase, Michelle Vanni, Brian Sadler, Percy Liang, Xifeng Yan, Yu Su


  Access Paper or Ask Questions

Removing Spurious Features can Hurt Accuracy and Affect Groups Disproportionately


Dec 07, 2020
Fereshte Khani, Percy Liang


  Access Paper or Ask Questions

Enabling certification of verification-agnostic networks via memory-efficient semidefinite programming


Nov 03, 2020
Sumanth Dathathri, Krishnamurthy Dvijotham, Alexey Kurakin, Aditi Raghunathan, Jonathan Uesato, Rudy Bunel, Shreya Shankar, Jacob Steinhardt, Ian Goodfellow, Percy Liang, Pushmeet Kohli


  Access Paper or Ask Questions

Selective Classification Can Magnify Disparities Across Groups


Oct 27, 2020
Erik Jones, Shiori Sagawa, Pang Wei Koh, Ananya Kumar, Percy Liang


  Access Paper or Ask Questions

RNNs can generate bounded hierarchical languages with optimal memory


Oct 15, 2020
John Hewitt, Michael Hahn, Surya Ganguli, Percy Liang, Christopher D. Manning

* EMNLP2020 + appendix typo fixes 

  Access Paper or Ask Questions

The EOS Decision and Length Extrapolation


Oct 14, 2020
Benjamin Newman, John Hewitt, Percy Liang, Christopher D. Manning

* 16 page, 7 Figures, 9 Tables, Blackbox NLP Workshop at EMNLP 2020 

  Access Paper or Ask Questions

Learning Adaptive Language Interfaces through Decomposition


Oct 11, 2020
Siddharth Karamcheti, Dorsa Sadigh, Percy Liang

* Accepted at the 1st Workshop for Interactive and Executable Semantic Parsing (IntEx-SemPar) @ EMNLP 2020. 11 pages, 5 figures 

  Access Paper or Ask Questions

On the Importance of Adaptive Data Collection for Extremely Imbalanced Pairwise Tasks


Oct 10, 2020
Stephen Mussmann, Robin Jia, Percy Liang

* In Findings of EMNLP 2020 

  Access Paper or Ask Questions

Task-Oriented Dialogue as Dataflow Synthesis


Oct 02, 2020
Semantic Machines, Jacob Andreas, John Bufe, David Burkett, Charles Chen, Josh Clausman, Jean Crawford, Kate Crim, Jordan DeLoach, Leah Dorner, Jason Eisner, Hao Fang, Alan Guo, David Hall, Kristin Hayes, Kellie Hill, Diana Ho, Wendy Iwaszuk, Smriti Jha, Dan Klein, Jayant Krishnamurthy, Theo Lanman, Percy Liang, Christopher H Lin, Ilya Lintsbakh, Andy McGovern, Aleksandr Nisnevich, Adam Pauls, Dmitrij Petters, Brent Read, Dan Roth, Subhro Roy, Jesse Rusak, Beth Short, Div Slomin, Ben Snyder, Stephon Striplin, Yu Su, Zachary Tellman, Sam Thomson, Andrei Vorobev, Izabela Witoszko, Jason Wolfe, Abby Wray, Yuchen Zhang, Alexander Zotov

* TACL 2020 

  Access Paper or Ask Questions

Robustness to Spurious Correlations via Human Annotations


Aug 13, 2020
Megha Srivastava, Tatsunori Hashimoto, Percy Liang

* ICML 2020 final version, 16 pages, 9 figures 

  Access Paper or Ask Questions

Explore then Execute: Adapting without Rewards via Factorized Meta-Reinforcement Learning


Aug 06, 2020
Evan Zheran Liu, Aditi Raghunathan, Percy Liang, Chelsea Finn

* Project web page at https://ezliu.github.io/dream 

  Access Paper or Ask Questions