Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Kawin Ethayarajh

Information-Theoretic Measures of Dataset Difficulty


Oct 16, 2021
Kawin Ethayarajh, Yejin Choi, Swabha Swayamdipta


  Access Paper or Ask Questions

Conditional probing: measuring usable information beyond a baseline


Sep 19, 2021
John Hewitt, Kawin Ethayarajh, Percy Liang, Christopher D. Manning

* EMNLP 2021 + typo fixes 

  Access Paper or Ask Questions

On the Opportunities and Risks of Foundation Models


Aug 18, 2021
Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Kohd, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christopher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, Percy Liang

* Authored by the Center for Research on Foundation Models (CRFM) at the Stanford Institute for Human-Centered Artificial Intelligence (HAI) 

  Access Paper or Ask Questions

Attention Flows are Shapley Value Explanations


May 31, 2021
Kawin Ethayarajh, Dan Jurafsky

* ACL 2021 

  Access Paper or Ask Questions

Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking


May 21, 2021
Zhiyi Ma, Kawin Ethayarajh, Tristan Thrush, Somya Jain, Ledell Wu, Robin Jia, Christopher Potts, Adina Williams, Douwe Kiela


  Access Paper or Ask Questions

Frequency-based Distortions in Contextualized Word Embeddings


Apr 17, 2021
Kaitlyn Zhou, Kawin Ethayarajh, Dan Jurafsky


  Access Paper or Ask Questions

Utility is in the Eye of the User: A Critique of NLP Leaderboards


Oct 15, 2020
Kawin Ethayarajh, Dan Jurafsky

* EMNLP 2020 

  Access Paper or Ask Questions

BLEU Neighbors: A Reference-less Approach to Automatic Evaluation


Apr 29, 2020
Kawin Ethayarajh, Dorsa Sadigh


  Access Paper or Ask Questions

Is Your Classifier Actually Biased? Measuring Fairness under Uncertainty with Bernstein Bounds


Apr 26, 2020
Kawin Ethayarajh

* ACL 2020 

  Access Paper or Ask Questions

Rotate King to get Queen: Word Relationships as Orthogonal Transformations in Embedding Space


Sep 05, 2019
Kawin Ethayarajh

* Accepted to EMNLP 2019 

  Access Paper or Ask Questions

How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings


Sep 02, 2019
Kawin Ethayarajh

* Accepted to EMNLP 2019 

  Access Paper or Ask Questions

Rotate $\textit{King}$ to get $\textit{Queen}$: Word Relationships as Orthogonal Transformations in Embedding Space


Sep 02, 2019
Kawin Ethayarajh

* Accepted to EMNLP 2019 

  Access Paper or Ask Questions

Understanding Undesirable Word Embedding Associations


Aug 18, 2019
Kawin Ethayarajh, David Duvenaud, Graeme Hirst

* Accepted to ACL 2019 

  Access Paper or Ask Questions

Towards Understanding Linear Word Analogies


Oct 27, 2018
Kawin Ethayarajh, David Duvenaud, Graeme Hirst


  Access Paper or Ask Questions