Alert button
Picture for Kawin Ethayarajh

Kawin Ethayarajh

Alert button

KTO: Model Alignment as Prospect Theoretic Optimization

Feb 02, 2024
Kawin Ethayarajh, Winnie Xu, Niklas Muennighoff, Dan Jurafsky, Douwe Kiela

Viaarxiv icon

Anchor Points: Benchmarking Models with Much Fewer Examples

Sep 14, 2023
Rajan Vivek, Kawin Ethayarajh, Diyi Yang, Douwe Kiela

Figure 1 for Anchor Points: Benchmarking Models with Much Fewer Examples
Figure 2 for Anchor Points: Benchmarking Models with Much Fewer Examples
Figure 3 for Anchor Points: Benchmarking Models with Much Fewer Examples
Figure 4 for Anchor Points: Benchmarking Models with Much Fewer Examples
Viaarxiv icon

How Human is Human Evaluation? Improving the Gold Standard for NLG with Utility Theory

May 24, 2022
Kawin Ethayarajh, Dan Jurafsky

Figure 1 for How Human is Human Evaluation? Improving the Gold Standard for NLG with Utility Theory
Figure 2 for How Human is Human Evaluation? Improving the Gold Standard for NLG with Utility Theory
Figure 3 for How Human is Human Evaluation? Improving the Gold Standard for NLG with Utility Theory
Figure 4 for How Human is Human Evaluation? Improving the Gold Standard for NLG with Utility Theory
Viaarxiv icon

Richer Countries and Richer Representations

May 10, 2022
Kaitlyn Zhou, Kawin Ethayarajh, Dan Jurafsky

Figure 1 for Richer Countries and Richer Representations
Figure 2 for Richer Countries and Richer Representations
Figure 3 for Richer Countries and Richer Representations
Figure 4 for Richer Countries and Richer Representations
Viaarxiv icon

Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words

May 10, 2022
Kaitlyn Zhou, Kawin Ethayarajh, Dallas Card, Dan Jurafsky

Figure 1 for Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words
Figure 2 for Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words
Figure 3 for Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words
Figure 4 for Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words
Viaarxiv icon

Information-Theoretic Measures of Dataset Difficulty

Oct 16, 2021
Kawin Ethayarajh, Yejin Choi, Swabha Swayamdipta

Figure 1 for Information-Theoretic Measures of Dataset Difficulty
Figure 2 for Information-Theoretic Measures of Dataset Difficulty
Figure 3 for Information-Theoretic Measures of Dataset Difficulty
Figure 4 for Information-Theoretic Measures of Dataset Difficulty
Viaarxiv icon

Conditional probing: measuring usable information beyond a baseline

Sep 19, 2021
John Hewitt, Kawin Ethayarajh, Percy Liang, Christopher D. Manning

Figure 1 for Conditional probing: measuring usable information beyond a baseline
Figure 2 for Conditional probing: measuring usable information beyond a baseline
Figure 3 for Conditional probing: measuring usable information beyond a baseline
Figure 4 for Conditional probing: measuring usable information beyond a baseline
Viaarxiv icon

On the Opportunities and Risks of Foundation Models

Aug 18, 2021
Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Kohd, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christopher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, Percy Liang

Figure 1 for On the Opportunities and Risks of Foundation Models
Figure 2 for On the Opportunities and Risks of Foundation Models
Figure 3 for On the Opportunities and Risks of Foundation Models
Figure 4 for On the Opportunities and Risks of Foundation Models
Viaarxiv icon

Attention Flows are Shapley Value Explanations

May 31, 2021
Kawin Ethayarajh, Dan Jurafsky

Figure 1 for Attention Flows are Shapley Value Explanations
Viaarxiv icon