Alert button
Picture for Sunayana Sitaram

Sunayana Sitaram

Alert button

METAL: Towards Multilingual Meta-Evaluation

Add code
Bookmark button
Alert button
Apr 02, 2024
Rishav Hada, Varun Gumma, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram

Viaarxiv icon

Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs

Add code
Bookmark button
Alert button
Mar 01, 2024
Nishanth Chandran, Sunayana Sitaram, Divya Gupta, Rahul Sharma, Kashish Mittal, Manohar Swaminathan

Figure 1 for Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
Figure 2 for Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
Figure 3 for Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
Figure 4 for Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
Viaarxiv icon

A Unified Framework and Dataset for Assessing Gender Bias in Vision-Language Models

Add code
Bookmark button
Alert button
Feb 21, 2024
Ashutosh Sathe, Prachi Jain, Sunayana Sitaram

Viaarxiv icon

MAFIA: Multi-Adapter Fused Inclusive LanguAge Models

Add code
Bookmark button
Alert button
Feb 12, 2024
Prachi Jain, Ashutosh Sathe, Varun Gumma, Kabir Ahuja, Sunayana Sitaram

Viaarxiv icon

CultureLLM: Incorporating Cultural Differences into Large Language Models

Add code
Bookmark button
Alert button
Feb 09, 2024
Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, Xing Xie

Viaarxiv icon

MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models

Add code
Bookmark button
Alert button
Jan 15, 2024
Divyanshu Aggarwal, Ashutosh Sathe, Sunayana Sitaram

Figure 1 for MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models
Figure 2 for MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models
Figure 3 for MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models
Figure 4 for MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models
Viaarxiv icon

MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks

Add code
Bookmark button
Alert button
Nov 13, 2023
Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, Ishaan Watts, Ashutosh Sathe, Millicent Ochieng, Rishav Hada, Prachi Jain, Maxamed Axmed, Kalika Bali, Sunayana Sitaram

Viaarxiv icon

Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparation

Add code
Bookmark button
Alert button
Oct 31, 2023
A. Seza Doğruöz, Sunayana Sitaram, Zheng-Xin Yong

Viaarxiv icon

Partial Rank Similarity Minimization Method for Quality MOS Prediction of Unseen Speech Synthesis Systems in Zero-Shot and Semi-supervised setting

Add code
Bookmark button
Alert button
Oct 08, 2023
Hemant Yadav, Erica Cooper, Junichi Yamagishi, Sunayana Sitaram, Rajiv Ratn Shah

Viaarxiv icon

Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?

Add code
Bookmark button
Alert button
Sep 14, 2023
Rishav Hada, Varun Gumma, Adrian de Wynter, Harshita Diddee, Mohamed Ahmed, Monojit Choudhury, Kalika Bali, Sunayana Sitaram

Figure 1 for Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Figure 2 for Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Figure 3 for Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Figure 4 for Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Viaarxiv icon