Alert button
Picture for Yushi Hu

Yushi Hu

Alert button

BLINK: Multimodal Large Language Models Can See but Not Perceive

Add code
Bookmark button
Alert button
Apr 18, 2024
Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A. Smith, Wei-Chiu Ma, Ranjay Krishna

Viaarxiv icon

Training Language Models to Generate Text with Citations via Fine-grained Rewards

Add code
Bookmark button
Alert button
Feb 06, 2024
Chengyu Huang, Zeqiu Wu, Yushi Hu, Wenya Wang

Viaarxiv icon

Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models

Add code
Bookmark button
Alert button
Dec 05, 2023
Yushi Hu, Otilia Stretcu, Chun-Ta Lu, Krishnamurthy Viswanathan, Kenji Hata, Enming Luo, Ranjay Krishna, Ariel Fuxman

Viaarxiv icon

DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback

Add code
Bookmark button
Alert button
Nov 29, 2023
Jiao Sun, Deqing Fu, Yushi Hu, Su Wang, Royi Rassin, Da-Cheng Juan, Dana Alon, Charles Herrmann, Sjoerd van Steenkiste, Ranjay Krishna, Cyrus Rashtchian

Figure 1 for DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback
Figure 2 for DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback
Figure 3 for DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback
Figure 4 for DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback
Viaarxiv icon

Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generation

Add code
Bookmark button
Alert button
Oct 30, 2023
Jaemin Cho, Yushi Hu, Roopal Garg, Peter Anderson, Ranjay Krishna, Jason Baldridge, Mohit Bansal, Jordi Pont-Tuset, Su Wang

Figure 1 for Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generation
Figure 2 for Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generation
Figure 3 for Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generation
Figure 4 for Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generation
Viaarxiv icon

Fine-Grained Human Feedback Gives Better Rewards for Language Model Training

Add code
Bookmark button
Alert button
Jun 02, 2023
Zeqiu Wu, Yushi Hu, Weijia Shi, Nouha Dziri, Alane Suhr, Prithviraj Ammanabrolu, Noah A. Smith, Mari Ostendorf, Hannaneh Hajishirzi

Figure 1 for Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
Figure 2 for Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
Figure 3 for Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
Figure 4 for Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
Viaarxiv icon

TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering

Add code
Bookmark button
Alert button
Mar 28, 2023
Yushi Hu, Benlin Liu, Jungo Kasai, Yizhong Wang, Mari Ostendorf, Ranjay Krishna, Noah A. Smith

Figure 1 for TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering
Figure 2 for TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering
Figure 3 for TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering
Figure 4 for TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering
Viaarxiv icon

One Embedder, Any Task: Instruction-Finetuned Text Embeddings

Add code
Bookmark button
Alert button
Dec 20, 2022
Hongjin Su, Weijia Shi, Jungo Kasai, Yizhong Wang, Yushi Hu, Mari Ostendorf, Wen-tau Yih, Noah A. Smith, Luke Zettlemoyer, Tao Yu

Figure 1 for One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Figure 2 for One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Figure 3 for One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Figure 4 for One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Viaarxiv icon

PromptCap: Prompt-Guided Task-Aware Image Captioning

Add code
Bookmark button
Alert button
Nov 15, 2022
Yushi Hu, Hang Hua, Zhengyuan Yang, Weijia Shi, Noah A. Smith, Jiebo Luo

Figure 1 for PromptCap: Prompt-Guided Task-Aware Image Captioning
Figure 2 for PromptCap: Prompt-Guided Task-Aware Image Captioning
Figure 3 for PromptCap: Prompt-Guided Task-Aware Image Captioning
Figure 4 for PromptCap: Prompt-Guided Task-Aware Image Captioning
Viaarxiv icon

Binding Language Models in Symbolic Languages

Add code
Bookmark button
Alert button
Oct 06, 2022
Zhoujun Cheng, Tianbao Xie, Peng Shi, Chengzu Li, Rahul Nadkarni, Yushi Hu, Caiming Xiong, Dragomir Radev, Mari Ostendorf, Luke Zettlemoyer, Noah A. Smith, Tao Yu

Figure 1 for Binding Language Models in Symbolic Languages
Figure 2 for Binding Language Models in Symbolic Languages
Figure 3 for Binding Language Models in Symbolic Languages
Figure 4 for Binding Language Models in Symbolic Languages
Viaarxiv icon