Alert button
Picture for Zhiyang Xu

Zhiyang Xu

Alert button

Multimodal Instruction Tuning with Conditional Mixture of LoRA

Feb 24, 2024
Ying Shen, Zhiyang Xu, Qifan Wang, Yu Cheng, Wenpeng Yin, Lifu Huang

Viaarxiv icon

Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning

Feb 18, 2024
Zhiyang Xu, Chao Feng, Rulin Shao, Trevor Ashby, Ying Shen, Di Jin, Yu Cheng, Qifan Wang, Lifu Huang

Viaarxiv icon

X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects

Nov 15, 2023
Minqian Liu, Ying Shen, Zhiyang Xu, Yixin Cao, Eunah Cho, Vaibhav Kumar, Reza Ghanadan, Lifu Huang

Viaarxiv icon

MULTISCRIPT: Multimodal Script Learning for Supporting Open Domain Everyday Tasks

Oct 08, 2023
Jingyuan Qi, Minqian Liu, Ying Shen, Zhiyang Xu, Lifu Huang

Viaarxiv icon

The Art of SOCRATIC QUESTIONING: Zero-shot Multimodal Reasoning with Recursive Thinking and Self-Questioning

May 24, 2023
Jingyuan Qi, Zhiyang Xu, Ying Shen, Minqian Liu, Di Jin, Qifan Wang, Lifu Huang

Figure 1 for The Art of SOCRATIC QUESTIONING: Zero-shot Multimodal Reasoning with Recursive Thinking and Self-Questioning
Figure 2 for The Art of SOCRATIC QUESTIONING: Zero-shot Multimodal Reasoning with Recursive Thinking and Self-Questioning
Figure 3 for The Art of SOCRATIC QUESTIONING: Zero-shot Multimodal Reasoning with Recursive Thinking and Self-Questioning
Figure 4 for The Art of SOCRATIC QUESTIONING: Zero-shot Multimodal Reasoning with Recursive Thinking and Self-Questioning
Viaarxiv icon

AMELI: Enhancing Multimodal Entity Linking with Fine-Grained Attributes

May 24, 2023
Barry Menglong Yao, Yu Chen, Qifan Wang, Sijia Wang, Minqian Liu, Zhiyang Xu, Licheng Yu, Lifu Huang

Figure 1 for AMELI: Enhancing Multimodal Entity Linking with Fine-Grained Attributes
Figure 2 for AMELI: Enhancing Multimodal Entity Linking with Fine-Grained Attributes
Figure 3 for AMELI: Enhancing Multimodal Entity Linking with Fine-Grained Attributes
Figure 4 for AMELI: Enhancing Multimodal Entity Linking with Fine-Grained Attributes
Viaarxiv icon

Iteratively Improving Biomedical Entity Linking and Event Extraction via Hard Expectation-Maximization

May 24, 2023
Xiaochu Li, Minqian Liu, Zhiyang Xu, Lifu Huang

Figure 1 for Iteratively Improving Biomedical Entity Linking and Event Extraction via Hard Expectation-Maximization
Figure 2 for Iteratively Improving Biomedical Entity Linking and Event Extraction via Hard Expectation-Maximization
Figure 3 for Iteratively Improving Biomedical Entity Linking and Event Extraction via Hard Expectation-Maximization
Figure 4 for Iteratively Improving Biomedical Entity Linking and Event Extraction via Hard Expectation-Maximization
Viaarxiv icon

MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning

Dec 21, 2022
Zhiyang Xu, Ying Shen, Lifu Huang

Figure 1 for MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
Figure 2 for MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
Figure 3 for MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
Figure 4 for MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
Viaarxiv icon

Improve Event Extraction via Self-Training with Gradient Guidance

May 25, 2022
Zhiyang Xu, Lifu Huang

Figure 1 for Improve Event Extraction via Self-Training with Gradient Guidance
Figure 2 for Improve Event Extraction via Self-Training with Gradient Guidance
Figure 3 for Improve Event Extraction via Self-Training with Gradient Guidance
Figure 4 for Improve Event Extraction via Self-Training with Gradient Guidance
Viaarxiv icon

Identifying and Measuring Token-Level Sentiment Bias in Pre-trained Language Models with Prompts

Apr 15, 2022
Apoorv Garg, Deval Srivastava, Zhiyang Xu, Lifu Huang

Figure 1 for Identifying and Measuring Token-Level Sentiment Bias in Pre-trained Language Models with Prompts
Figure 2 for Identifying and Measuring Token-Level Sentiment Bias in Pre-trained Language Models with Prompts
Figure 3 for Identifying and Measuring Token-Level Sentiment Bias in Pre-trained Language Models with Prompts
Figure 4 for Identifying and Measuring Token-Level Sentiment Bias in Pre-trained Language Models with Prompts
Viaarxiv icon