Alert button
Picture for Renjie Pi

Renjie Pi

Alert button

Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization

Mar 13, 2024
Renjie Pi, Tianyang Han, Wei Xiong, Jipeng Zhang, Runtao Liu, Rui Pan, Tong Zhang

Viaarxiv icon

GradSafe: Detecting Unsafe Prompts for LLMs via Safety-Critical Gradient Analysis

Feb 21, 2024
Yueqi Xie, Minghong Fang, Renjie Pi, Neil Gong

Viaarxiv icon

SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmark

Feb 06, 2024
Zhenwen Liang, Kehan Guo, Gang Liu, Taicheng Guo, Yujun Zhou, Tianyu Yang, Jiajun Jiao, Renjie Pi, Jipeng Zhang, Xiangliang Zhang

Viaarxiv icon

The Instinctive Bias: Spurious Images lead to Hallucination in MLLMs

Feb 06, 2024
Tianyang Han, Qing Lian, Rui Pan, Renjie Pi, Jipeng Zhang, Shizhe Diao, Yong Lin, Tong Zhang

Viaarxiv icon

MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance

Jan 17, 2024
Renjie Pi, Tianyang Han, Yueqi Xie, Rui Pan, Qing Lian, Hanze Dong, Jipeng Zhang, Tong Zhang

Viaarxiv icon

G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Model

Dec 18, 2023
Jiahui Gao, Renjie Pi, Jipeng Zhang, Jiacheng Ye, Wanjun Zhong, Yufei Wang, Lanqing Hong, Jianhua Han, Hang Xu, Zhenguo Li, Lingpeng Kong

Viaarxiv icon

PerceptionGPT: Effectively Fusing Visual Perception into LLM

Nov 11, 2023
Renjie Pi, Lewei Yao, Jiahui Gao, Jipeng Zhang, Tong Zhang

Figure 1 for PerceptionGPT: Effectively Fusing Visual Perception into LLM
Figure 2 for PerceptionGPT: Effectively Fusing Visual Perception into LLM
Figure 3 for PerceptionGPT: Effectively Fusing Visual Perception into LLM
Figure 4 for PerceptionGPT: Effectively Fusing Visual Perception into LLM
Viaarxiv icon

Speciality vs Generality: An Empirical Study on Catastrophic Forgetting in Fine-tuning Foundation Models

Sep 12, 2023
Yong Lin, Lu Tan, Hangyu Lin, Zeming Zheng, Renjie Pi, Jipeng Zhang, Shizhe Diao, Haoxiang Wang, Han Zhao, Yuan Yao, Tong Zhang

Figure 1 for Speciality vs Generality: An Empirical Study on Catastrophic Forgetting in Fine-tuning Foundation Models
Figure 2 for Speciality vs Generality: An Empirical Study on Catastrophic Forgetting in Fine-tuning Foundation Models
Figure 3 for Speciality vs Generality: An Empirical Study on Catastrophic Forgetting in Fine-tuning Foundation Models
Figure 4 for Speciality vs Generality: An Empirical Study on Catastrophic Forgetting in Fine-tuning Foundation Models
Viaarxiv icon

DetGPT: Detect What You Need via Reasoning

May 24, 2023
Renjie Pi, Jiahui Gao, Shizhe Diao, Rui Pan, Hanze Dong, Jipeng Zhang, Lewei Yao, Jianhua Han, Hang Xu, Lingpeng Kong, Tong Zhang

Figure 1 for DetGPT: Detect What You Need via Reasoning
Figure 2 for DetGPT: Detect What You Need via Reasoning
Figure 3 for DetGPT: Detect What You Need via Reasoning
Figure 4 for DetGPT: Detect What You Need via Reasoning
Viaarxiv icon

Effective Bilevel Optimization via Minimax Reformulation

May 22, 2023
Xiaoyu Wang, Rui Pan, Renjie Pi, Tong Zhang

Figure 1 for Effective Bilevel Optimization via Minimax Reformulation
Figure 2 for Effective Bilevel Optimization via Minimax Reformulation
Figure 3 for Effective Bilevel Optimization via Minimax Reformulation
Figure 4 for Effective Bilevel Optimization via Minimax Reformulation
Viaarxiv icon