Alert button
Picture for Robin Jia

Robin Jia

Alert button

Proving membership in LLM pretraining data via data watermarks

Feb 16, 2024
Johnny Tian-Zheng Wei, Ryan Yixiang Wang, Robin Jia

Viaarxiv icon

Does VLN Pretraining Work with Nonsensical or Irrelevant Instructions?

Dec 02, 2023
Wang Zhu, Ishika Singh, Yuan Huang, Robin Jia, Jesse Thomason

Viaarxiv icon

Efficient End-to-End Visual Document Understanding with Rationale Distillation

Nov 16, 2023
Wang Zhu, Alekh Agarwal, Mandar Joshi, Robin Jia, Jesse Thomason, Kristina Toutanova

Viaarxiv icon

Do Localization Methods Actually Localize Memorized Data in LLMs?

Nov 15, 2023
Ting-Yun Chang, Jesse Thomason, Robin Jia

Viaarxiv icon

Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Models

Oct 26, 2023
Deqing Fu, Tian-Qi Chen, Robin Jia, Vatsal Sharan

Viaarxiv icon

How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench

May 24, 2023
Qinyuan Ye, Harvey Yiyun Fu, Xiang Ren, Robin Jia

Figure 1 for How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench
Figure 2 for How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench
Figure 3 for How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench
Figure 4 for How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench
Viaarxiv icon

Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering

May 24, 2023
Wang Zhu, Jesse Thomason, Robin Jia

Figure 1 for Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering
Figure 2 for Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering
Figure 3 for Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering
Figure 4 for Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering
Viaarxiv icon

Estimating Large Language Model Capabilities without Labeled Test Data

May 24, 2023
Harvey Yiyun Fu, Qinyuan Ye, Albert Xu, Xiang Ren, Robin Jia

Figure 1 for Estimating Large Language Model Capabilities without Labeled Test Data
Figure 2 for Estimating Large Language Model Capabilities without Labeled Test Data
Figure 3 for Estimating Large Language Model Capabilities without Labeled Test Data
Figure 4 for Estimating Large Language Model Capabilities without Labeled Test Data
Viaarxiv icon

SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples

May 13, 2023
Deqing Fu, Ameya Godbole, Robin Jia

Figure 1 for SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples
Figure 2 for SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples
Figure 3 for SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples
Figure 4 for SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples
Viaarxiv icon