Picture for Xinyao Niu

Xinyao Niu

The Fine Line: Navigating Large Language Model Pretraining with Down-streaming Capability Analysis

Add code
Apr 01, 2024
Viaarxiv icon

Yi: Open Foundation Models by 01.AI

Add code
Mar 07, 2024
Figure 1 for Yi: Open Foundation Models by 01.AI
Figure 2 for Yi: Open Foundation Models by 01.AI
Figure 3 for Yi: Open Foundation Models by 01.AI
Figure 4 for Yi: Open Foundation Models by 01.AI
Viaarxiv icon

Machine Unlearning of Pre-trained Large Language Models

Add code
Feb 27, 2024
Viaarxiv icon

Data Engineering for Scaling Language Models to 128K Context

Add code
Feb 15, 2024
Viaarxiv icon