Picture for Alon Albalak

Alon Albalak

DataComp-LM: In search of the next generation of training sets for language models

Add code
Jun 18, 2024
Viaarxiv icon

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Add code
Apr 10, 2024
Viaarxiv icon

A Survey on Data Selection for Language Models

Add code
Mar 08, 2024
Viaarxiv icon

Efficient Online Data Mixing For Language Model Pre-Training

Dec 05, 2023
Figure 1 for Efficient Online Data Mixing For Language Model Pre-Training
Figure 2 for Efficient Online Data Mixing For Language Model Pre-Training
Figure 3 for Efficient Online Data Mixing For Language Model Pre-Training
Figure 4 for Efficient Online Data Mixing For Language Model Pre-Training
Viaarxiv icon

RWKV: Reinventing RNNs for the Transformer Era

Add code
May 22, 2023
Figure 1 for RWKV: Reinventing RNNs for the Transformer Era
Figure 2 for RWKV: Reinventing RNNs for the Transformer Era
Figure 3 for RWKV: Reinventing RNNs for the Transformer Era
Figure 4 for RWKV: Reinventing RNNs for the Transformer Era
Viaarxiv icon

Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning

Add code
May 20, 2023
Figure 1 for Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
Figure 2 for Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
Figure 3 for Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
Figure 4 for Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
Viaarxiv icon

Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data

Add code
Feb 06, 2023
Figure 1 for Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data
Figure 2 for Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data
Figure 3 for Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data
Figure 4 for Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data
Viaarxiv icon

CausalDialogue: Modeling Utterance-level Causality in Conversations

Add code
Dec 20, 2022
Figure 1 for CausalDialogue: Modeling Utterance-level Causality in Conversations
Figure 2 for CausalDialogue: Modeling Utterance-level Causality in Conversations
Figure 3 for CausalDialogue: Modeling Utterance-level Causality in Conversations
Figure 4 for CausalDialogue: Modeling Utterance-level Causality in Conversations
Viaarxiv icon

Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models

Oct 08, 2022
Figure 1 for Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models
Figure 2 for Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models
Figure 3 for Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models
Figure 4 for Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models
Viaarxiv icon

Emotion Recognition in Conversation using Probabilistic Soft Logic

Jul 14, 2022
Figure 1 for Emotion Recognition in Conversation using Probabilistic Soft Logic
Figure 2 for Emotion Recognition in Conversation using Probabilistic Soft Logic
Figure 3 for Emotion Recognition in Conversation using Probabilistic Soft Logic
Figure 4 for Emotion Recognition in Conversation using Probabilistic Soft Logic
Viaarxiv icon