Picture for David Grangier

David Grangier

Specialized Language Models with Cheap Inference from Limited Domain Data

Feb 02, 2024
Viaarxiv icon

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

Add code
Jan 29, 2024
Viaarxiv icon

Adaptive Training Distributions with Scalable Online Bilevel Optimization

Nov 20, 2023
Figure 1 for Adaptive Training Distributions with Scalable Online Bilevel Optimization
Figure 2 for Adaptive Training Distributions with Scalable Online Bilevel Optimization
Figure 3 for Adaptive Training Distributions with Scalable Online Bilevel Optimization
Figure 4 for Adaptive Training Distributions with Scalable Online Bilevel Optimization
Viaarxiv icon

Transfer Learning for Structured Pruning under Limited Task Data

Nov 10, 2023
Figure 1 for Transfer Learning for Structured Pruning under Limited Task Data
Figure 2 for Transfer Learning for Structured Pruning under Limited Task Data
Figure 3 for Transfer Learning for Structured Pruning under Limited Task Data
Figure 4 for Transfer Learning for Structured Pruning under Limited Task Data
Viaarxiv icon

High-Resource Methodological Bias in Low-Resource Investigations

Add code
Nov 14, 2022
Figure 1 for High-Resource Methodological Bias in Low-Resource Investigations
Figure 2 for High-Resource Methodological Bias in Low-Resource Investigations
Figure 3 for High-Resource Methodological Bias in Low-Resource Investigations
Figure 4 for High-Resource Methodological Bias in Low-Resource Investigations
Viaarxiv icon

AudioLM: a Language Modeling Approach to Audio Generation

Add code
Sep 07, 2022
Figure 1 for AudioLM: a Language Modeling Approach to Audio Generation
Figure 2 for AudioLM: a Language Modeling Approach to Audio Generation
Figure 3 for AudioLM: a Language Modeling Approach to Audio Generation
Figure 4 for AudioLM: a Language Modeling Approach to Audio Generation
Viaarxiv icon

Learning strides in convolutional neural networks

Add code
Feb 03, 2022
Figure 1 for Learning strides in convolutional neural networks
Figure 2 for Learning strides in convolutional neural networks
Figure 3 for Learning strides in convolutional neural networks
Figure 4 for Learning strides in convolutional neural networks
Viaarxiv icon

Minimum Bayes Risk Decoding with Neural Metrics of Translation Quality

Dec 02, 2021
Figure 1 for Minimum Bayes Risk Decoding with Neural Metrics of Translation Quality
Figure 2 for Minimum Bayes Risk Decoding with Neural Metrics of Translation Quality
Figure 3 for Minimum Bayes Risk Decoding with Neural Metrics of Translation Quality
Figure 4 for Minimum Bayes Risk Decoding with Neural Metrics of Translation Quality
Viaarxiv icon

The Trade-offs of Domain Adaptation for Neural Language Models

Sep 21, 2021
Viaarxiv icon

On the Complementarity of Data Selection and Fine Tuning for Domain Adaptation

Add code
Sep 15, 2021
Figure 1 for On the Complementarity of Data Selection and Fine Tuning for Domain Adaptation
Figure 2 for On the Complementarity of Data Selection and Fine Tuning for Domain Adaptation
Figure 3 for On the Complementarity of Data Selection and Fine Tuning for Domain Adaptation
Figure 4 for On the Complementarity of Data Selection and Fine Tuning for Domain Adaptation
Viaarxiv icon