Alert button
Picture for Dani Yogatama

Dani Yogatama

Alert button

Understanding In-Context Learning with a Pelican Soup Framework

Feb 16, 2024
Ting-Rui Chiang, Dani Yogatama

Viaarxiv icon

DeLLMa: A Framework for Decision Making Under Uncertainty with Large Language Models

Feb 04, 2024
Ollie Liu, Deqing Fu, Dani Yogatama, Willie Neiswanger

Viaarxiv icon

On Retrieval Augmentation and the Limitations of Language Model Training

Nov 16, 2023
Ting-Rui Chiang, Xinyan Velocity Yu, Joshua Robinson, Ollie Liu, Isabelle Lee, Dani Yogatama

Viaarxiv icon

The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining

Oct 25, 2023
Ting-Rui Chiang, Dani Yogatama

Viaarxiv icon

Interpretable Diffusion via Information Decomposition

Oct 12, 2023
Xianghao Kong, Ollie Liu, Han Li, Dani Yogatama, Greg Ver Steeg

Figure 1 for Interpretable Diffusion via Information Decomposition
Figure 2 for Interpretable Diffusion via Information Decomposition
Figure 3 for Interpretable Diffusion via Information Decomposition
Figure 4 for Interpretable Diffusion via Information Decomposition
Viaarxiv icon

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

Jul 21, 2022
Yi Tay, Mostafa Dehghani, Samira Abnar, Hyung Won Chung, William Fedus, Jinfeng Rao, Sharan Narang, Vinh Q. Tran, Dani Yogatama, Donald Metzler

Figure 1 for Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Figure 2 for Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Figure 3 for Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Figure 4 for Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Viaarxiv icon

Questions Are All You Need to Train a Dense Passage Retriever

Jun 21, 2022
Devendra Singh Sachan, Mike Lewis, Dani Yogatama, Luke Zettlemoyer, Joelle Pineau, Manzil Zaheer

Figure 1 for Questions Are All You Need to Train a Dense Passage Retriever
Figure 2 for Questions Are All You Need to Train a Dense Passage Retriever
Figure 3 for Questions Are All You Need to Train a Dense Passage Retriever
Figure 4 for Questions Are All You Need to Train a Dense Passage Retriever
Viaarxiv icon

Emergent Abilities of Large Language Models

Jun 15, 2022
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus

Figure 1 for Emergent Abilities of Large Language Models
Figure 2 for Emergent Abilities of Large Language Models
Figure 3 for Emergent Abilities of Large Language Models
Figure 4 for Emergent Abilities of Large Language Models
Viaarxiv icon

Language Models Can See: Plugging Visual Controls in Text Generation

May 05, 2022
Yixuan Su, Tian Lan, Yahui Liu, Fangyu Liu, Dani Yogatama, Yan Wang, Lingpeng Kong, Nigel Collier

Figure 1 for Language Models Can See: Plugging Visual Controls in Text Generation
Figure 2 for Language Models Can See: Plugging Visual Controls in Text Generation
Figure 3 for Language Models Can See: Plugging Visual Controls in Text Generation
Figure 4 for Language Models Can See: Plugging Visual Controls in Text Generation
Viaarxiv icon

HighMMT: Towards Modality and Task Generalization for High-Modality Representation Learning

Mar 04, 2022
Paul Pu Liang, Yiwei Lyu, Xiang Fan, Shentong Mo, Dani Yogatama, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for HighMMT: Towards Modality and Task Generalization for High-Modality Representation Learning
Figure 2 for HighMMT: Towards Modality and Task Generalization for High-Modality Representation Learning
Figure 3 for HighMMT: Towards Modality and Task Generalization for High-Modality Representation Learning
Figure 4 for HighMMT: Towards Modality and Task Generalization for High-Modality Representation Learning
Viaarxiv icon