Alert button
Picture for Jiajun Shen

Jiajun Shen

Alert button

DiPaCo: Distributed Path Composition

Mar 15, 2024
Arthur Douillard, Qixuan Feng, Andrei A. Rusu, Adhiguna Kuncoro, Yani Donchev, Rachita Chhaparia, Ionel Gog, Marc'Aurelio Ranzato, Jiajun Shen, Arthur Szlam

Viaarxiv icon

Exploring Federated Self-Supervised Learning for General Purpose Audio Understanding

Feb 05, 2024
Yasar Abbas Ur Rehman, Kin Wai Lau, Yuyang Xie, Lan Ma, Jiajun Shen

Viaarxiv icon

Asynchronous Local-SGD Training for Language Modeling

Jan 17, 2024
Bo Liu, Rachita Chhaparia, Arthur Douillard, Satyen Kale, Andrei A. Rusu, Jiajun Shen, Arthur Szlam, Marc'Aurelio Ranzato

Viaarxiv icon

A Simple Recipe for Contrastively Pre-training Video-First Encoders Beyond 16 Frames

Dec 12, 2023
Pinelopi Papalampidi, Skanda Koppula, Shreya Pathak, Justin Chiu, Joe Heyward, Viorica Patraucean, Jiajun Shen, Antoine Miech, Andrew Zisserman, Aida Nematzdeh

Viaarxiv icon

DiLoCo: Distributed Low-Communication Training of Language Models

Nov 14, 2023
Arthur Douillard, Qixuan Feng, Andrei A. Rusu, Rachita Chhaparia, Yani Donchev, Adhiguna Kuncoro, Marc'Aurelio Ranzato, Arthur Szlam, Jiajun Shen

Viaarxiv icon

Adaptive Uncertainty Estimation via High-Dimensional Testing on Latent Representations

Oct 25, 2023
Tsai Hor Chan, Kin Wai Lau, Jiajun Shen, Guosheng Yin, Lequan Yu

Viaarxiv icon

L-DAWA: Layer-wise Divergence Aware Weight Aggregation in Federated Self-Supervised Visual Representation Learning

Jul 14, 2023
Yasar Abbas Ur Rehman, Yan Gao, Pedro Porto Buarque de Gusmão, Mina Alibeigi, Jiajun Shen, Nicholas D. Lane

Figure 1 for L-DAWA: Layer-wise Divergence Aware Weight Aggregation in Federated Self-Supervised Visual Representation Learning
Figure 2 for L-DAWA: Layer-wise Divergence Aware Weight Aggregation in Federated Self-Supervised Visual Representation Learning
Figure 3 for L-DAWA: Layer-wise Divergence Aware Weight Aggregation in Federated Self-Supervised Visual Representation Learning
Figure 4 for L-DAWA: Layer-wise Divergence Aware Weight Aggregation in Federated Self-Supervised Visual Representation Learning
Viaarxiv icon

Source-Aware Embedding Training on Heterogeneous Information Networks

Jul 10, 2023
Tsai Hor Chan, Chi Ho Wong, Jiajun Shen, Guosheng Yin

Figure 1 for Source-Aware Embedding Training on Heterogeneous Information Networks
Figure 2 for Source-Aware Embedding Training on Heterogeneous Information Networks
Figure 3 for Source-Aware Embedding Training on Heterogeneous Information Networks
Figure 4 for Source-Aware Embedding Training on Heterogeneous Information Networks
Viaarxiv icon

Making the Most of What You Have: Adapting Pre-trained Visual Language Models in the Low-data Regime

May 03, 2023
Chuhan Zhang, Antoine Miech, Jiajun Shen, Jean-Baptiste Alayrac, Pauline Luc

Figure 1 for Making the Most of What You Have: Adapting Pre-trained Visual Language Models in the Low-data Regime
Figure 2 for Making the Most of What You Have: Adapting Pre-trained Visual Language Models in the Low-data Regime
Figure 3 for Making the Most of What You Have: Adapting Pre-trained Visual Language Models in the Low-data Regime
Figure 4 for Making the Most of What You Have: Adapting Pre-trained Visual Language Models in the Low-data Regime
Viaarxiv icon

On the Benefits of Leveraging Structural Information in Planning Over the Learned Model

Mar 15, 2023
Jiajun Shen, Kananart Kuwaranancharoen, Raid Ayoub, Pietro Mercati, Shreyas Sundaram

Figure 1 for On the Benefits of Leveraging Structural Information in Planning Over the Learned Model
Figure 2 for On the Benefits of Leveraging Structural Information in Planning Over the Learned Model
Figure 3 for On the Benefits of Leveraging Structural Information in Planning Over the Learned Model
Figure 4 for On the Benefits of Leveraging Structural Information in Planning Over the Learned Model
Viaarxiv icon