Alert button
Picture for Kshitiz Malik

Kshitiz Malik

Alert button

Effective Long-Context Scaling of Foundation Models

Sep 27, 2023
Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma

Figure 1 for Effective Long-Context Scaling of Foundation Models
Figure 2 for Effective Long-Context Scaling of Foundation Models
Figure 3 for Effective Long-Context Scaling of Foundation Models
Figure 4 for Effective Long-Context Scaling of Foundation Models
Viaarxiv icon

Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning

Oct 14, 2022
John Nguyen, Jianyu Wang, Kshitiz Malik, Maziar Sanjabi, Michael Rabbat

Figure 1 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Figure 2 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Figure 3 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Figure 4 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Viaarxiv icon

Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning

Jun 30, 2022
John Nguyen, Kshitiz Malik, Maziar Sanjabi, Michael Rabbat

Figure 1 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Figure 2 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Figure 3 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Figure 4 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Viaarxiv icon

Federated Learning with Partial Model Personalization

Apr 08, 2022
Krishna Pillutla, Kshitiz Malik, Abdelrahman Mohamed, Michael Rabbat, Maziar Sanjabi, Lin Xiao

Figure 1 for Federated Learning with Partial Model Personalization
Figure 2 for Federated Learning with Partial Model Personalization
Figure 3 for Federated Learning with Partial Model Personalization
Figure 4 for Federated Learning with Partial Model Personalization
Viaarxiv icon

FedSynth: Gradient Compression via Synthetic Data in Federated Learning

Apr 04, 2022
Shengyuan Hu, Jack Goetz, Kshitiz Malik, Hongyuan Zhan, Zhe Liu, Yue Liu

Figure 1 for FedSynth: Gradient Compression via Synthetic Data in Federated Learning
Figure 2 for FedSynth: Gradient Compression via Synthetic Data in Federated Learning
Figure 3 for FedSynth: Gradient Compression via Synthetic Data in Federated Learning
Viaarxiv icon

Papaya: Practical, Private, and Scalable Federated Learning

Nov 08, 2021
Dzmitry Huba, John Nguyen, Kshitiz Malik, Ruiyu Zhu, Mike Rabbat, Ashkan Yousefpour, Carole-Jean Wu, Hongyuan Zhan, Pavel Ustinov, Harish Srinivas, Kaikai Wang, Anthony Shoumikhin, Jesik Min, Mani Malek

Figure 1 for Papaya: Practical, Private, and Scalable Federated Learning
Figure 2 for Papaya: Practical, Private, and Scalable Federated Learning
Figure 3 for Papaya: Practical, Private, and Scalable Federated Learning
Figure 4 for Papaya: Practical, Private, and Scalable Federated Learning
Viaarxiv icon

Federated Learning with Buffered Asynchronous Aggregation

Jun 11, 2021
John Nguyen, Kshitiz Malik, Hongyuan Zhan, Ashkan Yousefpour, Michael Rabbat, Mani Malek Esmaeili, Dzmitry Huba

Figure 1 for Federated Learning with Buffered Asynchronous Aggregation
Figure 2 for Federated Learning with Buffered Asynchronous Aggregation
Figure 3 for Federated Learning with Buffered Asynchronous Aggregation
Figure 4 for Federated Learning with Buffered Asynchronous Aggregation
Viaarxiv icon

Active Federated Learning

Sep 27, 2019
Jack Goetz, Kshitiz Malik, Duc Bui, Seungwhan Moon, Honglei Liu, Anuj Kumar

Figure 1 for Active Federated Learning
Figure 2 for Active Federated Learning
Figure 3 for Active Federated Learning
Viaarxiv icon

Federated User Representation Learning

Sep 27, 2019
Duc Bui, Kshitiz Malik, Jack Goetz, Honglei Liu, Seungwhan Moon, Anuj Kumar, Kang G. Shin

Figure 1 for Federated User Representation Learning
Figure 2 for Federated User Representation Learning
Figure 3 for Federated User Representation Learning
Figure 4 for Federated User Representation Learning
Viaarxiv icon