Alert button

Learning to Grow Pretrained Models for Efficient Transformer Training

Mar 02, 2023
Peihao Wang, Rameswar Panda, Lucas Torroba Hennigen, Philip Greengard, Leonid Karlinsky, Rogerio Feris, David Daniel Cox, Zhangyang Wang, Yoon Kim

Figure 1 for Learning to Grow Pretrained Models for Efficient Transformer Training
Figure 2 for Learning to Grow Pretrained Models for Efficient Transformer Training
Figure 3 for Learning to Grow Pretrained Models for Efficient Transformer Training
Figure 4 for Learning to Grow Pretrained Models for Efficient Transformer Training

Share this with someone who'll enjoy it:

View paper onarxiv iconopen_review iconOpenReview

Share this with someone who'll enjoy it: