Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox
Picture for Hongkun Yu

Hongkun Yu
Alert button

Scaling Instruction-Finetuned Language Models


Oct 20, 2022
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Zhao, Yanping Huang, Andrew Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei

Add code
Alert button

Figure 1 for Scaling Instruction-Finetuned Language Models
Figure 2 for Scaling Instruction-Finetuned Language Models
Figure 3 for Scaling Instruction-Finetuned Language Models
Figure 4 for Scaling Instruction-Finetuned Language Models
* Public checkpoints: https://github.com/google-research/t5x/blob/main/docs/models.md#flan-t5-checkpoints 
   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks


Oct 16, 2021
Frederick Liu, Siamak Shakeri, Hongkun Yu, Jing Li

Add code
Alert button

Figure 1 for EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks
Figure 2 for EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks
Figure 3 for EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks

   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

On the Transformer Growth for Progressive BERT Training


Oct 23, 2020
Xiaotao Gu, Liyuan Liu, Hongkun Yu, Jing Li, Chen Chen, Jiawei Han

Add code
Alert button

Figure 1 for On the Transformer Growth for Progressive BERT Training
Figure 2 for On the Transformer Growth for Progressive BERT Training
Figure 3 for On the Transformer Growth for Progressive BERT Training
Figure 4 for On the Transformer Growth for Progressive BERT Training

   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices


Apr 14, 2020
Zhiqing Sun, Hongkun Yu, Xiaodan Song, Renjie Liu, Yiming Yang, Denny Zhou

Add code
Alert button

Figure 1 for MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
Figure 2 for MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
Figure 3 for MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
Figure 4 for MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
* Accepted to ACL 2020 
   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Generating Representative Headlines for News Stories


Feb 01, 2020
Xiaotao Gu, Yuning Mao, Jiawei Han, Jialu Liu, Hongkun Yu, You Wu, Cong Yu, Daniel Finnie, Jiaqi Zhai, Nicholas Zukoski

Add code
Alert button

Figure 1 for Generating Representative Headlines for News Stories
Figure 2 for Generating Representative Headlines for News Stories
Figure 3 for Generating Representative Headlines for News Stories
Figure 4 for Generating Representative Headlines for News Stories
* WebConf 2020 (WWW 2020) 
   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email