Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Representing Long-Range Context for Graph Neural Networks with Global Attention


Jan 21, 2022
Zhanghao Wu, Paras Jain, Matthew A. Wright, Azalia Mirhoseini, Joseph E. Gonzalez, Ion Stoica

* NeurIPS 2021. The first two authors contributed equally to this work 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Distributed Reinforcement Learning is a Dataflow Problem


Dec 03, 2020
Eric Liang, Zhanghao Wu, Michael Luo, Sven Mika, Ion Stoica

* This paper has been withdrawn by the author due to the need to compare sample throughput and training times to more dataflow-based frameworks 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

HAT: Hardware-Aware Transformers for Efficient Natural Language Processing


May 28, 2020
Hanrui Wang, Zhanghao Wu, Zhijian Liu, Han Cai, Ligeng Zhu, Chuang Gan, Song Han

* Accepted to ACL 2020. 14 pages, 12 figures. Code available at http://github.com/mit-han-lab/hardware-aware-transformers.git 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Lite Transformer with Long-Short Range Attention


Apr 24, 2020
Zhanghao Wu, Zhijian Liu, Ji Lin, Yujun Lin, Song Han

* ICLR 2020. The first two authors contributed equally to this work 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email