Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Zhangyue Yin

Zhangyue Yin

What Dense Graph Do You Need for Self-Attention?

Jun 09, 2022
Yuxing Wang, Chu-Tak Lee, Qipeng Guo, Zhangyue Yin, Yunhua Zhou, Xuanjing Huang, Xipeng Qiu

Figure 1 for What Dense Graph Do You Need for Self-Attention?

Figure 2 for What Dense Graph Do You Need for Self-Attention?

Figure 3 for What Dense Graph Do You Need for Self-Attention?

Figure 4 for What Dense Graph Do You Need for Self-Attention?

* Accepted by ICML 2022. Code is available at https://github.com/yxzwang/Normalized-Information-Payload

Access Paper or Ask Questions