Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Yin-Wen Chang

Leveraging redundancy in attention with Reuse Transformers

Oct 13, 2021
Srinadh Bhojanapalli, Ayan Chakrabarti, Andreas Veit, Michal Lukasik, Himanshu Jain, Frederick Liu, Yin-Wen Chang, Sanjiv Kumar

  Access Paper or Ask Questions

Demystifying the Better Performance of Position Encoding Variants for Transformer

Apr 18, 2021
Pu-Chin Chen, Henry Tsai, Srinadh Bhojanapalli, Hyung Won Chung, Yin-Wen Chang, Chun-Sung Ferng

* 17 pages, 6 figures 

  Access Paper or Ask Questions

$O(n)$ Connections are Expressive Enough: Universal Approximability of Sparse Transformers

Jun 08, 2020
Chulhee Yun, Yin-Wen Chang, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar

* 32 pages 

  Access Paper or Ask Questions

Pre-training Tasks for Embedding-based Large-scale Retrieval

Feb 10, 2020
Wei-Cheng Chang, Felix X. Yu, Yin-Wen Chang, Yiming Yang, Sanjiv Kumar

* Accepted by ICLR 2020 

  Access Paper or Ask Questions