Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Learning Hard Retrieval Cross Attention for Transformer


Sep 30, 2020
Hongfei Xu, Qiuhui Liu

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Transformer with Depth-Wise LSTM


Jul 13, 2020
Hongfei Xu, Qiuhui Liu, Deyi Xiong, Josef van Genabith

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Learning Source Phrase Representations for Neural Machine Translation


Jun 25, 2020
Hongfei Xu, Josef van Genabith, Deyi Xiong, Qiuhui Liu, Jingyi Zhang

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Dynamically Adjusting Transformer Batch Size by Monitoring Gradient Direction Change


May 05, 2020
Hongfei Xu, Josef van Genabith, Deyi Xiong, Qiuhui Liu

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Analyzing Word Translation of Transformer Layers


Mar 21, 2020
Hongfei Xu, Josef van Genabith, Deyi Xiong, Qiuhui Liu

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Why Deep Transformers are Difficult to Converge? From Computation Order to Lipschitz Restricted Parameter Initialization


Nov 08, 2019
Hongfei Xu, Qiuhui Liu, Josef van Genabith, Jingyi Zhang

Add code

* A similar work (Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention) is accepted by EMNLP 2019, but there are differences between in analysis and approaches 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

UdS Submission for the WMT 19 Automatic Post-Editing Task


Aug 09, 2019
Hongfei Xu, Qiuhui Liu, Josef van Genabith

Add code

* WMT 2019 Automatic Post-Editing Shared Task Paper 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Neutron: An Implementation of the Transformer Translation Model and its Variants


Mar 18, 2019
Hongfei Xu, Qiuhui Liu

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email