Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Qiuhui Liu

Qiuhui Liu

Learning Hard Retrieval Cross Attention for Transformer

Sep 30, 2020
Hongfei Xu, Qiuhui Liu

Figure 1 for Learning Hard Retrieval Cross Attention for Transformer

Figure 2 for Learning Hard Retrieval Cross Attention for Transformer

Figure 3 for Learning Hard Retrieval Cross Attention for Transformer

Figure 4 for Learning Hard Retrieval Cross Attention for Transformer

Access Paper or Ask Questions

Why Deep Transformers are Difficult to Converge? From Computation Order to Lipschitz Restricted Parameter Initialization

Nov 08, 2019
Hongfei Xu, Qiuhui Liu, Josef van Genabith, Jingyi Zhang

Figure 1 for Why Deep Transformers are Difficult to Converge? From Computation Order to Lipschitz Restricted Parameter Initialization

Figure 2 for Why Deep Transformers are Difficult to Converge? From Computation Order to Lipschitz Restricted Parameter Initialization

Figure 3 for Why Deep Transformers are Difficult to Converge? From Computation Order to Lipschitz Restricted Parameter Initialization

Figure 4 for Why Deep Transformers are Difficult to Converge? From Computation Order to Lipschitz Restricted Parameter Initialization

* A similar work (Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention) is accepted by EMNLP 2019, but there are differences between in analysis and approaches

Access Paper or Ask Questions

UdS Submission for the WMT 19 Automatic Post-Editing Task

Aug 09, 2019
Hongfei Xu, Qiuhui Liu, Josef van Genabith

Figure 1 for UdS Submission for the WMT 19 Automatic Post-Editing Task

Figure 2 for UdS Submission for the WMT 19 Automatic Post-Editing Task

Figure 3 for UdS Submission for the WMT 19 Automatic Post-Editing Task

Figure 4 for UdS Submission for the WMT 19 Automatic Post-Editing Task

* WMT 2019 Automatic Post-Editing Shared Task Paper

Access Paper or Ask Questions

Neutron: An Implementation of the Transformer Translation Model and its Variants

Mar 18, 2019
Hongfei Xu, Qiuhui Liu

Figure 1 for Neutron: An Implementation of the Transformer Translation Model and its Variants

Figure 2 for Neutron: An Implementation of the Transformer Translation Model and its Variants

Access Paper or Ask Questions