Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Yimeng Wu

ALP-KD: Attention-Based Layer Projection for Knowledge Distillation

Dec 27, 2020
Peyman Passban, Yimeng Wu, Mehdi Rezagholizadeh, Qun Liu

* AAAI 2021. This work has been done while Peyman Passban was at Huawei 

  Access Paper or Ask Questions

Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers

Oct 06, 2020
Yimeng Wu, Peyman Passban, Mehdi Rezagholizade, Qun Liu

* The first two authors contributed equally 

  Access Paper or Ask Questions