Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing


Mar 20, 2023
Xiaozhe Ren, Pingyi Zhou, Xinfan Meng, Xinjing Huang, Yadao Wang, Weichao Wang, Pengfei Li, Xiaoda Zhang, Alexander Podolskiy, Grigory Arshinov, Andrey Bout, Irina Piontkovskaya, Jiansheng Wei, Xin Jiang, Teng Su, Qun Liu, Jun Yao

Add code


   Access Paper or Ask Questions

Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution


Jun 07, 2022
Nikolay Arefyev, Boris Sheludko, Alexander Podolskiy, Alexander Panchenko

Add code

* Proceedings of the 28th International Conference on Computational Linguistics, pages 1242-1255, Barcelona, Spain (Online). International Committee on Computational Linguistics. 2022 
* arXiv admin note: text overlap with arXiv:2006.00031 

   Access Paper or Ask Questions

Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection


Jan 11, 2021
Alexander Podolskiy, Dmitry Lipin, Andrey Bout, Ekaterina Artemova, Irina Piontkovskaya

Add code

* to appear in AAAI 2021 

   Access Paper or Ask Questions

A Comparative Study of Lexical Substitution Approaches based on Neural Language Models


May 29, 2020
Nikolay Arefyev, Boris Sheludko, Alexander Podolskiy, Alexander Panchenko

Add code


   Access Paper or Ask Questions