Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

4-bit Quantization of LSTM-based Speech Recognition Models



Andrea Fasoli , Chia-Yu Chen , Mauricio Serrano , Xiao Sun , Naigang Wang , Swagath Venkataramani , George Saon , Xiaodong Cui , Brian Kingsbury , Wei Zhang , Zoltán Tüske , Kailash Gopalakrishnan

* 5 pages, 3 figures, Andrea Fasoli and Chia-Yu Chen equally contributed to this work. Paper accepted to Interspeech 2021 

   Access Paper or Ask Questions

ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training



Chia-Yu Chen , Jiamin Ni , Songtao Lu , Xiaodong Cui , Pin-Yu Chen , Xiao Sun , Naigang Wang , Swagath Venkataramani , Vijayalakshmi Srinivasan , Wei Zhang , Kailash Gopalakrishnan

* NeurIPS2020 accepted https://proceedings.neurips.cc/paper/2020/hash/9d58963592071dbf38a0fa114269959c-Abstract.html 

   Access Paper or Ask Questions

All at Once Network Quantization via Collaborative Knowledge Transfer



Ximeng Sun , Rameswar Panda , Chun-Fu Chen , Naigang Wang , Bowen Pan Kailash Gopalakrishnan , Aude Oliva , Rogerio Feris , Kate Saenko


   Access Paper or Ask Questions

A Comprehensive Survey on Hardware-Aware Neural Architecture Search



Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

* Submitted to Proceedings of IEEE 

   Access Paper or Ask Questions

Accumulation Bit-Width Scaling For Ultra-Low Precision Training Of Deep Networks



Charbel Sakr , Naigang Wang , Chia-Yu Chen , Jungwook Choi , Ankur Agrawal , Naresh Shanbhag , Kailash Gopalakrishnan

* Published as a conference paper in ICLR 2019 

   Access Paper or Ask Questions

Training Deep Neural Networks with 8-bit Floating Point Numbers



Naigang Wang , Jungwook Choi , Daniel Brand , Chia-Yu Chen , Kailash Gopalakrishnan

* NeurIPS 2018 (12 pages) 

   Access Paper or Ask Questions