Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Aditya Siddhant

nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models?


Jun 03, 2021
Mihir Kale, Aditya Siddhant, Noah Constant, Melvin Johnson, Rami Al-Rfou, Linting Xue

* Accepted at ACL-IJCNLP 2021 

  Access Paper or Ask Questions

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation


Apr 15, 2021
Sebastian Ruder, Noah Constant, Jan Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, Melvin Johnson


  Access Paper or Ask Questions

Distilling Large Language Models into Tiny and Effective Students using pQRNN


Jan 21, 2021
Prabhu Kaliamoorthi, Aditya Siddhant, Edward Li, Melvin Johnson


  Access Paper or Ask Questions

mT5: A massively multilingual pre-trained text-to-text transformer


Oct 23, 2020
Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel


  Access Paper or Ask Questions

Explicit Alignment Objectives for Multilingual Bidirectional Encoders


Oct 15, 2020
Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig


  Access Paper or Ask Questions

Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages


Sep 23, 2020
Xavier Garcia, Aditya Siddhant, Orhan Firat, Ankur P. Parikh


  Access Paper or Ask Questions

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation


May 11, 2020
Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, Yonghui Wu

* ACL 2020 

  Access Paper or Ask Questions

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization


Apr 10, 2020
Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson


  Access Paper or Ask Questions

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation


Sep 01, 2019
Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman


  Access Paper or Ask Questions

Supervised Contextual Embeddings for Transfer Learning in Natural Language Processing Tasks


Jun 28, 2019
Mihir Kale, Aditya Siddhant, Sreyashi Nag, Radhika Parik, Matthias Grabmair, Anthony Tomasic

* Appeared in 2nd Learning from Limited Labeled Data (LLD) Workshop at ICLR 2019 

  Access Paper or Ask Questions

Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent Agents


Nov 13, 2018
Aditya Siddhant, Anuj Goyal, Angeliki Metallinou

* To appear at AAAI 2019 

  Access Paper or Ask Questions

Deep Bayesian Active Learning for Natural Language Processing: Results of a Large-Scale Empirical Study


Sep 24, 2018
Aditya Siddhant, Zachary C. Lipton

* To be presented at EMNLP 2018 

  Access Paper or Ask Questions

Leveraging Native Language Speech for Accent Identification using Deep Siamese Networks


Jun 18, 2018
Aditya Siddhant, Preethi Jyothi, Sriram Ganapathy

* Published in ASRU 2017 

  Access Paper or Ask Questions