Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Aditya Siddhant

Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning

Jan 13, 2022
Aditya Siddhant, Ankur Bapna, Orhan Firat, Yuan Cao, Mia Xu Chen, Isaac Caswell, Xavier Garcia

  Access Paper or Ask Questions

DOCmT5: Document-Level Pretraining of Multilingual Language Models

Dec 16, 2021
Chia-Hsuan Lee, Aditya Siddhant, Viresh Ratnakar, Melvin Johnson

  Access Paper or Ask Questions

nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models?

Jun 03, 2021
Mihir Kale, Aditya Siddhant, Noah Constant, Melvin Johnson, Rami Al-Rfou, Linting Xue

* Accepted at ACL-IJCNLP 2021 

  Access Paper or Ask Questions

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation

Apr 15, 2021
Sebastian Ruder, Noah Constant, Jan Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, Melvin Johnson

  Access Paper or Ask Questions

Distilling Large Language Models into Tiny and Effective Students using pQRNN

Jan 21, 2021
Prabhu Kaliamoorthi, Aditya Siddhant, Edward Li, Melvin Johnson

  Access Paper or Ask Questions

mT5: A massively multilingual pre-trained text-to-text transformer

Oct 23, 2020
Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel

  Access Paper or Ask Questions

Explicit Alignment Objectives for Multilingual Bidirectional Encoders

Oct 15, 2020
Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig

  Access Paper or Ask Questions

Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages

Sep 23, 2020
Xavier Garcia, Aditya Siddhant, Orhan Firat, Ankur P. Parikh

  Access Paper or Ask Questions

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation

May 11, 2020
Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, Yonghui Wu

* ACL 2020 

  Access Paper or Ask Questions

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

Apr 10, 2020
Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson

  Access Paper or Ask Questions

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation

Sep 01, 2019
Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman

  Access Paper or Ask Questions

Supervised Contextual Embeddings for Transfer Learning in Natural Language Processing Tasks

Jun 28, 2019
Mihir Kale, Aditya Siddhant, Sreyashi Nag, Radhika Parik, Matthias Grabmair, Anthony Tomasic

* Appeared in 2nd Learning from Limited Labeled Data (LLD) Workshop at ICLR 2019 

  Access Paper or Ask Questions

Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent Agents

Nov 13, 2018
Aditya Siddhant, Anuj Goyal, Angeliki Metallinou

* To appear at AAAI 2019 

  Access Paper or Ask Questions

Deep Bayesian Active Learning for Natural Language Processing: Results of a Large-Scale Empirical Study

Sep 24, 2018
Aditya Siddhant, Zachary C. Lipton

* To be presented at EMNLP 2018 

  Access Paper or Ask Questions

Leveraging Native Language Speech for Accent Identification using Deep Siamese Networks

Jun 18, 2018
Aditya Siddhant, Preethi Jyothi, Sriram Ganapathy

* Published in ASRU 2017 

  Access Paper or Ask Questions