Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Dani Yogatama

Finetuning Pretrained Transformers into RNNs


Mar 24, 2021
Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith


  Access Paper or Ask Questions

Random Feature Attention


Mar 19, 2021
Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah A. Smith, Lingpeng Kong

* ICLR 2021 

  Access Paper or Ask Questions

Adaptive Semiparametric Language Models


Feb 04, 2021
Dani Yogatama, Cyprien de Masson d'Autume, Lingpeng Kong

* Accepted to TACL, pre MIT Press publication version 

  Access Paper or Ask Questions

Pitfalls of Static Language Modelling


Feb 03, 2021
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomas Kocisky, Susannah Young, Phil Blunsom


  Access Paper or Ask Questions

Syntactic Structure Distillation Pretraining For Bidirectional Encoders


May 27, 2020
Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried, Dani Yogatama, Laura Rimell, Chris Dyer, Phil Blunsom

* 17 pages, 6 tables, 2 figures. AK and LK contributed equally 

  Access Paper or Ask Questions

A Call for More Rigor in Unsupervised Cross-lingual Learning


Apr 30, 2020
Mikel Artetxe, Sebastian Ruder, Dani Yogatama, Gorka Labaka, Eneko Agirre

* ACL 2020 

  Access Paper or Ask Questions

Modelling Latent Skills for Multitask Language Generation


Feb 21, 2020
Kris Cao, Dani Yogatama


  Access Paper or Ask Questions

A Mutual Information Maximization Perspective of Language Representation Learning


Nov 26, 2019
Lingpeng Kong, Cyprien de Masson d'Autume, Wang Ling, Lei Yu, Zihang Dai, Dani Yogatama

* 12 pages, 3 figures 

  Access Paper or Ask Questions

Reducing Sentiment Bias in Language Models via Counterfactual Evaluation


Nov 08, 2019
Po-Sen Huang, Huan Zhang, Ray Jiang, Robert Stanforth, Johannes Welbl, Jack Rae, Vishal Maini, Dani Yogatama, Pushmeet Kohli


  Access Paper or Ask Questions

On the Cross-lingual Transferability of Monolingual Representations


Oct 25, 2019
Mikel Artetxe, Sebastian Ruder, Dani Yogatama


  Access Paper or Ask Questions

Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagation


Sep 03, 2019
Po-Sen Huang, Robert Stanforth, Johannes Welbl, Chris Dyer, Dani Yogatama, Sven Gowal, Krishnamurthy Dvijotham, Pushmeet Kohli

* Accepted in EMNLP 2019 

  Access Paper or Ask Questions

Episodic Memory in Lifelong Language Learning


Jun 03, 2019
Cyprien de Masson d'Autume, Sebastian Ruder, Lingpeng Kong, Dani Yogatama


  Access Paper or Ask Questions

Learning and Evaluating General Linguistic Intelligence


Jan 31, 2019
Dani Yogatama, Cyprien de Masson d'Autume, Jerome Connor, Tomas Kocisky, Mike Chrzanowski, Lingpeng Kong, Angeliki Lazaridou, Wang Ling, Lei Yu, Chris Dyer, Phil Blunsom


  Access Paper or Ask Questions

Variational Smoothing in Recurrent Neural Network Language Models


Jan 27, 2019
Lingpeng Kong, Gabor Melis, Wang Ling, Lei Yu, Dani Yogatama

* Accepted as a conference paper at ICLR 2019 

  Access Paper or Ask Questions

Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problems


Oct 23, 2017
Wang Ling, Dani Yogatama, Chris Dyer, Phil Blunsom


  Access Paper or Ask Questions

Generative and Discriminative Text Classification with Recurrent Neural Networks


May 26, 2017
Dani Yogatama, Chris Dyer, Wang Ling, Phil Blunsom


  Access Paper or Ask Questions

Jointly Learning Sentence Embeddings and Syntax with Unsupervised Tree-LSTMs


May 25, 2017
Jean Maillard, Stephen Clark, Dani Yogatama


  Access Paper or Ask Questions

Learning to Compose Words into Sentences with Reinforcement Learning


Nov 28, 2016
Dani Yogatama, Phil Blunsom, Chris Dyer, Edward Grefenstette, Wang Ling


  Access Paper or Ask Questions

Deep Speech 2: End-to-End Speech Recognition in English and Mandarin


Dec 08, 2015
Dario Amodei, Rishita Anubhai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse Engel, Linxi Fan, Christopher Fougner, Tony Han, Awni Hannun, Billy Jun, Patrick LeGresley, Libby Lin, Sharan Narang, Andrew Ng, Sherjil Ozair, Ryan Prenger, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Yi Wang, Zhiqian Wang, Chong Wang, Bo Xiao, Dani Yogatama, Jun Zhan, Zhenyao Zhu


  Access Paper or Ask Questions

A Sparse and Adaptive Prior for Time-Dependent Model Parameters


Nov 07, 2015
Dani Yogatama, Bryan R. Routledge, Noah A. Smith


  Access Paper or Ask Questions

Sparse Overcomplete Word Vector Representations


Jun 05, 2015
Manaal Faruqui, Yulia Tsvetkov, Dani Yogatama, Chris Dyer, Noah Smith

* Proceedings of ACL 2015 

  Access Paper or Ask Questions

Bayesian Optimization of Text Representations


Mar 02, 2015
Dani Yogatama, Noah A. Smith


  Access Paper or Ask Questions

Learning Word Representations with Hierarchical Sparse Coding


Nov 06, 2014
Dani Yogatama, Manaal Faruqui, Chris Dyer, Noah A. Smith


  Access Paper or Ask Questions