Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Adhiguna Kuncoro

Scaling Language Models: Methods, Analysis & Insights from Training Gopher


Dec 08, 2021
Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew Johnson, Blake Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Ed Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving

* 118 pages 

  Access Paper or Ask Questions

IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation


Apr 16, 2021
Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung

* Work in progress, 10 pages 

  Access Paper or Ask Questions

Pitfalls of Static Language Modelling


Feb 03, 2021
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomas Kocisky, Susannah Young, Phil Blunsom


  Access Paper or Ask Questions

Syntactic Structure Distillation Pretraining For Bidirectional Encoders


May 27, 2020
Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried, Dani Yogatama, Laura Rimell, Chris Dyer, Phil Blunsom

* 17 pages, 6 tables, 2 figures. AK and LK contributed equally 

  Access Paper or Ask Questions

Scalable Syntax-Aware Language Models Using Knowledge Distillation


Jun 14, 2019
Adhiguna Kuncoro, Chris Dyer, Laura Rimell, Stephen Clark, Phil Blunsom

* ACL 2019 

  Access Paper or Ask Questions

Unsupervised Recurrent Neural Network Grammars


Apr 15, 2019
Yoon Kim, Alexander M. Rush, Lei Yu, Adhiguna Kuncoro, Chris Dyer, Gábor Melis

* NAACL 2019 

  Access Paper or Ask Questions

Finding Syntax in Human Encephalography with Beam Search


Jun 11, 2018
John Hale, Chris Dyer, Adhiguna Kuncoro, Jonathan R. Brennan

* ACL2018 

  Access Paper or Ask Questions

DyNet: The Dynamic Neural Network Toolkit


Jan 15, 2017
Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews, Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, Kevin Duh, Manaal Faruqui, Cynthia Gan, Dan Garrette, Yangfeng Ji, Lingpeng Kong, Adhiguna Kuncoro, Gaurav Kumar, Chaitanya Malaviya, Paul Michel, Yusuke Oda, Matthew Richardson, Naomi Saphra, Swabha Swayamdipta, Pengcheng Yin

* 33 pages 

  Access Paper or Ask Questions

What Do Recurrent Neural Network Grammars Learn About Syntax?


Jan 10, 2017
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Graham Neubig, Noah A. Smith

* 10 pages. To appear in EACL 2017, Valencia, Spain 

  Access Paper or Ask Questions

Recurrent Neural Network Grammars


Oct 12, 2016
Chris Dyer, Adhiguna Kuncoro, Miguel Ballesteros, Noah A. Smith

* Proceedings of NAACL 2016 (contains corrigendum) 

  Access Paper or Ask Questions

Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser


Sep 24, 2016
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Noah A. Smith

* 10 pages. To appear at EMNLP 2016 

  Access Paper or Ask Questions

Dependency Parsing with LSTMs: An Empirical Evaluation


Jun 30, 2016
Adhiguna Kuncoro, Yuichiro Sawai, Kevin Duh, Yuji Matsumoto

* 7 pages, 4 figures 

  Access Paper or Ask Questions