Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Scaling Language Models: Methods, Analysis & Insights from Training Gopher



Jack W. Rae , Sebastian Borgeaud , Trevor Cai , Katie Millican , Jordan Hoffmann , Francis Song , John Aslanides , Sarah Henderson , Roman Ring , Susannah Young , Eliza Rutherford , Tom Hennigan , Jacob Menick , Albin Cassirer , Richard Powell , George van den Driessche , Lisa Anne Hendricks , Maribeth Rauh , Po-Sen Huang , Amelia Glaese , Johannes Welbl , Sumanth Dathathri , Saffron Huang , Jonathan Uesato , John Mellor , Irina Higgins , Antonia Creswell , Nat McAleese , Amy Wu , Erich Elsen , Siddhant Jayakumar , Elena Buchatskaya , David Budden , Esme Sutherland , Karen Simonyan , Michela Paganini , Laurent Sifre , Lena Martens , Xiang Lorraine Li , Adhiguna Kuncoro , Aida Nematzadeh , Elena Gribovskaya , Domenic Donato , Angeliki Lazaridou , Arthur Mensch , Jean-Baptiste Lespiau , Maria Tsimpoukelli , Nikolai Grigorev , Doug Fritz , Thibault Sottiaux , Mantas Pajarskas , Toby Pohlen , Zhitao Gong , Daniel Toyama , Cyprien de Masson d'Autume , Yujia Li , Tayfun Terzi , Vladimir Mikulik , Igor Babuschkin , Aidan Clark , Diego de Las Casas , Aurelia Guy , Chris Jones , James Bradbury , Matthew Johnson , Blake Hechtman , Laura Weidinger , Iason Gabriel , William Isaac , Ed Lockhart , Simon Osindero , Laura Rimell , Chris Dyer , Oriol Vinyals , Kareem Ayoub , Jeff Stanway , Lorrayne Bennett , Demis Hassabis , Koray Kavukcuoglu , Geoffrey Irving

* 118 pages 

   Access Paper or Ask Questions

Ethical and social risks of harm from Language Models



Laura Weidinger , John Mellor , Maribeth Rauh , Conor Griffin , Jonathan Uesato , Po-Sen Huang , Myra Cheng , Mia Glaese , Borja Balle , Atoosa Kasirzadeh , Zac Kenton , Sasha Brown , Will Hawkins , Tom Stepleton , Courtney Biles , Abeba Birhane , Julia Haas , Laura Rimell , Lisa Anne Hendricks , William Isaac , Sean Legassick , Geoffrey Irving , Iason Gabriel


   Access Paper or Ask Questions

You should evaluate your language model on marginal likelihood over tokenisations



Kris Cao , Laura Rimell

* accepted at EMNLP 2021 

   Access Paper or Ask Questions

You should evaluate your language model on marginal likelihood overtokenisations



Kris Cao , Laura Rimell

* accepted at EMNLP 2021 

   Access Paper or Ask Questions

Pretraining the Noisy Channel Model for Task-Oriented Dialogue



Qi Liu , Lei Yu , Laura Rimell , Phil Blunsom

* Accepted to TACL, pre MIT Press publication version 

   Access Paper or Ask Questions

Probing Emergent Semantics in Predictive Agents via Question Answering



Abhishek Das , Federico Carnevale , Hamza Merzic , Laura Rimell , Rosalia Schneider , Josh Abramson , Alden Hung , Arun Ahuja , Stephen Clark , Gregory Wayne , Felix Hill

* ICML 2020 

   Access Paper or Ask Questions

Syntactic Structure Distillation Pretraining For Bidirectional Encoders



Adhiguna Kuncoro , Lingpeng Kong , Daniel Fried , Dani Yogatama , Laura Rimell , Chris Dyer , Phil Blunsom

* 17 pages, 6 tables, 2 figures. AK and LK contributed equally 

   Access Paper or Ask Questions

Neural Generative Rhetorical Structure Parsing



Amandla Mabona , Laura Rimell , Stephen Clark , Andreas Vlachos

* EMNLP 2019 

   Access Paper or Ask Questions

Scalable Syntax-Aware Language Models Using Knowledge Distillation



Adhiguna Kuncoro , Chris Dyer , Laura Rimell , Stephen Clark , Phil Blunsom

* ACL 2019 

   Access Paper or Ask Questions

Take and Took, Gaggle and Goose, Book and Read: Evaluating the Utility of Vector Differences for Lexical Relation Learning



Ekaterina Vylomova , Laura Rimell , Trevor Cohn , Timothy Baldwin


   Access Paper or Ask Questions

1
2
>>