Alert button
Picture for Cyprien de Masson d'Autume

Cyprien de Masson d'Autume

Alert button

StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models

May 23, 2022
Adam Liška, Tomáš Kočiský, Elena Gribovskaya, Tayfun Terzi, Eren Sezener, Devang Agrawal, Cyprien de Masson d'Autume, Tim Scholtes, Manzil Zaheer, Susannah Young, Ellen Gilsenan-McMahon, Sophia Austin, Phil Blunsom, Angeliki Lazaridou

Figure 1 for StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models
Figure 2 for StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models
Figure 3 for StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models
Figure 4 for StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models
Viaarxiv icon

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

Dec 08, 2021
Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew Johnson, Blake Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Ed Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving

Figure 1 for Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Figure 2 for Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Figure 3 for Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Figure 4 for Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Viaarxiv icon

A Systematic Investigation of Commonsense Understanding in Large Language Models

Oct 31, 2021
Xiang Lorraine Li, Adhi Kuncoro, Cyprien de Masson d'Autume, Phil Blunsom, Aida Nematzadeh

Figure 1 for A Systematic Investigation of Commonsense Understanding in Large Language Models
Figure 2 for A Systematic Investigation of Commonsense Understanding in Large Language Models
Figure 3 for A Systematic Investigation of Commonsense Understanding in Large Language Models
Figure 4 for A Systematic Investigation of Commonsense Understanding in Large Language Models
Viaarxiv icon

Adaptive Semiparametric Language Models

Feb 04, 2021
Dani Yogatama, Cyprien de Masson d'Autume, Lingpeng Kong

Figure 1 for Adaptive Semiparametric Language Models
Figure 2 for Adaptive Semiparametric Language Models
Figure 3 for Adaptive Semiparametric Language Models
Figure 4 for Adaptive Semiparametric Language Models
Viaarxiv icon

Pitfalls of Static Language Modelling

Feb 03, 2021
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomas Kocisky, Susannah Young, Phil Blunsom

Figure 1 for Pitfalls of Static Language Modelling
Figure 2 for Pitfalls of Static Language Modelling
Figure 3 for Pitfalls of Static Language Modelling
Figure 4 for Pitfalls of Static Language Modelling
Viaarxiv icon

A Mutual Information Maximization Perspective of Language Representation Learning

Nov 26, 2019
Lingpeng Kong, Cyprien de Masson d'Autume, Wang Ling, Lei Yu, Zihang Dai, Dani Yogatama

Figure 1 for A Mutual Information Maximization Perspective of Language Representation Learning
Figure 2 for A Mutual Information Maximization Perspective of Language Representation Learning
Viaarxiv icon

Episodic Memory in Lifelong Language Learning

Jun 03, 2019
Cyprien de Masson d'Autume, Sebastian Ruder, Lingpeng Kong, Dani Yogatama

Figure 1 for Episodic Memory in Lifelong Language Learning
Figure 2 for Episodic Memory in Lifelong Language Learning
Figure 3 for Episodic Memory in Lifelong Language Learning
Figure 4 for Episodic Memory in Lifelong Language Learning
Viaarxiv icon

Training language GANs from Scratch

May 23, 2019
Cyprien de Masson d'Autume, Mihaela Rosca, Jack Rae, Shakir Mohamed

Figure 1 for Training language GANs from Scratch
Figure 2 for Training language GANs from Scratch
Figure 3 for Training language GANs from Scratch
Figure 4 for Training language GANs from Scratch
Viaarxiv icon

Learning and Evaluating General Linguistic Intelligence

Jan 31, 2019
Dani Yogatama, Cyprien de Masson d'Autume, Jerome Connor, Tomas Kocisky, Mike Chrzanowski, Lingpeng Kong, Angeliki Lazaridou, Wang Ling, Lei Yu, Chris Dyer, Phil Blunsom

Figure 1 for Learning and Evaluating General Linguistic Intelligence
Figure 2 for Learning and Evaluating General Linguistic Intelligence
Figure 3 for Learning and Evaluating General Linguistic Intelligence
Figure 4 for Learning and Evaluating General Linguistic Intelligence
Viaarxiv icon