Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Geoffrey Irving

Geoffrey Irving

Improving language models by retrieving from trillions of tokens


Jan 11, 2022
Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia Guy, Jacob Menick, Roman Ring, Tom Hennigan, Saffron Huang, Loren Maggiore, Chris Jones, Albin Cassirer, Andy Brock, Michela Paganini, Geoffrey Irving, Oriol Vinyals, Simon Osindero, Karen Simonyan, Jack W. Rae, Erich Elsen, Laurent Sifre

Figure 1 for Improving language models by retrieving from trillions of tokens
Figure 2 for Improving language models by retrieving from trillions of tokens
Figure 3 for Improving language models by retrieving from trillions of tokens
Figure 4 for Improving language models by retrieving from trillions of tokens
* Add missing references. Fix some typos 
  Access Paper or Ask Questions

Scaling Language Models: Methods, Analysis & Insights from Training Gopher


Dec 08, 2021
Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew Johnson, Blake Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Ed Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving

Figure 1 for Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Figure 2 for Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Figure 3 for Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Figure 4 for Scaling Language Models: Methods, Analysis & Insights from Training Gopher
* 118 pages 
  Access Paper or Ask Questions

Ethical and social risks of harm from Language Models


Dec 08, 2021
Laura Weidinger, John Mellor, Maribeth Rauh, Conor Griffin, Jonathan Uesato, Po-Sen Huang, Myra Cheng, Mia Glaese, Borja Balle, Atoosa Kasirzadeh, Zac Kenton, Sasha Brown, Will Hawkins, Tom Stepleton, Courtney Biles, Abeba Birhane, Julia Haas, Laura Rimell, Lisa Anne Hendricks, William Isaac, Sean Legassick, Geoffrey Irving, Iason Gabriel

Figure 1 for Ethical and social risks of harm from Language Models
Figure 2 for Ethical and social risks of harm from Language Models

  Access Paper or Ask Questions

Alignment of Language Agents


Mar 26, 2021
Zachary Kenton, Tom Everitt, Laura Weidinger, Iason Gabriel, Vladimir Mikulik, Geoffrey Irving


  Access Paper or Ask Questions

Fine-Tuning Language Models from Human Preferences


Sep 18, 2019
Daniel M. Ziegler, Nisan Stiennon, Jeffrey Wu, Tom B. Brown, Alec Radford, Dario Amodei, Paul Christiano, Geoffrey Irving

Figure 1 for Fine-Tuning Language Models from Human Preferences
Figure 2 for Fine-Tuning Language Models from Human Preferences
Figure 3 for Fine-Tuning Language Models from Human Preferences
Figure 4 for Fine-Tuning Language Models from Human Preferences

  Access Paper or Ask Questions

Reward learning from human preferences and demonstrations in Atari


Nov 15, 2018
Borja Ibarz, Jan Leike, Tobias Pohlen, Geoffrey Irving, Shane Legg, Dario Amodei

Figure 1 for Reward learning from human preferences and demonstrations in Atari
Figure 2 for Reward learning from human preferences and demonstrations in Atari
Figure 3 for Reward learning from human preferences and demonstrations in Atari
Figure 4 for Reward learning from human preferences and demonstrations in Atari
* NIPS 2018 
  Access Paper or Ask Questions

AI safety via debate


Oct 22, 2018
Geoffrey Irving, Paul Christiano, Dario Amodei

Figure 1 for AI safety via debate
Figure 2 for AI safety via debate
Figure 3 for AI safety via debate
Figure 4 for AI safety via debate
* 24 pages, 6 figures 
  Access Paper or Ask Questions

DeepMath - Deep Sequence Models for Premise Selection


Jan 26, 2017
Alex A. Alemi, Francois Chollet, Niklas Een, Geoffrey Irving, Christian Szegedy, Josef Urban

Figure 1 for DeepMath - Deep Sequence Models for Premise Selection
Figure 2 for DeepMath - Deep Sequence Models for Premise Selection
Figure 3 for DeepMath - Deep Sequence Models for Premise Selection
Figure 4 for DeepMath - Deep Sequence Models for Premise Selection

  Access Paper or Ask Questions

Deep Network Guided Proof Search


Jan 24, 2017
Sarah Loos, Geoffrey Irving, Christian Szegedy, Cezary Kaliszyk

Figure 1 for Deep Network Guided Proof Search
Figure 2 for Deep Network Guided Proof Search
Figure 3 for Deep Network Guided Proof Search
Figure 4 for Deep Network Guided Proof Search
* In Thomas Eiter and David Sands, editors, 21st International Conference on Logic for Programming, Artificial Intelligence and Reasoning (LPAR-21). EPiC Series in Computing, vol. 46, pages 85-105, EasyChair, 2017. ISSN 2398-7340 
  Access Paper or Ask Questions

TensorFlow: A system for large-scale machine learning


May 31, 2016
Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, Xiaoqiang Zheng

Figure 1 for TensorFlow: A system for large-scale machine learning
Figure 2 for TensorFlow: A system for large-scale machine learning
Figure 3 for TensorFlow: A system for large-scale machine learning
Figure 4 for TensorFlow: A system for large-scale machine learning
* 18 pages, 9 figures; v2 has a spelling correction in the metadata 
  Access Paper or Ask Questions

TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems


Mar 16, 2016
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mane, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viegas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, Xiaoqiang Zheng

Figure 1 for TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Figure 2 for TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Figure 3 for TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Figure 4 for TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
* Version 2 updates only the metadata, to correct the formatting of Mart\'in Abadi's name 
  Access Paper or Ask Questions