Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox
Picture for Neel Nanda

Neel Nanda
Alert button

A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operations


Feb 06, 2023
Bilal Chughtai, Lawrence Chan, Neel Nanda

Add code
Alert button

Figure 1 for A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operations
Figure 2 for A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operations
Figure 3 for A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operations
Figure 4 for A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operations
* 9 page main body, 1 page references, 12 page appendix 
   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Progress measures for grokking via mechanistic interpretability


Jan 13, 2023
Neel Nanda, Lawrence Chan, Tom Lieberum, Jess Smith, Jacob Steinhardt

Add code
Alert button

Figure 1 for Progress measures for grokking via mechanistic interpretability
Figure 2 for Progress measures for grokking via mechanistic interpretability
Figure 3 for Progress measures for grokking via mechanistic interpretability
Figure 4 for Progress measures for grokking via mechanistic interpretability
* 10 page main body, 2 page references, 24 page appendix 
   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

In-context Learning and Induction Heads


Sep 24, 2022
Catherine Olsson, Nelson Elhage, Neel Nanda, Nicholas Joseph, Nova DasSarma, Tom Henighan, Ben Mann, Amanda Askell, Yuntao Bai, Anna Chen, Tom Conerly, Dawn Drain, Deep Ganguli, Zac Hatfield-Dodds, Danny Hernandez, Scott Johnston, Andy Jones, Jackson Kernion, Liane Lovitt, Kamal Ndousse, Dario Amodei, Tom Brown, Jack Clark, Jared Kaplan, Sam McCandlish, Chris Olah

Add code
Alert button


   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback


Apr 12, 2022
Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, Nicholas Joseph, Saurav Kadavath, Jackson Kernion, Tom Conerly, Sheer El-Showk, Nelson Elhage, Zac Hatfield-Dodds, Danny Hernandez, Tristan Hume, Scott Johnston, Shauna Kravec, Liane Lovitt, Neel Nanda, Catherine Olsson, Dario Amodei, Tom Brown, Jack Clark, Sam McCandlish, Chris Olah, Ben Mann, Jared Kaplan

Add code
Alert button

Figure 1 for Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
Figure 2 for Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
Figure 3 for Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
Figure 4 for Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
* Data available at https://github.com/anthropics/hh-rlhf 
   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

An Empirical Investigation of Learning from Biased Toxicity Labels


Oct 04, 2021
Neel Nanda, Jonathan Uesato, Sven Gowal

Add code
Alert button

Figure 1 for An Empirical Investigation of Learning from Biased Toxicity Labels
Figure 2 for An Empirical Investigation of Learning from Biased Toxicity Labels
Figure 3 for An Empirical Investigation of Learning from Biased Toxicity Labels
Figure 4 for An Empirical Investigation of Learning from Biased Toxicity Labels
* 8 pages, 6 figures. Accepted to the Socially Responsible Machine Learning Workshop, ICML 2021 
   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Fully General Online Imitation Learning


Feb 17, 2021
Michael K. Cohen, Marcus Hutter, Neel Nanda

Add code
Alert button

Figure 1 for Fully General Online Imitation Learning
Figure 2 for Fully General Online Imitation Learning
* 13 pages with 8-page appendix 
   Access Paper or Ask Questions
  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email