WT5?! Training Text-to-Text Models to Explain their Predictions

Apr 30, 2020
Sharan Narang, Colin Raffel, Katherine Lee, Adam Roberts, Noah Fiedel, Karishma Malkan

  Access Model/Code and Paper

How Much Knowledge Can You Pack Into the Parameters of a Language Model?

Feb 24, 2020
Adam Roberts, Colin Raffel, Noam Shazeer

  Access Model/Code and Paper

Deflecting Adversarial Attacks

Feb 18, 2020
Yao Qin, Nicholas Frosst, Colin Raffel, Garrison Cottrell, Geoffrey Hinton

  Access Model/Code and Paper

Top-K Training of GANs: Improving Generators by Making Critics Less Critical

Feb 14, 2020
Samarth Sinha, Anirudh Goyal, Colin Raffel, Augustus Odena

  Access Model/Code and Paper

FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence

Jan 21, 2020
Kihyuk Sohn, David Berthelot, Chun-Liang Li, Zizhao Zhang, Nicholas Carlini, Ekin D. Cubuk, Alex Kurakin, Han Zhang, Colin Raffel

  Access Model/Code and Paper

Towards GAN Benchmarks Which Require Generalization

Jan 10, 2020
Ishaan Gulrajani, Colin Raffel, Luke Metz

* ICLR 2019 conference paper 

  Access Model/Code and Paper

ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring

Nov 21, 2019
David Berthelot, Nicholas Carlini, Ekin D. Cubuk, Alex Kurakin, Kihyuk Sohn, Han Zhang, Colin Raffel

  Access Model/Code and Paper

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Oct 24, 2019
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu

  Access Model/Code and Paper

Detecting and Diagnosing Adversarial Images with Class-Conditional Capsule Reconstructions

Jul 05, 2019
Yao Qin, Nicholas Frosst, Sara Sabour, Colin Raffel, Garrison Cottrell, Geoffrey Hinton

  Access Model/Code and Paper

Monotonic Infinite Lookback Attention for Simultaneous Machine Translation

Jun 12, 2019
Naveen Arivazhagan, Colin Cherry, Wolfgang Macherey, Chung-Cheng Chiu, Semih Yavuz, Ruoming Pang, Wei Li, Colin Raffel

* Accepted for publication at ACL 2019 

  Access Model/Code and Paper

MixMatch: A Holistic Approach to Semi-Supervised Learning

May 06, 2019
David Berthelot, Nicholas Carlini, Ian Goodfellow, Nicolas Papernot, Avital Oliver, Colin Raffel

  Access Model/Code and Paper

Imperceptible, Robust, and Targeted Adversarial Examples for Automatic Speech Recognition

Mar 22, 2019
Yao Qin, Nicholas Carlini, Ian Goodfellow, Garrison Cottrell, Colin Raffel

  Access Model/Code and Paper

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

Feb 21, 2019
Jonathan Shen, Patrick Nguyen, Yonghui Wu, Zhifeng Chen, Mia X. Chen, Ye Jia, Anjuli Kannan, Tara Sainath, Yuan Cao, Chung-Cheng Chiu, Yanzhang He, Jan Chorowski, Smit Hinsu, Stella Laurenzo, James Qin, Orhan Firat, Wolfgang Macherey, Suyog Gupta, Ankur Bapna, Shuyuan Zhang, Ruoming Pang, Ron J. Weiss, Rohit Prabhavalkar, Qiao Liang, Benoit Jacob, Bowen Liang, HyoukJoong Lee, Ciprian Chelba, Sébastien Jean, Bo Li, Melvin Johnson, Rohan Anil, Rajat Tibrewal, Xiaobing Liu, Akiko Eriguchi, Navdeep Jaitly, Naveen Ari, Colin Cherry, Parisa Haghani, Otavio Good, Youlong Cheng, Raziel Alvarez, Isaac Caswell, Wei-Ning Hsu, Zongheng Yang, Kuan-Chieh Wang, Ekaterina Gonina, Katrin Tomanek, Ben Vanik, Zelin Wu, Llion Jones, Mike Schuster, Yanping Huang, Dehao Chen, Kazuki Irie, George Foster, John Richardson, Klaus Macherey, Antoine Bruguier, Heiga Zen, Colin Raffel, Shankar Kumar, Kanishka Rao, David Rybach, Matthew Murray, Vijayaditya Peddinti, Maxim Krikun, Michiel A. U. Bacchiani, Thomas B. Jablin, Rob Suderman, Ian Williams, Benjamin Lee, Deepti Bhatia, Justin Carlson, Semih Yavuz, Yu Zhang, Ian McGraw, Max Galkin, Qi Ge, Golan Pundak, Chad Whipkey, Todd Wang, Uri Alon, Dmitry Lepikhin, Ye Tian, Sara Sabour, William Chan, Shubham Toshniwal, Baohua Liao, Michael Nirschl, Pat Rondon

  Access Model/Code and Paper

Realistic Evaluation of Deep Semi-Supervised Learning Algorithms

Oct 26, 2018
Avital Oliver, Augustus Odena, Colin Raffel, Ekin D. Cubuk, Ian J. Goodfellow

* NIPS 2018 Proceedings 

  Access Model/Code and Paper

A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music

Jul 30, 2018
Adam Roberts, Jesse Engel, Colin Raffel, Curtis Hawthorne, Douglas Eck

* ICML 2018 
* ICML Camera Ready Version 

  Access Model/Code and Paper

Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer

Jul 23, 2018
David Berthelot, Colin Raffel, Aurko Roy, Ian Goodfellow

  Access Model/Code and Paper

Is Generator Conditioning Causally Related to GAN Performance?

Jun 19, 2018
Augustus Odena, Jacob Buckman, Catherine Olsson, Tom B. Brown, Christopher Olah, Colin Raffel, Ian Goodfellow

  Access Model/Code and Paper

Onsets and Frames: Dual-Objective Piano Transcription

Jun 05, 2018
Curtis Hawthorne, Erich Elsen, Jialin Song, Adam Roberts, Ian Simon, Colin Raffel, Jesse Engel, Sageev Oore, Douglas Eck

* Examples available at https://goo.gl/magenta/onsets-frames-examples 

  Access Model/Code and Paper

Learning a Latent Space of Multitrack Measures

Jun 01, 2018
Ian Simon, Adam Roberts, Colin Raffel, Jesse Engel, Curtis Hawthorne, Douglas Eck

  Access Model/Code and Paper

Monotonic Chunkwise Attention

Feb 23, 2018
Chung-Cheng Chiu, Colin Raffel

* ICLR camera-ready version 

  Access Model/Code and Paper

Learning Hard Alignments with Variational Inference

Nov 01, 2017
Dieterich Lawson, Chung-Cheng Chiu, George Tucker, Colin Raffel, Kevin Swersky, Navdeep Jaitly

  Access Model/Code and Paper

Online and Linear-Time Attention by Enforcing Monotonic Alignments

Jun 29, 2017
Colin Raffel, Minh-Thang Luong, Peter J. Liu, Ron J. Weiss, Douglas Eck

* ICML camera-ready version; 10 pages + 9 page appendix 

  Access Model/Code and Paper

Training a Subsampling Mechanism in Expectation

Apr 08, 2017
Colin Raffel, Dieterich Lawson

* Camera-ready version. Includes additional figures in an appendix 

  Access Model/Code and Paper

Feed-Forward Networks with Attention Can Solve Some Long-Term Memory Problems

Sep 20, 2016
Colin Raffel, Daniel P. W. Ellis

  Access Model/Code and Paper

Theano: A Python framework for fast computation of mathematical expressions

May 09, 2016
The Theano Development Team, Rami Al-Rfou, Guillaume Alain, Amjad Almahairi, Christof Angermueller, Dzmitry Bahdanau, Nicolas Ballas, Frédéric Bastien, Justin Bayer, Anatoly Belikov, Alexander Belopolsky, Yoshua Bengio, Arnaud Bergeron, James Bergstra, Valentin Bisson, Josh Bleecher Snyder, Nicolas Bouchard, Nicolas Boulanger-Lewandowski, Xavier Bouthillier, Alexandre de Brébisson, Olivier Breuleux, Pierre-Luc Carrier, Kyunghyun Cho, Jan Chorowski, Paul Christiano, Tim Cooijmans, Marc-Alexandre Côté, Myriam Côté, Aaron Courville, Yann N. Dauphin, Olivier Delalleau, Julien Demouth, Guillaume Desjardins, Sander Dieleman, Laurent Dinh, Mélanie Ducoffe, Vincent Dumoulin, Samira Ebrahimi Kahou, Dumitru Erhan, Ziye Fan, Orhan Firat, Mathieu Germain, Xavier Glorot, Ian Goodfellow, Matt Graham, Caglar Gulcehre, Philippe Hamel, Iban Harlouchet, Jean-Philippe Heng, Balázs Hidasi, Sina Honari, Arjun Jain, Sébastien Jean, Kai Jia, Mikhail Korobov, Vivek Kulkarni, Alex Lamb, Pascal Lamblin, Eric Larsen, César Laurent, Sean Lee, Simon Lefrancois, Simon Lemieux, Nicholas Léonard, Zhouhan Lin, Jesse A. Livezey, Cory Lorenz, Jeremiah Lowin, Qianli Ma, Pierre-Antoine Manzagol, Olivier Mastropietro, Robert T. McGibbon, Roland Memisevic, Bart van Merriënboer, Vincent Michalski, Mehdi Mirza, Alberto Orlandi, Christopher Pal, Razvan Pascanu, Mohammad Pezeshki, Colin Raffel, Daniel Renshaw, Matthew Rocklin, Adriana Romero, Markus Roth, Peter Sadowski, John Salvatier, François Savard, Jan Schlüter, John Schulman, Gabriel Schwartz, Iulian Vlad Serban, Dmitriy Serdyuk, Samira Shabanian, Étienne Simon, Sigurd Spieckermann, S. Ramana Subramanyam, Jakub Sygnowski, Jérémie Tanguay, Gijs van Tulder, Joseph Turian, Sebastian Urban, Pascal Vincent, Francesco Visin, Harm de Vries, David Warde-Farley, Dustin J. Webb, Matthew Willson, Kelvin Xu, Lijun Xue, Li Yao, Saizheng Zhang, Ying Zhang

* 19 pages, 5 figures 

  Access Model/Code and Paper

Poker-CNN: A Pattern Learning Strategy for Making Draws and Bets in Poker Games

Sep 22, 2015
Nikolai Yakovenko, Liangliang Cao, Colin Raffel, James Fan

* 8 pages 

  Access Model/Code and Paper