Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Andrew M. Dai

Finetuned Language Models Are Zero-Shot Learners

Sep 03, 2021
Jason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, Quoc V. Le

  Access Paper or Ask Questions

BEDS-Bench: Behavior of EHR-models under Distributional Shift--A Benchmark

Jul 17, 2021
Anand Avati, Martin Seneviratne, Emily Xue, Zhen Xu, Balaji Lakshminarayanan, Andrew M. Dai

  Access Paper or Ask Questions

MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records

Feb 03, 2021
Zhen Xu, David R. So, Andrew M. Dai

* Accepted for publication at the Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21) 

  Access Paper or Ask Questions

Learnability and Complexity of Quantum Samples

Oct 22, 2020
Murphy Yuezhen Niu, Andrew M. Dai, Li Li, Augustus Odena, Zhengli Zhao, Vadim Smelyanskyi, Hartmut Neven, Sergio Boixo

  Access Paper or Ask Questions

Training independent subnetworks for robust prediction

Oct 13, 2020
Marton Havasi, Rodolphe Jenatton, Stanislav Fort, Jeremiah Zhe Liu, Jasper Snoek, Balaji Lakshminarayanan, Andrew M. Dai, Dustin Tran

  Access Paper or Ask Questions

Learning Unstable Dynamical Systems with Time-Weighted Logarithmic Loss

Jul 10, 2020
Kamil Nar, Yuan Xue, Andrew M. Dai

  Access Paper or Ask Questions

Flow Contrastive Estimation of Energy-Based Models

Dec 02, 2019
Ruiqi Gao, Erik Nijkamp, Diederik P. Kingma, Zhen Xu, Andrew M. Dai, Ying Nian Wu

  Access Paper or Ask Questions

Modelling EHR timeseries by restricting feature interaction

Nov 14, 2019
Kun Zhang, Yuan Xue, Gerardo Flores, Alvin Rajkomar, Claire Cui, Andrew M. Dai

* Machine Learning for Health (ML4H) at NeurIPS 2019 - Extended Abstract 

  Access Paper or Ask Questions

Federated and Differentially Private Learning for Electronic Health Records

Nov 13, 2019
Stephen R. Pfohl, Andrew M. Dai, Katherine Heller

* Machine Learning for Health (ML4H) at NeurIPS 2019 - Extended Abstract 

  Access Paper or Ask Questions

Capacity, Bandwidth, and Compositionality in Emergent Language Learning

Oct 24, 2019
Cinjon Resnick, Abhinav Gupta, Jakob Foerster, Andrew M. Dai, Kyunghyun Cho

* The first two authors contributed equally 

  Access Paper or Ask Questions

Improved Patient Classification with Language Model Pretraining Over Clinical Notes

Oct 02, 2019
Jonas Kemp, Alvin Rajkomar, Andrew M. Dai

* Accepted at NeurIPS ML4H 2019, extended abstract track 

  Access Paper or Ask Questions

Learning an Adaptive Learning Rate Schedule

Sep 20, 2019
Zhen Xu, Andrew M. Dai, Jonas Kemp, Luke Metz

  Access Paper or Ask Questions

Graph Convolutional Transformer: Learning the Graphical Structure of Electronic Health Records

Jun 28, 2019
Edward Choi, Zhen Xu, Yujia Li, Michael W. Dusenberry, Gerardo Flores, Yuan Xue, Andrew M. Dai

  Access Paper or Ask Questions

Analyzing the Role of Model Uncertainty for Electronic Health Records

Jun 10, 2019
Michael W. Dusenberry, Dustin Tran, Edward Choi, Jonas Kemp, Jeremy Nixon, Ghassen Jerfel, Katherine Heller, Andrew M. Dai

* Presented at the ICML 2019 Workshop on Uncertainty & Robustness in Deep Learning. Code to be open-sourced 

  Access Paper or Ask Questions

Gmail Smart Compose: Real-Time Assisted Writing

May 17, 2019
Mia Xu Chen, Benjamin N Lee, Gagan Bansal, Yuan Cao, Shuyuan Zhang, Justin Lu, Jackie Tsay, Yinan Wang, Andrew M. Dai, Zhifeng Chen, Timothy Sohn, Yonghui Wu

  Access Paper or Ask Questions

Music Transformer

Oct 10, 2018
Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer, Ian Simon, Curtis Hawthorne, Andrew M. Dai, Matthew D. Hoffman, Monica Dinculescu, Douglas Eck

* Rewrote many sections to clarify the work, and extended relative attention to the local case. Previous title is "An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation" 

  Access Paper or Ask Questions

Peptide-Spectra Matching from Weak Supervision

Aug 22, 2018
Samuel S. Schoenholz, Sean Hackett, Laura Deming, Eugene Melamud, Navdeep Jaitly, Fiona McAllister, Jonathon O'Brien, George Dahl, Bryson Bennett, Andrew M. Dai, Daphne Koller

  Access Paper or Ask Questions

Learning Longer-term Dependencies in RNNs with Auxiliary Losses

Jun 13, 2018
Trieu H. Trinh, Andrew M. Dai, Minh-Thang Luong, Quoc V. Le

* ICML 2018 

  Access Paper or Ask Questions

Embedding Text in Hyperbolic Spaces

Jun 12, 2018
Bhuwan Dhingra, Christopher J. Shallue, Mohammad Norouzi, Andrew M. Dai, George E. Dahl

* TextGraphs 2018 

  Access Paper or Ask Questions

Scalable and accurate deep learning for electronic health records

May 11, 2018
Alvin Rajkomar, Eyal Oren, Kai Chen, Andrew M. Dai, Nissan Hajaj, Peter J. Liu, Xiaobing Liu, Mimi Sun, Patrik Sundberg, Hector Yee, Kun Zhang, Gavin E. Duggan, Gerardo Flores, Michaela Hardt, Jamie Irvine, Quoc Le, Kurt Litsch, Jake Marcus, Alexander Mossin, Justin Tansuwan, De Wang, James Wexler, Jimbo Wilson, Dana Ludwig, Samuel L. Volchenboum, Katherine Chou, Michael Pearson, Srinivasan Madabushi, Nigam H. Shah, Atul J. Butte, Michael Howell, Claire Cui, Greg Corrado, Jeff Dean

* npj Digital Medicine 1:18 (2018) 
* Published version from 

  Access Paper or Ask Questions

MaskGAN: Better Text Generation via Filling in the______

Mar 01, 2018
William Fedus, Ian Goodfellow, Andrew M. Dai

* 16 pages, ICLR 2018 

  Access Paper or Ask Questions

Many Paths to Equilibrium: GANs Do Not Need to Decrease a Divergence At Every Step

Feb 20, 2018
William Fedus, Mihaela Rosca, Balaji Lakshminarayanan, Andrew M. Dai, Shakir Mohamed, Ian Goodfellow

* 18 pages 

  Access Paper or Ask Questions

Who Said What: Modeling Individual Labelers Improves Classification

Jan 04, 2018
Melody Y. Guan, Varun Gulshan, Andrew M. Dai, Geoffrey E. Hinton

* AAAI 2018 

  Access Paper or Ask Questions

Adversarial Training Methods for Semi-Supervised Text Classification

May 06, 2017
Takeru Miyato, Andrew M. Dai, Ian Goodfellow

* Published as a conference paper at ICLR 2017 

  Access Paper or Ask Questions

Generating Sentences from a Continuous Space

May 12, 2016
Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, Andrew M. Dai, Rafal Jozefowicz, Samy Bengio

* SIGNLL Conference on Computational Natural Language Learning (CONLL), 2016 
* First two authors contributed equally. Work was done when all authors were at Google, Inc 

  Access Paper or Ask Questions

Semi-supervised Sequence Learning

Nov 04, 2015
Andrew M. Dai, Quoc V. Le

  Access Paper or Ask Questions

Document Embedding with Paragraph Vectors

Jul 29, 2015
Andrew M. Dai, Christopher Olah, Quoc V. Le

* 8 pages 

  Access Paper or Ask Questions

The supervised hierarchical Dirichlet process

Dec 17, 2014
Andrew M. Dai, Amos J. Storkey

* 14 pages 

  Access Paper or Ask Questions