Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Lucy Colwell

Rethinking Attention with Performers


Sep 30, 2020
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamas Sarlos, Peter Hawkins, Jared Davis, Afroz Mohiuddin, Lukasz Kaiser, David Belanger, Lucy Colwell, Adrian Weller

* 36 pages. This is an updated version of a previous submission which can be found at arXiv:2006.03555. See https://github.com/google-research/google-research/tree/master/protein_lm for protein language model code, and https://github.com/google-research/google-research/tree/master/performer for Performer code 

  Access Paper or Ask Questions

Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers


Jun 05, 2020
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Jared Davis, Tamas Sarlos, David Belanger, Lucy Colwell, Adrian Weller

* 14 pages, 11 figures 

  Access Paper or Ask Questions

Population-Based Black-Box Optimization for Biological Sequence Design


Jun 05, 2020
Christof Angermueller, David Belanger, Andreea Gane, Zelda Mariet, David Dohan, Kevin Murphy, Lucy Colwell, D Sculley


  Access Paper or Ask Questions

Noisy, sparse, nonlinear: Navigating the Bermuda Triangle of physical inference with deep filtering


Nov 19, 2019
Carl Poelking, Yehia Amar, Alexei Lapkin, Lucy Colwell


  Access Paper or Ask Questions

Using Attribution to Decode Dataset Bias in Neural Network Models for Chemistry


Nov 29, 2018
Kevin McCloskey, Ankur Taly, Federico Monti, Michael P. Brenner, Lucy Colwell


  Access Paper or Ask Questions