Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Valerii Likhosherstov

Debiasing a First-order Heuristic for Approximate Bi-level Optimization


Jun 08, 2021
Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Davis, Adrian Weller

* Proceedings of the 38th International Conference on Machine Learning, PMLR 139, 2021. arXiv admin note: text overlap with arXiv:2006.03631 

  Access Paper or Ask Questions

On the Expressive Power of Self-Attention Matrices


Jun 08, 2021
Valerii Likhosherstov, Krzysztof Choromanski, Adrian Weller


  Access Paper or Ask Questions

Unlocking Pixels for Reinforcement Learning via Implicit Attention


Mar 04, 2021
Krzysztof Choromanski, Deepali Jain, Jack Parker-Holder, Xingyou Song, Valerii Likhosherstov, Anirban Santara, Aldo Pacchiano, Yunhao Tang, Adrian Weller


  Access Paper or Ask Questions

Sub-Linear Memory: How to Make Performers SLiM


Dec 21, 2020
Valerii Likhosherstov, Krzysztof Choromanski, Jared Davis, Xingyou Song, Adrian Weller


  Access Paper or Ask Questions

Rethinking Attention with Performers


Sep 30, 2020
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamas Sarlos, Peter Hawkins, Jared Davis, Afroz Mohiuddin, Lukasz Kaiser, David Belanger, Lucy Colwell, Adrian Weller

* 36 pages. This is an updated version of a previous submission which can be found at arXiv:2006.03555. See https://github.com/google-research/google-research/tree/master/protein_lm for protein language model code, and https://github.com/google-research/google-research/tree/master/performer for Performer code 

  Access Paper or Ask Questions

An Ode to an ODE


Jun 23, 2020
Krzysztof Choromanski, Jared Quincy Davis, Valerii Likhosherstov, Xingyou Song, Jean-Jacques Slotine, Jacob Varley, Honglak Lee, Adrian Weller, Vikas Sindhwani

* 20 pages, 9 figures 

  Access Paper or Ask Questions

UFO-BLO: Unbiased First-Order Bilevel Optimization


Jun 05, 2020
Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Davis, Adrian Weller


  Access Paper or Ask Questions

Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers


Jun 05, 2020
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Jared Davis, Tamas Sarlos, David Belanger, Lucy Colwell, Adrian Weller

* 14 pages, 11 figures 

  Access Paper or Ask Questions

CWY Parametrization for Scalable Learning of Orthogonal and Stiefel Matrices


Apr 18, 2020
Valerii Likhosherstov, Jared Davis, Krzysztof Choromanski, Adrian Weller


  Access Paper or Ask Questions

Stochastic Flows and Geometric Optimization on the Orthogonal Group


Mar 30, 2020
Krzysztof Choromanski, David Cheikhi, Jared Davis, Valerii Likhosherstov, Achille Nazaret, Achraf Bahamou, Xingyou Song, Mrugank Akarte, Jack Parker-Holder, Jacob Bergquist, Yuan Gao, Aldo Pacchiano, Tamas Sarlos, Adrian Weller, Vikas Sindhwani


  Access Paper or Ask Questions

Tractable Minor-free Generalization of Planar Zero-field Ising Models


Oct 22, 2019
Valerii Likhosherstov, Yury Maximov, Michael Chertkov

* 32 pages. arXiv admin note: substantial text overlap with arXiv:1906.06431, arXiv:1812.09587 

  Access Paper or Ask Questions

Inference and Sampling of $K_{33}$-free Ising Models


Dec 22, 2018
Valerii Likhosherstov, Yury Maximov, Michael Chertkov

* 20 pages, 8 figures 

  Access Paper or Ask Questions