Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Xingyou Song

Unlocking Pixels for Reinforcement Learning via Implicit Attention


Mar 04, 2021
Krzysztof Choromanski, Deepali Jain, Jack Parker-Holder, Xingyou Song, Valerii Likhosherstov, Anirban Santara, Aldo Pacchiano, Yunhao Tang, Adrian Weller


  Access Paper or Ask Questions

ES-ENAS: Combining Evolution Strategies with Neural Architecture Search at No Extra Cost for Reinforcement Learning


Jan 19, 2021
Xingyou Song, Krzysztof Choromanski, Jack Parker-Holder, Yunhao Tang, Daiyi Peng, Deepali Jain, Wenbo Gao, Aldo Pacchiano, Tamas Sarlos, Yuxiang Yang

* 14 pages. This is an updated version of a previous submission which can be found at arXiv:1907.06511. See https://github.com/google-research/google-research/tree/master/es_enas for associated code 

  Access Paper or Ask Questions

Sub-Linear Memory: How to Make Performers SLiM


Dec 21, 2020
Valerii Likhosherstov, Krzysztof Choromanski, Jared Davis, Xingyou Song, Adrian Weller


  Access Paper or Ask Questions

Rethinking Attention with Performers


Sep 30, 2020
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamas Sarlos, Peter Hawkins, Jared Davis, Afroz Mohiuddin, Lukasz Kaiser, David Belanger, Lucy Colwell, Adrian Weller

* 36 pages. This is an updated version of a previous submission which can be found at arXiv:2006.03555. See https://github.com/google-research/google-research/tree/master/protein_lm for protein language model code, and https://github.com/google-research/google-research/tree/master/performer for Performer code 

  Access Paper or Ask Questions

An Ode to an ODE


Jun 23, 2020
Krzysztof Choromanski, Jared Quincy Davis, Valerii Likhosherstov, Xingyou Song, Jean-Jacques Slotine, Jacob Varley, Honglak Lee, Adrian Weller, Vikas Sindhwani

* 20 pages, 9 figures 

  Access Paper or Ask Questions

UFO-BLO: Unbiased First-Order Bilevel Optimization


Jun 05, 2020
Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Davis, Adrian Weller


  Access Paper or Ask Questions

Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers


Jun 05, 2020
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Jared Davis, Tamas Sarlos, David Belanger, Lucy Colwell, Adrian Weller

* 14 pages, 11 figures 

  Access Paper or Ask Questions

Robotic Table Tennis with Model-Free Reinforcement Learning


Mar 31, 2020
Wenbo Gao, Laura Graesser, Krzysztof Choromanski, Xingyou Song, Nevena Lazic, Pannag Sanketi, Vikas Sindhwani, Navdeep Jaitly

* 8 pages, 4 figures 

  Access Paper or Ask Questions

Stochastic Flows and Geometric Optimization on the Orthogonal Group


Mar 30, 2020
Krzysztof Choromanski, David Cheikhi, Jared Davis, Valerii Likhosherstov, Achille Nazaret, Achraf Bahamou, Xingyou Song, Mrugank Akarte, Jack Parker-Holder, Jacob Bergquist, Yuan Gao, Aldo Pacchiano, Tamas Sarlos, Adrian Weller, Vikas Sindhwani


  Access Paper or Ask Questions

Rapidly Adaptable Legged Robots via Evolutionary Meta-Learning


Mar 02, 2020
Xingyou Song, Yuxiang Yang, Krzysztof Choromanski, Ken Caluwaerts, Wenbo Gao, Chelsea Finn, Jie Tan

* For associated video file, see http://youtu.be/_QPMCDdFC3E 

  Access Paper or Ask Questions

Observational Overfitting in Reinforcement Learning


Dec 28, 2019
Xingyou Song, Yiding Jiang, Stephen Tu, Yilun Du, Behnam Neyshabur

* Published as a conference paper in ICLR 2020 

  Access Paper or Ask Questions

Gradientless Descent: High-Dimensional Zeroth-Order Optimization


Nov 19, 2019
Daniel Golovin, John Karro, Greg Kochanski, Chansoo Lee, Xingyou Song, Qiuyi Zhang

* 11 main pages, 26 total pages 

  Access Paper or Ask Questions

ES-MAML: Simple Hessian-Free Meta Learning


Oct 05, 2019
Xingyou Song, Wenbo Gao, Yuxiang Yang, Krzysztof Choromanski, Aldo Pacchiano, Yunhao Tang

* 10 main pages, 21 total pages, 21 figures 

  Access Paper or Ask Questions

Reinforcement Learning with Chromatic Networks


Jul 10, 2019
Xingyou Song, Krzysztof Choromanski, Jack Parker-Holder, Yunhao Tang, Wenbo Gao, Aldo Pacchiano, Tamas Sarlos, Deepali Jain, Yuxiang Yang

* 10 main pages, 22 total pages 

  Access Paper or Ask Questions

An Empirical Study on Hyperparameters and their Interdependence for RL Generalization


Jun 02, 2019
Xingyou Song, Yilun Du, Jacob Jackson

* Published in ICML 2019 Workshop "Understanding and Improving Generalization in Deep Learning" 

  Access Paper or Ask Questions

The Principle of Unchanged Optimality in Reinforcement Learning Generalization


Jun 02, 2019
Alex Irpan, Xingyou Song

* Published at ICML 2019 Workshop "Understanding and Improving Generalization in Deep Learning" 

  Access Paper or Ask Questions

Sentiment Predictability for Stocks


Jan 18, 2018
Jordan Prosky, Xingyou Song, Andrew Tan, Michael Zhao

* 9 pages 

  Access Paper or Ask Questions