Alert button
Picture for Valerii Likhosherstov

Valerii Likhosherstov

Alert button

Scalable Neural Network Kernels

Oct 20, 2023
Arijit Sehanobish, Krzysztof Choromanski, Yunfan Zhao, Avinava Dubey, Valerii Likhosherstov

Figure 1 for Scalable Neural Network Kernels
Figure 2 for Scalable Neural Network Kernels
Figure 3 for Scalable Neural Network Kernels
Figure 4 for Scalable Neural Network Kernels
Viaarxiv icon

Efficient Graph Field Integrators Meet Point Clouds

Feb 05, 2023
Krzysztof Choromanski, Arijit Sehanobish, Han Lin, Yunfan Zhao, Eli Berger, Tetiana Parshakova, Alvin Pan, David Watkins, Tianyi Zhang, Valerii Likhosherstov, Somnath Basu Roy Chowdhury, Avinava Dubey, Deepali Jain, Tamas Sarlos, Snigdha Chaturvedi, Adrian Weller

Figure 1 for Efficient Graph Field Integrators Meet Point Clouds
Figure 2 for Efficient Graph Field Integrators Meet Point Clouds
Figure 3 for Efficient Graph Field Integrators Meet Point Clouds
Figure 4 for Efficient Graph Field Integrators Meet Point Clouds
Viaarxiv icon

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers

Feb 03, 2023
Krzysztof Marcin Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamas Sarlos, Thomas Weingarten, Adrian Weller

Figure 1 for Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
Figure 2 for Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
Figure 3 for Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
Figure 4 for Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
Viaarxiv icon

FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features

Feb 01, 2023
Valerii Likhosherstov, Krzysztof Choromanski, Avinava Dubey, Frederick Liu, Tamas Sarlos, Adrian Weller

Figure 1 for FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features
Figure 2 for FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features
Figure 3 for FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features
Figure 4 for FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features
Viaarxiv icon

Simplex Random Features

Jan 31, 2023
Isaac Reid, Krzysztof Choromanski, Valerii Likhosherstov, Adrian Weller

Figure 1 for Simplex Random Features
Figure 2 for Simplex Random Features
Figure 3 for Simplex Random Features
Figure 4 for Simplex Random Features
Viaarxiv icon

Adaptive Computation with Elastic Input Sequence

Jan 30, 2023
Fuzhao Xue, Valerii Likhosherstov, Anurag Arnab, Neil Houlsby, Mostafa Dehghani, Yang You

Figure 1 for Adaptive Computation with Elastic Input Sequence
Figure 2 for Adaptive Computation with Elastic Input Sequence
Figure 3 for Adaptive Computation with Elastic Input Sequence
Figure 4 for Adaptive Computation with Elastic Input Sequence
Viaarxiv icon

Automated Deep Aberration Detection from Chromosome Karyotype Images

Nov 30, 2022
Zahra Shamsi, Drew Bryant, Jacob Wilson, Xiaoyu Qu, Avinava Dubey, Konik Kothari, Mostafa Dehghani, Mariya Chavarha, Valerii Likhosherstov, Brian Williams, Michael Frumkin, Fred Appelbaum, Krzysztof Choromanski, Ali Bashir, Min Fang

Figure 1 for Automated Deep Aberration Detection from Chromosome Karyotype Images
Figure 2 for Automated Deep Aberration Detection from Chromosome Karyotype Images
Figure 3 for Automated Deep Aberration Detection from Chromosome Karyotype Images
Figure 4 for Automated Deep Aberration Detection from Chromosome Karyotype Images
Viaarxiv icon

Chefs' Random Tables: Non-Trigonometric Random Features

May 30, 2022
Valerii Likhosherstov, Krzysztof Choromanski, Avinava Dubey, Frederick Liu, Tamas Sarlos, Adrian Weller

Figure 1 for Chefs' Random Tables: Non-Trigonometric Random Features
Figure 2 for Chefs' Random Tables: Non-Trigonometric Random Features
Figure 3 for Chefs' Random Tables: Non-Trigonometric Random Features
Figure 4 for Chefs' Random Tables: Non-Trigonometric Random Features
Viaarxiv icon

PolyViT: Co-training Vision Transformers on Images, Videos and Audio

Nov 25, 2021
Valerii Likhosherstov, Anurag Arnab, Krzysztof Choromanski, Mario Lucic, Yi Tay, Adrian Weller, Mostafa Dehghani

Figure 1 for PolyViT: Co-training Vision Transformers on Images, Videos and Audio
Figure 2 for PolyViT: Co-training Vision Transformers on Images, Videos and Audio
Figure 3 for PolyViT: Co-training Vision Transformers on Images, Videos and Audio
Figure 4 for PolyViT: Co-training Vision Transformers on Images, Videos and Audio
Viaarxiv icon