Picture for Insu Han

Insu Han

QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead

Add code
Jun 05, 2024
Viaarxiv icon

SubGen: Token Generation in Sublinear Time and Memory

Add code
Feb 08, 2024
Viaarxiv icon

HyperAttention: Long-context Attention in Near-Linear Time

Oct 11, 2023
Viaarxiv icon

KDEformer: Accelerating Transformers via Kernel Density Estimation

Add code
Feb 05, 2023
Figure 1 for KDEformer: Accelerating Transformers via Kernel Density Estimation
Figure 2 for KDEformer: Accelerating Transformers via Kernel Density Estimation
Figure 3 for KDEformer: Accelerating Transformers via Kernel Density Estimation
Figure 4 for KDEformer: Accelerating Transformers via Kernel Density Estimation
Viaarxiv icon

Fast Neural Kernel Embeddings for General Activations

Add code
Sep 09, 2022
Figure 1 for Fast Neural Kernel Embeddings for General Activations
Figure 2 for Fast Neural Kernel Embeddings for General Activations
Figure 3 for Fast Neural Kernel Embeddings for General Activations
Figure 4 for Fast Neural Kernel Embeddings for General Activations
Viaarxiv icon

Scalable MCMC Sampling for Nonsymmetric Determinantal Point Processes

Add code
Jul 01, 2022
Figure 1 for Scalable MCMC Sampling for Nonsymmetric Determinantal Point Processes
Figure 2 for Scalable MCMC Sampling for Nonsymmetric Determinantal Point Processes
Figure 3 for Scalable MCMC Sampling for Nonsymmetric Determinantal Point Processes
Figure 4 for Scalable MCMC Sampling for Nonsymmetric Determinantal Point Processes
Viaarxiv icon

Near Optimal Reconstruction of Spherical Harmonic Expansions

Feb 25, 2022
Figure 1 for Near Optimal Reconstruction of Spherical Harmonic Expansions
Viaarxiv icon

Random Gegenbauer Features for Scalable Kernel Methods

Add code
Feb 07, 2022
Figure 1 for Random Gegenbauer Features for Scalable Kernel Methods
Figure 2 for Random Gegenbauer Features for Scalable Kernel Methods
Figure 3 for Random Gegenbauer Features for Scalable Kernel Methods
Figure 4 for Random Gegenbauer Features for Scalable Kernel Methods
Viaarxiv icon

Scalable Sampling for Nonsymmetric Determinantal Point Processes

Add code
Jan 20, 2022
Figure 1 for Scalable Sampling for Nonsymmetric Determinantal Point Processes
Figure 2 for Scalable Sampling for Nonsymmetric Determinantal Point Processes
Figure 3 for Scalable Sampling for Nonsymmetric Determinantal Point Processes
Viaarxiv icon

Scaling Neural Tangent Kernels via Sketching and Random Features

Add code
Jun 15, 2021
Figure 1 for Scaling Neural Tangent Kernels via Sketching and Random Features
Figure 2 for Scaling Neural Tangent Kernels via Sketching and Random Features
Figure 3 for Scaling Neural Tangent Kernels via Sketching and Random Features
Figure 4 for Scaling Neural Tangent Kernels via Sketching and Random Features
Viaarxiv icon