Get our free extension to see links to code for papers anywhere online!
Free add-on: code for papers everywhere!
Free add-on: See code for papers anywhere!
Add to Chrome
Add to Firefox
Add to Edge
CatalyzeX Icon
Search Icon
Code for
High-throughput Generative Inference of Large Language Models with a Single GPU
Github Icon
FMInference/FlexGen
Explore Code
Download Icon
Github Icon
NVIDIA/FasterTransformer
Explore Code
Download Icon