Speed and Conversational Large Language Models: Not All Is About Tokens per Second

Add code
Feb 23, 2025
Javier Conde, Miguel González, Pedro Reviriego, Zhen Gao, Shanshan Liu, Fabrizio Lombardi
Figure 1 for Speed and Conversational Large Language Models: Not All Is About Tokens per Second
Figure 2 for Speed and Conversational Large Language Models: Not All Is About Tokens per Second
Figure 3 for Speed and Conversational Large Language Models: Not All Is About Tokens per Second
Figure 4 for Speed and Conversational Large Language Models: Not All Is About Tokens per Second

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

The speed of open-weights large language models (LLMs) and its dependency on the task at hand, when run on GPUs, is studied to present a comparative analysis of the speed of the most popular open LLMs.

* Computer (Volume: 57, Issue: 8, August 2024)  
View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon