← Lcoalhost
vLLM on three GPUs: Qwen2.5-7B tokens per second and cost per 1M tokens on RTX A6000, L40S and H100
Source :
DEV · #llm
See it live in context on Lcoalhost →