← Lcoalhost

vLLM on three GPUs: Qwen2.5-7B tokens per second and cost per 1M tokens on RTX A6000, L40S and H100

Source : DEV · #llm

See it live in context on Lcoalhost →