← Lcoalhost
RTX 3090 vs A100 for a 7B model on vLLM: the cheaper GPU depends on your answer time
Source :
DEV · #llm
See it live in context on Lcoalhost →