← Lcoalhost

RTX 3090 vs A100 for a 7B model on vLLM: the cheaper GPU depends on your answer time

Source : DEV · #llm

See it live in context on Lcoalhost →