← Lcoalhost
How much VRAM do popular LLMs really need at 4-bit and 8K context? Data from 26 models
Source :
DEV · #llm
See it live in context on Lcoalhost →