← Lcoalhost

How much VRAM do popular LLMs really need at 4-bit and 8K context? Data from 26 models

Source : DEV · #llm

See it live in context on Lcoalhost →