← Lcoalhost
The model page said 8-bit. The checkpoint is 4.49 bits per parameter.
Source :
DEV · #llm
See it live in context on Lcoalhost →