← Lcoalhost
Serving a 6 GB ternary 27B model: the settings that decide whether it works
Source :
DEV · #llm
See it live in context on Lcoalhost →