← Lcoalhost

An 8B SLM on a 4-core laptop CPU, no GPU: 6 tokens/sec

Source : DEV · #llm

See it live in context on Lcoalhost →