← Lcoalhost

One 4k prompt costs a serving node as much as 900 generated tokens

Source : DEV · #llm

See it live in context on Lcoalhost →