← Lcoalhost
Every 1,000 tokens of context costs 0.39 ms: decode speed from 1K to 100K on RTX Spark
Source :
DEV · #llm
See it live in context on Lcoalhost →