← Lcoalhost
FP8 Cut Our TPOT by 25%. At High Concurrency, It Also Changed the Answers.
Source :
DEV · #llm
See it live in context on Lcoalhost →