← Lcoalhost

Estimating tokens/s for Mixture-of-Experts models: active parameters, plus a routing term

Source : DEV · #llm

See it live in context on Lcoalhost →