← Lcoalhost
The great sparsification: 2026 open-weight MoE models now activate 1 to 9 percent of their weights
Source :
DEV · #llm
See it live in context on Lcoalhost →