← Lcoalhost

The great sparsification: 2026 open-weight MoE models now activate 1 to 9 percent of their weights

Source : DEV · #llm

See it live in context on Lcoalhost →