← Lcoalhost

Repacked QAT Gemma 4 on One TPU v5e: 12B Serves at 675 Tokens per Second

Source : DEV · #llm

See it live in context on Lcoalhost →