← Lcoalhost

GPU offload says Max, but only 54 of 65 layers loaded: how to check where your model actually runs

Source : DEV · #llm

See it live in context on Lcoalhost →