← Lcoalhost
GPU offload says Max, but only 54 of 65 layers loaded: how to check where your model actually runs
Source :
DEV · #llm
See it live in context on Lcoalhost →