← Lcoalhost

llama-server's logprobs are placeholders when speculative decoding is on

Source : DEV · #llm

See it live in context on Lcoalhost →