← Lcoalhost
An 80GB H100, and only 3B of the model could keep up with conversation
Source :
DEV · #llm
See it live in context on Lcoalhost →