Writing

Which Local LLM Is Most Useful With 36 GB VRAM and 128 GB RAM?

I tested three MoE models from 125B to 321B parameters to find which one gives the best mix of capability and speed on my workstation.