The freedom and limitations of local language models
I spent part of the extended weekend doing a few A/B comparisons between local LLMs and a frontier model for reference. The setup was intentionally simple. I gave two models the same Kubernetes or TypeScript coding task and judged the output subjectively....