local-llm
- 105 identical commands and other ways local agents fail
1,655 agent transcripts from a 3090 bench: killed runs wrote longest replies four times those of passing runs, loops never passed, edits missed.
- Most models passed the scripts. The ledgers split them
Which local models passed which coding tasks on one RTX 3090: nearly all wrote the small CLI tools, and no model passed every Spring Boot run.
- On one RTX 3090, agent speed followed active parameters
Generation speed of 28 local models driving coding agents on one RTX 3090. Active parameters and MTP drafting set it; the quant moved it far less.
- Twenty-one agent runs on a laptop iGPU, none merge-ready
Seven local MoE models ran three coding tasks each on a Radeon 680M. A blind review graded all 21 runs and found none merge-ready.
- On a laptop iGPU, memory bandwidth picked the model
Coding agents on a Radeon 680M: a dense 27B generated 5.7 tokens a second whatever I tried; MoEs with 2-3B active on the GPU, 27 to 48.
- My drift check said 0 differences. It checked 4 arrays.
My Go checker read a bash model config without running it and said 0 differences. It compared 4 arrays. The fail-closed rewrite found a missing output cap.
- My agents got their own config. Two still read mine.
A separate config dir per coding agent kept my files untouched. Claude Code and OpenCode still read my ~/.claude, and OpenCode sent a prompt to a hosted model.
- In opencode 1.19.5, my workaround protected nothing
I renamed model keys so opencode wouldn't force top_p on my local models. In 1.19.5 it matches the id I sent anyway, and the qwen rule is gone.
- Two rounds, seventeen arms: the engine set the speed, not the quant
17 local-model setups on one 128 GB box. Q2_0 generated 2.2x faster than IQ4_XS; a same-file engine A/B puts most of that on the engine.
- Five languages, two reps: the round-two ranking
Five local models in six setups, 144 coding-agent runs on one 128 GB box. Flash-Next leads in both quants, and the bugs line up by ticket.