rocm
- Faster prompts, slower agents: a second engine on the 680M
A MoE engine read prompts 1.4x faster than llama.cpp on a Radeon 680M and generated slower. Three agent runs got the same grades and finished later.
- 120 GiB for the GPU, set in the kernel, not the BIOS
On a 128 GB Strix Halo box the BIOS's 96 G GPU setting leaves Linux 31 GiB. The minimum plus two TTM parameters gives the GPU 120 GiB.