llama.cpp TRIAL

Version 0.7.0 improves MoE inference and introduces server compatibility changes.

Next stepReplay an MoE workload and regress API/RPC compatibility.

Judgment reviewed 2026-10-16 · Basis: llama.cpp 0.7.0 adds MoE caching and changes its server API