agent_swarm drives the core scenario: several agents share a long repo
context and differ only in a short instruction. It runs the workload with
sharing off (baseline) and on, erasing llama's own per-slot cache between
runs so the comparison isolates cross-process reuse, and reports honest
end-to-end TTFT, recomputed prefill tokens, hit rate and throughput.
smoke_e2e is a minimal two-agent cross-GPU reuse check; microbench_store
and microbench_striped measure raw and striped store bandwidth;
run_matrix sweeps a config and plot renders the figures.
scripts/env.sh keeps every toolchain, cache and runtime directory under
an out-of-tree state root so the source stays clean and nothing is
written under /. The setup_* scripts install a local Go toolchain, a
venv with mooncake-transfer-engine, a CUDA build of llama.cpp and the
GGUF models; the *_start/stop and demo scripts bring the stack up and
down, scoped to this integration's own ports and paths.
897a11bd34