[
  {
    "id": "witness-glm52-cpu-throughput",
    "title": "GLM-5.2 CPU serve on a high-RAM no-GPU box: single-stream prefill/decode tok/s for the full ~433GB UD-Q4_K_M. MEMORY: the fak-native all-resident path needs >= ~1.1x model-size of FREE RAM (it loaded ~458GB resident and WEDGED a 1TB host where ~512GB was hugepage-locked, 2026-06-27 / #974); run llama.cpp (mmap, memory-safe) for the baseline, and the fak-native path ONLY when free RAM clears the model+KV.",
    "source": "overlay",
    "value": "frontier",
    "requires": ["weights"],
    "manual": true,
    "run": "BASELINE (memory-safe, mmap): /path/to/llama-bench -m $FAK_GGUF -ngl 0 -t 128 -p 256 -n 64 -r 2   ||   FAK-NATIVE (only if free RAM > ~1.1x GGUF size + KV; else it OOM-wedges the host, #974): FAK_Q4K=1 FAK_GGUF_LOAD_WORKERS=64 fak serve --gguf $FAK_GGUF --context-budget-tokens 8192 --addr 127.0.0.1:8080  then POST /v1/chat/completions",
    "acceptance": "a recorded single-stream prefill+decode tok/s for GLM-5.2 UD-Q4_K_M on a CPU-only host for llama.cpp (mmap baseline) and, where RAM allows, fak-native, in an experiments/benchmark/runs artifact; the fak-native resident-Q4_K load wall-clock + GB/s where it fits",
    "recheck_days": 30,
    "timeout_sec": 7200,
    "doc": "docs/notes/GLM52-FAK-NATIVE-CPU-SERVE-MEMORY-WEDGE-2026-06-27.md"
  },
  {
    "id": "witness-qwen36-27b-metal-decode",
    "title": "Qwen3.6-27B Q4_K_M single-stream decode tok/s in fak's OWN Apple-Silicon Metal kernel (engine=inkernel, --metal), NOT coder14b/llama.cpp. The decode-length curve (16/32/64/128 tok) traces the prefill-amortization asymptote. The 36GB Mac needs --context-budget-tokens to bound KV (the full native window is 192GiB -> FitTooBig).",
    "source": "overlay",
    "value": "frontier",
    "requires": ["metal", "weights"],
    "manual": true,
    "run": "On the Mac metal node (a -tags fakmetal fak build): FAK_Q4K=1 FAK_GATEWAY_KEY=$(cat ~/.fak-gateway-key) fak serve --metal --gguf <mac>/.cache/fak-models/gguf/Qwen3.6-27B.q4_k_m.gguf --model qwen3.6-27b --addr $FAK_MAC_GATEWAY --require-key-env FAK_GATEWAY_KEY --context-budget-tokens 8192  then curl /v1/chat/completions max_tokens={16,32,64,128} and record completion_tokens/time_total. WARM the serve first (discard the cold 16-tok point). Real mac host/user resolve from the gitignored fak-mac.local.ps1 (see docs/fak/scrubbing-real-values.md).",
    "acceptance": "a recorded warm single-stream decode tok/s curve for Qwen3.6-27B Q4_K_M on the Mac Metal node, labelled WITNESSED (fak own kernel); the cold first-request point flagged separately",
    "recheck_days": 14,
    "timeout_sec": 1800,
    "doc": "docs/nightrun/MAC-OVERNIGHT-PLAN-2026-06-28.md"
  }
]
