live: heartbeat sync 2026-10-18T16:47:59-07:00 (Refs #11)
This commit is contained in:
1 parent
a550db6027
commit
979e9ef711
173 files changed
+3844
-57
No files matched your search
@@ -0,0 +1,9 @@
|
||||
## LLM Runtime KV Cache (frank-archon)
|
||||
|
||||
**KV cache is unquantized (fp8 native)** — radiance engine 1.0.13 on frank-primary (frank-archon) runs with fp8 KV cache pool of 3.46 GiB. A prior quantized state was reversed; the unquantized configuration is the current production state.
|
||||
|
||||
**Per-slot context ceiling** — `frank-archon` and `frank-dragoon` share a 262,144 position per-slot ceiling (`--ctx-size 401408 --parallel 2`), distinct from the 27B-era 200,192 limit. The harness clamps `max_tokens` to `min(45056, contextWindow − est − 4096)` and the 400-zone law under-counts; the 400 constant is the floor.
|
||||
|
||||
**MTP head placement** — `frank-dragoon` halogen-flash-server 0.16.2 embeds the MTP head inside the checkpoint (`HALOGEN_MTP_HEAD` unset; no sidecar fetched). `frank-zealot` llama.cpp has no MTP tensors in the Q6_K GGUF file.
|
||||
|
||||
**Per-slot vs pool context** — `frank-zealot` exposes `200704` as the per-slot window (configured `--ctx-size 401408 --parallel 2`), not the 262,144 native model size or the 409,600 aggregate pool. The harness must compact before llama.cpp accepts longer prompts.
|
||||
Reference in new issue
Block a user