Frank
aa1941d592
docs + guard: single 262k slot state, split-limits analysis, cache incident
...
- spec matrix + PP doc: production state = 1 slot @ 262144, split 0.53
(34 blocks), KV 8192/8192, 3090 at 23460/24576. New 'Split limits
(measured 2026-08-17)' section: 0.50/0.54/0.55 boundary data, the
KV-per-device rounding rule (round(f x 66)), and why 35 blocks is
unreachable (9-FA flip at f~0.538).
- PP doc: cache incident writeup - full Dankserver disk -> 0-byte cache
entries -> corrupt weights -> degenerate output; fix + signature.
- deployment.md + AGENTS.md + index.md: numbers brought current.
- scripts/prune-rpc-cache.sh: cron guard capping the worker cache at
40 GiB (oldest first) to prevent the disk-full recurrence.
2026-08-17 01:24:06 -07:00
Frank
7fe271e65d
docs: llama.cpp stack at production state (2026-08-16) + sibling-project links
...
- spec matrix: new 'Production state' section — PP head (RPC0+ROCm0,
split 0.40/0.60), pool 401400 / n_ctx_slot 200704 live, MTP n_max 4
over ngram-mod fallback (journal acceptance stats), f16 KV.
2026-08-15 standalone state marked superseded (Vulkan0 verdict was
standalone-only; PP head runs ROCm0 by default).
- deployment.md: fix frank-default-large section (MTP not 'no draft',
ROCm0 not Vulkan0, 200704/slot not 262144, f16 not q8_0 KV,
serve-pp-head.sh not serve-llama-frank-large.sh).
- PP deployment doc: production-state section; test-day open questions
resolved with journal evidence.
- index.md: NPU line now qwen3.6-moe:35b-a3b @262k ctx; Sibling
projects section -> serverAppConfigs.
- AGENTS.md: overview reflects PP+MTP reality; sibling pointer.
2026-08-16 23:19:21 -07:00
Frank