Frank
8c42771877
docs: mark retired FastFlowLM/NPU pages with the port/name handoff; tighten Dankclaw system specs runtime row
2026-08-17 18:10:57 -07:00
Frank
d9af7f1d19
fleet redo 2026-08-17: retire PP+NPU, new topology
...
- Move all previous scripts to old/scripts/ (retired PP/NPU-era)
- frank-default-large: llama.cpp FastMTP on dankserver (HauhauCS
Qwen3.8-27B IQ4_XS + FastMTP 32K draft + ngram-mod, K q8_0/V f16,
128K ctx, batch 2048/ubatch 1024, port 7770)
- frank-default-small: vLLM ROCm on dankclaw (Avesed Qwen3.6-35B-A3B
INT8 W8A8, full 262144 ctx, no KV quant, 4 seqs, batch 16384,
ngram spec, port 52625)
- retarget deploy.sh (dankserver/dankclaw, inline sudo, no helpers)
- docs: deployment + index + AGENTS.md + README for new topology,
superseded banners on retired docs, add frank-redo-2026-08-17 runbook
2026-08-17 15:23:46 -07:00
Frank
968066ff23
docs: boot policy (only PP units enabled), deploy.sh dankserver hazard, stale-claim cleanup
...
- deployment.md: Boot Policy (2026-08-17) section (disabled units table,
re-enable recipes, stale frank-restart-small.sh helper, broken
deploy.sh dankserver target); Update Dankserver -> frank-pp-worker;
condensed retired 35B history block and 2026-08-13 incident
- AGENTS.md: boot-policy note, target map fix (Q6_K, split 0.68),
deploy.sh dankserver warning, obsolete quirk entries condensed
- README.md: rewrite active services/models tables (PP head + worker)
- index.md: topology fix (qwythos:9b, Q6_K split 0.68, NPU disabled)
- qwen3.8-spec-matrix.md: superseded configs merged into compact
history; stale inline env block removed; bundled-head MTP note
- FastFlowLM, PP Deployment: boot-policy + enablement notes
- System Specs x2, DFlash doc, 35B FP8 doc, Ling docs: stale active
claims fixed, retired banners, never-shipped plan stubbed
2026-08-17 03:30:00 -07:00
Frank
e9ec5cd13f
docs: NPU endpoint now serves qwythos:9b (2026-08-17 swap, FLM 1.0.1)
...
- AGENTS.md + deployment.md target maps: qwen3.6-moe:35b-a3b -> qwythos:9b
- FLM doc: FLM 1.0.1 upgrade record, flm-add install state, model swap
paragraph (commit c85ff6c
2026-08-17 01:24:43 -07:00
Frank
f5a78db017
docs: FLM rejects developer role — root cause of pi 'Stream ended without finish_reason'
...
Streaming requests with role=developer get HTTP 200 + error JSON as
first body; pi sees a chunkless stream. Fix: compat.supportsDeveloperRole
false on the model entry. Verified by field bisection + headless pi run.
2026-08-16 20:54:13 -07:00
Frank
9ec5678ef0
docs: qwen3.6-moe unreachable incident (2026-08-16) + topology reconciliation
...
- FastFlowLM doc: incident section (EXEC-203 exec-bit loop, client model
ID 'frank-default-small' rejected, swap churn 14:48-15:03), FLM
unknown-tag fallback behavior (silently loads llama3.2:1b default),
working models.json entry recorded, promotion status -> qwen3.6-moe
- AGENTS.md: Overview + target map now reflect qwen3.6-moe:35b-a3b on
the NPU endpoint (Dankserver llama.cpp 35B service stopped)
- deployment.md: topology table current; Dankserver frank-default-small
section marked STOPPED 2026-08-16 (alias moved to the NPU endpoint)
2026-08-16 15:50:15 -07:00
Frank
2f1999b2e9
docs: frank-default-small live config — turbo, ASR, 131072 ctx verified
2026-08-16 14:38:37 -07:00
Frank
d0ade28f6d
docs: fleet topology update — PP split renamed frank-default-large, NPU endpoint promoted to frank-default-small, 4-model NPU bakeoff matrix (2026-08-16)
2026-08-16 14:22:13 -07:00
Frank
79c913aaa7
docs: NPU parallelism measured — single-lane FIFO serialization, aggregate t/s flat at N=1/2/4
2026-08-16 13:12:46 -07:00
Frank
d48227c7f7
docs: gpt-oss-20b landed on the Dankclaw NPU — 19.3 t/s decode measured, memlock fix, serve state (2026-08-16)
2026-08-16 12:57:44 -07:00
Frank
0799fc5eb4
docs: FastFlowLM NPU research — AMD NPU runtime, 50 TOPS Strix Halo fit analysis, verified install state, test runbook (2026-08-16)
2026-08-16 12:29:11 -07:00
Frank