docs: dankserver board swap clears the PCIe-atomics wall
Reanalysis after the 2026-09-20 swap to an ASUS ProArt B850-Creator WiFi NEO: both R9700s now sit on CPU GPP root ports (x8/x8 Gen5 bifurcation), every bridge reads AtomicOpsCap Routing+, and both endpoints read AtomicOpsCtl ReqEn+ (CAP_EXP+28.w = 0x1440) — the exact precondition Dual-R9700-Cooperation's test plan named. TP=2 is therefore unblocked, not proven: no collective has been dispatched since the swap, GGML_HIP_RCCL is still OFF, and the 272 t/s "tensor" number on record measured a butterfly fallback. - Dual-R9700-Cooperation: short answer rewritten, re-measured 2026-09-20 topology table, rebuild-hypothesis door marked moot, probe plan is now standing work. - Dankserver System Specs: Motherboard section; GPU BDFs 0b:00.0 -> 07:00.0, iGPU 10:00.0 -> 11:00.0, kernel 7.0.0-31, SMT on, and the new eno2 (192.168.0.247) second 5GbE port holding the low-metric default route while eno1 keeps the fleet's static .235. - frank-medium-llamacpp-dflash2: rationale and hardware row split past from present; dated work-log sections stay as history. - AGENTS.md + both indexes: no longer assert a wall that no longer exists. Docs only; frank-medium stayed active and healthy throughout (verified /health). ./tests/run.sh 331/331.
This commit is contained in:
@@ -120,20 +120,21 @@ The LLM inference fleet on the two hosts. Full index:
|
||||
serving orcarouter/Qwen3.8-27B-Uncensored-GGUF at Q8_0 with the DFlash2
|
||||
drafter (z-lab/Qwen3.8-27B-DFlash2-GGUF at Q4_K_M) on Dankserver's 2x Radeon
|
||||
AI PRO R9700 as one layer-split process behind the :7770 endpoint, balanced
|
||||
32:33 over two 163,840-token slots — no tensor parallelism, because the
|
||||
second card cannot dispatch an RCCL collective
|
||||
32:33 over two 163,840-token slots — no tensor parallelism: the runtime ships
|
||||
RCCL-less, and the collective has not been re-probed since the 2026-09-20
|
||||
board swap cleared the atomics gate
|
||||
- [[frank-medium-radiance-mxfp4]] — RETIRED 2026-09-16: the vllm-radiance
|
||||
MXFP4 stack serving just1moremodel/Qwen3.8-27B-Uncensored-MXFP4-awq on
|
||||
Dankserver's 2x Radeon AI PRO R9700 as two single-GPU replicas behind a
|
||||
round-robin proxy; kept as the record of the deployment
|
||||
[[frank-medium-llamacpp-dflash2]] replaced, plus the PCIe-atomics evidence
|
||||
that rules out TP=2 on this host (since 2026-09-15/16)
|
||||
- [[Dual-R9700-Cooperation]] — why the two R9700s cannot run tensor-parallel
|
||||
that ruled out TP=2 on the previous board (gate cleared 2026-09-20)
|
||||
- [[Dual-R9700-Cooperation]] — why the two R9700s *could not* run tensor-parallel
|
||||
together: the PCIe-atomics gate quoted from ROCclr, the measured RCCL matrix
|
||||
(collectives *and* P2P `send`/`recv` both fail on card #2, which rules out
|
||||
pipeline parallelism too), what is closed and what is still open, and the two
|
||||
hardware paths — a ~$30 M.2→PCIe x4 riser into the free, CPU-attached M.2_2
|
||||
slot, or a board whose CPU x16 bifurcates to x8/x8
|
||||
(collectives *and* P2P `send`/`recv` both failed on card #2, which ruled out
|
||||
pipeline parallelism too), what was closed, and the re-measured 2026-09-20
|
||||
topology after the ProArt B850-Creator x8/x8 swap — both chains `Routing+`,
|
||||
both endpoints `ReqEn+`, so TP=2 is unblocked but still unprobed
|
||||
- [[frank-medium-rocmfpx]] — PRIOR frank-medium deployment (llama.cpp era):
|
||||
charlie12345/ROCmFPX serving kingjones777/
|
||||
Qwen3.8-27B-ROCmFPX-Q8_0-AGENT-GGUF; kept as the record of the runtime it
|
||||
|
||||
Reference in New Issue
Block a user