docs: pipeline parallelism research + educational sample script set

Compiles the 5-subagent research fan-out (llama.cpp RPC, vLLM PP,
bandwidth math, mixed-vendor experiments, Qwen3.6-27B spec methods) into
the KB under docs/Pipeline Parallelism/ with an index, expected
performance estimates (1/2.5/10 GbE), and an EDUCATIONAL-ONLY two-node
Qwen3.6-27B Q8 split script set (MTP/DFlash/ngram-mod variants, DSpark
noted as vLLM-only). Nothing here is deployed or intended to run.
This commit is contained in:
Frank committed 2026-08-14 00:22:23 -07:00
1 parent 8d1d9baa82
commit db69fc8192
9 files changed
+1915

No files matched your search

+10
View File
@@ -59,3 +59,13 @@ MTP-ONLY draft, port 7770]
- [[DFlash DSpark Speculative Decoding]] — block diffusion (DFlash) and semi-autoregressive (DSpark) drafting on vLLM and llama.cpp
- [[Quantization by Hardware Architecture]] — which quant format fits which GPU/CPU
## Pipeline Parallelism
- [[Pipeline Parallelism]] — index of multi-node inference research and sample scripts
- [[Pipeline Parallelism/llama.cpp RPC]] — ggml-rpc-server + `--rpc` distributed inference
- [[Pipeline Parallelism/vLLM Pipeline Parallelism]] — vLLM PP across machines
- [[Pipeline Parallelism/Ethernet Bandwidth Math]] — bytes per token and link feasibility
- [[Pipeline Parallelism/Mixed-Vendor Experiments]] — NVIDIA + Strix Halo real-world runs
- [[Pipeline Parallelism/Expected Performance]] — estimated tok/s over 1/2.5/10 GbE
- [[Pipeline Parallelism/Sample Script Set]] — educational two-node Qwen3.6-27B Q8 split