docs: pipeline parallelism research + educational sample script set
Compiles the 5-subagent research fan-out (llama.cpp RPC, vLLM PP, bandwidth math, mixed-vendor experiments, Qwen3.6-27B spec methods) into the KB under docs/Pipeline Parallelism/ with an index, expected performance estimates (1/2.5/10 GbE), and an EDUCATIONAL-ONLY two-node Qwen3.6-27B Q8 split script set (MTP/DFlash/ngram-mod variants, DSpark noted as vLLM-only). Nothing here is deployed or intended to run.
This commit is contained in:
1 parent
8d1d9baa82
commit
db69fc8192
9 files changed
+1915
No files matched your search
@@ -59,3 +59,13 @@ MTP-ONLY draft, port 7770]
|
||||
|
||||
- [[DFlash DSpark Speculative Decoding]] — block diffusion (DFlash) and semi-autoregressive (DSpark) drafting on vLLM and llama.cpp
|
||||
- [[Quantization by Hardware Architecture]] — which quant format fits which GPU/CPU
|
||||
|
||||
## Pipeline Parallelism
|
||||
|
||||
- [[Pipeline Parallelism]] — index of multi-node inference research and sample scripts
|
||||
- [[Pipeline Parallelism/llama.cpp RPC]] — ggml-rpc-server + `--rpc` distributed inference
|
||||
- [[Pipeline Parallelism/vLLM Pipeline Parallelism]] — vLLM PP across machines
|
||||
- [[Pipeline Parallelism/Ethernet Bandwidth Math]] — bytes per token and link feasibility
|
||||
- [[Pipeline Parallelism/Mixed-Vendor Experiments]] — NVIDIA + Strix Halo real-world runs
|
||||
- [[Pipeline Parallelism/Expected Performance]] — estimated tok/s over 1/2.5/10 GbE
|
||||
- [[Pipeline Parallelism/Sample Script Set]] — educational two-node Qwen3.6-27B Q8 split
|
||||
Reference in new issue
Block a user