Frank 8b79766d81 docs: record why CHUNK stays at 8192 on the single-GPU replicas ...

Raising the prefill chunk to 16384 grows the arena enough that the KV cache
falls to 4.22 GiB against the 5.21 GiB a 114688-token context needs, so the
engine refuses to start. Measured single-card prefill at 8192 is ~2.5k tok/s
(~15k-token prompt, 5992 ms TTFT); the trade would mean cutting context for
unmeasured prefill gain, so the default stands.

2026-09-16 04:58:47 -07:00

..

Pipeline Parallelism

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

agentionai-fast-imatrix.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

ciru-activefpx-promptforge.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Dankclaw Improvements.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Dankclaw System Specs.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

dankclaw-iommu-translation-off.md

feat(llm): swap frank-large to halogen-flash-server, retire frank-npu

2026-09-11 14:48:28 -07:00

Dankserver System Specs.md

docs: frank-medium runbook, fleet topology and client cutover

2026-09-15 19:27:04 -07:00

dankserver-vram-growth.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

dealign-ornith-crack.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

deployment.md

docs: frank-medium runbook, fleet topology and client cutover

2026-09-15 19:27:04 -07:00

dflash2-large-vulkan.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

DFlash DSpark Speculative Decoding.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

eemin-rocmi4-mtp.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

FastFlowLM NPU Inference.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-large-benchmark.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-large-ik-uncensored.md

frank-large: document the ik_llama.cpp deployment and the decode performance campaign

2026-09-16 02:42:41 -07:00

frank-medium-radiance-mxfp4.md

docs: record why CHUNK stays at 8192 on the single-GPU replicas

2026-09-16 04:58:47 -07:00

frank-medium-rocmfpx.md

frank-medium: deploy two single-GPU replicas — TP=2 is blocked by PCIe atomics

2026-09-16 03:47:11 -07:00

frank-npu.md

feat(llm): swap frank-large to halogen-flash-server, retire frank-npu

2026-09-11 14:48:28 -07:00

frank-redo-2026-08-17.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-small-benchmark.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

freetoken-benchmark-sweep.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

freetoken-frank-small.md

docs: frank-medium runbook, fleet topology and client cutover

2026-09-15 19:27:04 -07:00

halogen-flash-server.md

frank-large: correct docs to measured 401408 ledger figures

2026-09-13 23:02:16 -07:00

Hybrid CPU GPU Processing Dankserver.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

ikllama-ornith-dankserver.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

index.md

frank-medium: deploy two single-GPU replicas — TP=2 is blocked by PCIe atomics

2026-09-16 03:47:11 -07:00

kairic-edge.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

kingjones-q8agent-rocmfpx.md

docs: frank-medium runbook, fleet topology and client cutover

2026-09-15 19:27:04 -07:00

kingjones-strix-mtp.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

kingjones-strix-rocmfp4.md

feat(llm): swap frank-large to halogen-flash-server, retire frank-npu

2026-09-11 14:48:28 -07:00

ling-3.0-flash-trial.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

ling-3.0-flash-vllm-plan.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Quantization by Hardware Architecture.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

qwen3.8-spec-matrix.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

qwen3.8-strix-optimizations.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

RAM CPU Offloading in VLLM.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

Running Qwen3.6 27B FP8 on Dankclaw.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Running Qwen3.6 35B A3B FP8 on Dankserver.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Shared Memory Architecture Dankclaw.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

ubatch-benchmark-large.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

VLLM Index.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

VLLM Overview.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

vllm_research_findings.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00