Frank cadc7f2768 frank-default-large: threads-batch=16 confirmed optimal + decode benchmark results ...

Decode sweep (TB=8,16,32, 8K+ prompt, 256 gen tokens):
  TB=8:  3.3 tok/s (76.6s)
  TB=16: 3.4 tok/s (74.8s)
  TB=32: 3.4 tok/s (75.0s)

Decode is flat; TB=16 wins on prefill (5.1% faster) with zero decode tradeoff.

Also:
- Fix :: syntax error in serve-frank-large.sh
- Document systemctl disable destroys unit file; use mask/unmask instead

2026-08-27 13:20:52 -07:00

..

Pipeline Parallelism

Doc audit: fix all broken links + correct stale facts across the KB

2026-08-24 01:10:44 -07:00

ciru-activefpx-promptforge.md

Update benchmark documentation after harness replacement

2026-08-25 19:08:42 -07:00

Dankclaw Improvements.md

Upgrade frank-default-large to kingjones Q8_0 AGENT at full 262144 context

2026-08-25 07:12:02 -07:00

Dankclaw System Specs.md

Swap LLM fleet to Ornith CRACK (small) and kingjones ROCmFP4 STRIX MTP (large); apply Qwen-Sharp chat template

2026-08-24 21:35:11 -07:00

Dankserver System Specs.md

Use ngram-mod and prioritize attention experts

2026-08-25 01:40:06 -07:00

dankserver-vram-growth.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

dealign-ornith-crack.md

Use ngram-mod and prioritize attention experts

2026-08-25 01:40:06 -07:00

deployment.md

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

dflash2-large-vulkan.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

DFlash DSpark Speculative Decoding.md

Doc audit: fix all broken links + correct stale facts across the KB

2026-08-24 01:10:44 -07:00

eemin-rocmi4-mtp.md

Update benchmark documentation after harness replacement

2026-08-25 19:08:42 -07:00

FastFlowLM NPU Inference.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

frank-default-large-benchmark.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

frank-default-small-benchmark.md

Record no-spec ubatch benchmark

2026-08-25 01:29:49 -07:00

frank-redo-2026-08-17.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

freetoken-benchmark-sweep.md

feat: replace llama.cpp Tiel-Coder with FreeToken v0.1.2 serving Qwen3.6-35B-A3B-FP8

2026-08-27 02:01:16 -07:00

freetoken-frank-default-small.md

feat: replace llama.cpp Tiel-Coder with FreeToken v0.1.2 serving Qwen3.6-35B-A3B-FP8

2026-08-27 02:01:16 -07:00

Hybrid CPU GPU Processing Dankserver.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

ikllama-ornith-dankserver.md

frank-default-small: KV K default f16 (no hadamard), V q6_0 + hadamard

2026-08-26 05:53:01 -07:00

index.md

docs: update LLM index for STRIX model swap (STRIX_LEAN → STRIX)

2026-08-27 03:31:01 -07:00

kairic-edge.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

kingjones-q8agent-rocmfpx.md

Clarify historical ROCmFPX payload sizes

2026-08-25 13:28:38 -07:00

kingjones-strix-mtp.md

Fix Q6 AGENT projector path

2026-08-25 13:58:50 -07:00

kingjones-strix-rocmfp4.md

frank-default-large: threads-batch=16 confirmed optimal + decode benchmark results

2026-08-27 13:20:52 -07:00

ling-3.0-flash-trial.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

ling-3.0-flash-vllm-plan.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

Quantization by Hardware Architecture.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

qwen3.8-spec-matrix.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

qwen3.8-strix-optimizations.md

Upgrade frank-default-large to kingjones Q8_0 AGENT at full 262144 context

2026-08-25 07:12:02 -07:00

RAM CPU Offloading in VLLM.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

Running Qwen3.6 27B FP8 on Dankclaw.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

Running Qwen3.6 35B A3B FP8 on Dankserver.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

Shared Memory Architecture Dankclaw.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

ubatch-benchmark-large.md

Set equal batch and ubatch at 8k context

2026-08-25 21:04:00 -07:00

VLLM Index.md

Doc audit: fix all broken links + correct stale facts across the KB

2026-08-24 01:10:44 -07:00

VLLM Overview.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00

vllm_research_findings.md

Reorganize: llm/docs -> docs/LLM (LLM fleet knowledge base)

2026-08-22 15:06:51 -07:00