From 9a83dae73af3e4794bf4ce98a2b53dd2a79c9afc Mon Sep 17 00:00:00 2001 From: Frank Date: Wed, 16 Sep 2026 15:52:45 -0700 Subject: [PATCH] docs: blank line before the throughput heading --- serverAppConfigs-docs/LLM/frank-medium-llamacpp-dflash2.md | 1 + 1 file changed, 1 insertion(+) diff --git a/serverAppConfigs-docs/LLM/frank-medium-llamacpp-dflash2.md b/serverAppConfigs-docs/LLM/frank-medium-llamacpp-dflash2.md index e1d8f0d..5a006a0 100644 --- a/serverAppConfigs-docs/LLM/frank-medium-llamacpp-dflash2.md +++ b/serverAppConfigs-docs/LLM/frank-medium-llamacpp-dflash2.md @@ -186,6 +186,7 @@ Deployed flags: replaced: two vLLM replicas, i.e. two complete copies of the model, one per card, which is exactly why a 29.8 GB FP8 checkpoint could not be served there at any usable context. + ### Measured throughput (2026-09-16, deployed service, `temperature 0`) Same filler corpus for every shape, so these are shapes rather than a