dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

docs: blank line before the throughput heading

Browse Source
This commit is contained in:
Frank committed 2026-09-16 15:52:45 -07:00
1 parent ff52543d8a
commit 9a83dae73a
1 file changed
+1
Download Patch File Download Diff File Expand all files Collapse all files
serverAppConfigs-docs/LLM/frank-medium-llamacpp-dflash2.md
+1
View File
@@ -186,6 +186,7 @@ Deployed flags:
replaced: two vLLM replicas, i.e. two complete copies of the model, one per replaced: two vLLM replicas, i.e. two complete copies of the model, one per
card, which is exactly why a 29.8 GB FP8 checkpoint could not be served there card, which is exactly why a 29.8 GB FP8 checkpoint could not be served there
at any usable context. at any usable context.
### Measured throughput (2026-09-16, deployed service, `temperature 0`) ### Measured throughput (2026-09-16, deployed service, `temperature 0`)
Same filler corpus for every shape, so these are shapes rather than a Same filler corpus for every shape, so these are shapes rather than a