frank-large: record deployed boot facts (pool 819,332 tokens, 3.13x, 230 s)
Live battery green after deploy #3: alias, reasoning split into `reasoning`, tool_calls, /metrics acceptance pos0 69% pos1 44% - the cross-model MTP head performs as measured in the bench window.
This commit is contained in:
1 parent
780c307354
commit
3c339eeba2
2 files changed
+10
-2
No files matched your search
@@ -155,8 +155,13 @@ chase text drift between spec and no-spec arms as a regression.
|
||||
frank-primary lesson).
|
||||
- Bench windows: `systemctl stop frank-large` is enough (mask fails on the
|
||||
relinked unit; the deploy restores).
|
||||
- First-deploy fact to record here: the boot-time KV pool line
|
||||
(`Maximum concurrency for 262,144 tokens per prompt: N.Nx`).
|
||||
- First-deploy facts (2026-10-01, deploy #3): healthy after **230 s**;
|
||||
boot log `GPU KV cache size: 819,332 tokens, Maximum concurrency for
|
||||
262,144 tokens per request: 3.13x` — four sessions share the pool
|
||||
(the scheduler, not a carve). Live battery green: alias `frank-large`,
|
||||
reasoning split into `reasoning`, tool_calls with correct args, and
|
||||
`/metrics` acceptance pos0 69% pos1 44% (54/86 draft tokens accepted),
|
||||
matching the bench window.
|
||||
|
||||
## Rollback
|
||||
|
||||
|
||||
Reference in new issue
Block a user