Files
serverAppConfigs/scripts
Frank 53ada02a63 frank-default-large: PARALLEL=1, CTX 262144, split 0.50 (max 3090 weight)
Single full-context slot instead of two half-context slots. The 3090 takes
~33 of 66 layers (up from 26): the VRAM budget frees up because the f16 KV
pool shrinks 401400 -> 262144. 33 layers is the max with a safety margin
(34 -> 244 MiB headroom, 35 -> OOM). Verified math: /tmp/vram-math.py from
live journal buffers.
2026-08-16 23:53:09 -07:00
..