Frank
f2575a1018
frank-secondary: 2×114688 ctx (112k per-slot), ubatch 1024
Lower per-slot context from 131,072 (128k) to 114,688 (112k) to free
~1 GiB of KV, which funds the ubatch 512 -> 1024 increase (prefill
throughput). The per-slot window is the product contract, so models.yml
contextWindow follows to 114,688.
- CTX_SIZE: 262144 -> 229376 (2 × 114,688)
- UBATCH_SIZE: 512 -> 1024
- Test 194: per-slot 131072 -> 114688
- KV budget test: 131072 -> 114688, ubatch 512 -> 1024
2026-10-06 16:38:58 -07:00
..
2026-09-16 14:59:23 -07:00
2026-10-05 18:18:21 -07:00
2026-08-28 11:18:41 -07:00
2026-09-16 07:46:23 -07:00
2026-10-02 07:50:50 -07:00
2026-08-28 02:20:06 -07:00
2026-09-16 07:46:23 -07:00
2026-09-26 19:45:28 -07:00
2026-09-21 19:55:00 -07:00
2026-08-13 20:19:41 -07:00
2026-09-21 12:46:02 -07:00
2026-10-06 15:37:13 -07:00
2026-10-06 15:37:13 -07:00
2026-09-16 07:43:33 -07:00
2026-10-05 18:04:02 -07:00
2026-08-13 20:19:41 -07:00
2026-10-06 15:37:13 -07:00
2026-10-06 15:37:13 -07:00
2026-10-06 16:38:58 -07:00
2026-09-04 12:54:28 -07:00
2026-08-22 15:49:44 -07:00
2026-09-16 19:28:34 -07:00
2026-09-21 14:12:38 -07:00
2026-09-21 13:20:15 -07:00
2026-10-06 15:37:13 -07:00
2026-08-25 20:13:33 -07:00
2026-09-21 15:02:14 -07:00
2026-08-22 15:49:44 -07:00
2026-09-03 16:15:43 -07:00
2026-09-12 10:09:12 -07:00
2026-08-25 15:38:57 -07:00
2026-10-06 15:37:13 -07:00
2026-09-24 20:39:28 -07:00
2026-08-26 20:08:30 -07:00
2026-08-13 20:19:41 -07:00
2026-09-16 06:59:44 -07:00
2026-09-26 23:25:55 -07:00
2026-08-19 00:00:42 -07:00
2026-09-01 14:40:10 -07:00