Frank
9c386d4f89
feat(qwen38): score the inherited corpus at the window the container really has
...
The reference rig declared a 32,768-token window while the boot ledger hands it
7,436, so 197 of the 198 inherited documents were too long to score. The engine
warns about the real pool; the flag was the only cited source.
Add scripts/rechunk-kld-corpus.py, which moves document boundaries without
moving tokens: each record is re-cut into windows of at most --max-doc-tokens
(7,168 = 7x1024, the largest whole kilopage under 7,436), and each window gets
its own score_from = len - --score-tail. The reference scores the same token
series at more positions and at a shorter context; the calibration corpus is
untouched, so no quant moves. Writes go through a temp file and the token
counts must match before the output is published.
The rig header now says what the pool actually is, and scripts/test-changed.sh
routes the new script to its own seam instead of the generic syntax fallback.
2026-10-28 00:26:28 -07:00
..
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-27 19:36:53 -07:00
2026-10-27 19:36:32 -07:00
2026-10-20 20:41:36 -07:00
2026-10-20 16:55:44 -07:00
2026-10-10 17:03:14 -07:00
2026-10-19 10:18:24 -07:00
2026-10-19 10:56:37 -07:00
2026-10-17 22:18:00 -07:00
2026-08-28 02:20:06 -07:00
2026-09-16 21:43:09 -07:00
2026-09-20 17:51:27 -07:00
2026-10-10 17:03:14 -07:00
2026-09-16 06:59:44 -07:00
2026-10-09 16:47:19 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-09-16 15:38:20 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-09-21 18:56:35 -07:00
2026-09-20 15:25:09 -07:00
2026-10-27 19:40:48 -07:00
2026-10-10 17:03:14 -07:00
2026-10-18 17:18:21 -07:00
2026-10-09 16:47:19 -07:00
2026-10-17 22:18:00 -07:00
2026-10-19 10:17:52 -07:00
2026-10-19 04:54:06 -07:00
2026-10-27 19:36:53 -07:00
2026-10-07 21:31:10 -07:00
2026-09-20 15:25:09 -07:00
2026-10-10 17:03:14 -07:00
2026-10-09 16:47:19 -07:00
2026-08-25 20:13:33 -07:00
2026-08-25 20:13:33 -07:00
2026-10-21 13:33:03 -07:00
2026-10-21 16:52:40 -07:00
2026-08-25 20:13:33 -07:00
2026-10-21 14:59:47 -07:00
2026-10-27 19:36:32 -07:00
2026-10-19 10:56:37 -07:00
2026-10-15 04:10:50 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-19 21:42:31 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-10 17:03:14 -07:00
2026-10-17 21:02:16 -07:00
2026-10-10 17:03:14 -07:00
2026-10-18 17:26:50 -07:00
2026-10-18 13:50:19 -07:00
2026-10-17 19:40:56 -07:00
2026-10-18 13:15:18 -07:00
2026-10-19 14:42:56 -07:00
2026-10-10 17:03:14 -07:00
2026-10-27 19:36:26 -07:00
2026-09-26 19:51:57 -07:00
2026-10-09 16:47:19 -07:00
2026-10-10 17:03:14 -07:00
2026-10-20 23:26:53 -07:00
2026-10-15 04:10:50 -07:00
2026-10-21 02:21:53 -07:00
2026-10-21 01:34:28 -07:00
2026-10-19 14:26:58 -07:00
2026-10-20 18:11:40 -07:00
2026-10-19 14:42:56 -07:00
2026-10-19 14:47:30 -07:00
2026-10-19 10:56:37 -07:00
2026-08-28 02:20:06 -07:00
2026-10-21 00:34:17 -07:00
2026-10-20 23:42:26 -07:00
2026-10-27 19:36:38 -07:00
2026-09-26 15:23:24 -07:00
2026-09-26 22:50:17 -07:00
2026-10-05 23:26:51 -07:00
2026-09-21 13:20:15 -07:00
2026-08-23 12:59:56 -07:00
2026-08-23 12:59:56 -07:00
2026-10-27 19:36:53 -07:00
2026-10-10 17:03:14 -07:00
2026-10-07 02:45:28 -07:00
2026-10-10 17:03:14 -07:00
2026-08-25 15:38:57 -07:00
2026-10-19 16:22:38 -07:00
2026-10-19 10:17:52 -07:00
2026-10-20 23:26:53 -07:00
2026-10-05 23:26:51 -07:00
2026-09-26 19:25:46 -07:00
2026-10-28 00:26:28 -07:00
2026-10-19 10:56:37 -07:00
2026-10-19 10:56:37 -07:00
2026-10-28 00:26:28 -07:00
2026-10-10 17:03:14 -07:00
2026-09-26 23:25:55 -07:00
2026-10-20 23:26:53 -07:00
2026-10-21 02:21:53 -07:00
2026-10-19 14:42:56 -07:00
2026-10-18 01:24:03 -07:00
2026-09-17 18:38:54 -07:00
2026-09-17 13:09:59 -07:00
2026-10-06 00:21:40 -07:00
2026-10-18 01:34:17 -07:00
2026-10-28 00:26:28 -07:00
2026-08-25 17:04:15 -07:00
2026-10-17 22:18:00 -07:00
2026-10-13 19:20:33 -07:00
2026-10-06 20:41:33 -07:00
2026-10-18 17:18:30 -07:00