docs: halogen 400-zone note (compaction gap vs fit check); chore: gitignore third_party/ fork tree against peer stash sweeps

This commit is contained in:
Frank
2026-09-17 13:14:51 -07:00
parent d856cdd9cc
commit 49ddce9d00
2 changed files with 11 additions and 0 deletions
+1
View File
@@ -37,3 +37,4 @@ __pycache__/
# Editor/OS noise # Editor/OS noise
*.swp *.swp
.DS_Store .DS_Store
third_party/
@@ -340,6 +340,16 @@ deployment:
request is a 400 rather than a silent truncation. `max_tokens`, request is a 400 rather than a silent truncation. `max_tokens`,
`max_completion_tokens` and `max_output_tokens` all work and must agree if `max_completion_tokens` and `max_output_tokens` all work and must agree if
more than one is sent. more than one is sent.
- **A budget above (window − compaction-threshold) is a guaranteed 400 zone.**
The fit check (`prompt + max_tokens <= HALOGEN_CTX`) refuses, and the harness
only compacts at its own threshold — with OMP at 70 % of a 200,192 window
(140,134), any prompt in (136,192, 140,134] with a 64,000 budget overflows
the window while sitting below the compaction trigger. That collided live on
2026-09-17 (prompt 138,898 + 64,000 = 202,898 > 200,192). The fix is
harness-side: keep the declared `maxTokens` at or under
`window − threshold` (57,344 chosen) so no pre-compaction request can miss
the fit check. Do not fix it by raising `HALOGEN_CTX` past pool/2 — that
breaks the two-resident-conversations property.
- **`reasoning_effort`** is accepted at the top level and inside - **`reasoning_effort`** is accepted at the top level and inside
`chat_template_kwargs`: `minimal`, `low`, `medium`, `high`, `xhigh`. The `chat_template_kwargs`: `minimal`, `low`, `medium`, `high`, `xhigh`. The
model's default is `xhigh`. `minimal` aliases the template's `low` and still model's default is `xhigh`. `minimal` aliases the template's `low` and still