docs: halogen 400-zone note (compaction gap vs fit check); chore: gitignore third_party/ fork tree against peer stash sweeps
This commit is contained in:
@@ -37,3 +37,4 @@ __pycache__/
|
|||||||
# Editor/OS noise
|
# Editor/OS noise
|
||||||
*.swp
|
*.swp
|
||||||
.DS_Store
|
.DS_Store
|
||||||
|
third_party/
|
||||||
|
|||||||
@@ -340,6 +340,16 @@ deployment:
|
|||||||
request is a 400 rather than a silent truncation. `max_tokens`,
|
request is a 400 rather than a silent truncation. `max_tokens`,
|
||||||
`max_completion_tokens` and `max_output_tokens` all work and must agree if
|
`max_completion_tokens` and `max_output_tokens` all work and must agree if
|
||||||
more than one is sent.
|
more than one is sent.
|
||||||
|
- **A budget above (window − compaction-threshold) is a guaranteed 400 zone.**
|
||||||
|
The fit check (`prompt + max_tokens <= HALOGEN_CTX`) refuses, and the harness
|
||||||
|
only compacts at its own threshold — with OMP at 70 % of a 200,192 window
|
||||||
|
(140,134), any prompt in (136,192, 140,134] with a 64,000 budget overflows
|
||||||
|
the window while sitting below the compaction trigger. That collided live on
|
||||||
|
2026-09-17 (prompt 138,898 + 64,000 = 202,898 > 200,192). The fix is
|
||||||
|
harness-side: keep the declared `maxTokens` at or under
|
||||||
|
`window − threshold` (57,344 chosen) so no pre-compaction request can miss
|
||||||
|
the fit check. Do not fix it by raising `HALOGEN_CTX` past pool/2 — that
|
||||||
|
breaks the two-resident-conversations property.
|
||||||
- **`reasoning_effort`** is accepted at the top level and inside
|
- **`reasoning_effort`** is accepted at the top level and inside
|
||||||
`chat_template_kwargs`: `minimal`, `low`, `medium`, `high`, `xhigh`. The
|
`chat_template_kwargs`: `minimal`, `low`, `medium`, `high`, `xhigh`. The
|
||||||
model's default is `xhigh`. `minimal` aliases the template's `low` and still
|
model's default is `xhigh`. `minimal` aliases the template's `low` and still
|
||||||
|
|||||||
Reference in New Issue
Block a user