comments: replace law idiom with the mechanism it encoded
Every comment that cited a named law, an incident date, or an internal nickname now states the underlying mechanism and why it matters, generically: curl exit-0 artifacts and byte-count gates, argv-in-/proc secret exposure, tag mutability vs digest pinning, shape-specialized kernels refusing uncompiled slot counts, MTP heads as file tensors no flag can supply, drafter/slot coupling as an engine property, pkill -f matching its invoker, pinned-RAM pairing with LimitMEMLOCK, one-encoding-per-table, the short-run first-token noise floor, and the protected-expert rule. No behavior change: comment/string text only; suite green (371 tests).
This commit is contained in:
1 parent
cf6319aad7
commit
2e86445fc5
19 files changed
+74
-59
No files matched your search
@@ -14,7 +14,7 @@
|
||||
# half of RAM), the served window is what models.yml must
|
||||
# quote, the host-networking contract (no --publish), the image gate on a
|
||||
# name@sha256 ref, the .rad payload gate with its size floor, the
|
||||
# chat-template override mount, the self-healing law (the run returns before
|
||||
# chat-template override mount, the self-healing requirement (the run returns before
|
||||
# the engine is up, so the serve script must wait on the container for
|
||||
# Restart=always to mean anything), the deployer's false-green MainPID check,
|
||||
# the vendored hfget fetch path (no token for this ungated repo), and the
|
||||
@@ -136,10 +136,11 @@ nosudo_bin() {
|
||||
# Concurrency: 3 slots x the served window is the capacity contract, and
|
||||
# the fused TP all-reduce is declared over seqs x (1 + spec) = 9 rows,
|
||||
# under the 25-row bound at which the wht6 wire stays bit-exact. The
|
||||
# "seqs 2 cannot boot" law belongs to the retired tcclaviger vLLM fork
|
||||
# (torch.compile query_start_loc constraint, 2026-10-02); radiance booted
|
||||
# seqs 2 in the fp8-native era and the 2026-10-06 sweep had seqs 2 and 3
|
||||
# tied inside the +-3% noise floor — slots buy concurrency, not speed.
|
||||
# "seqs 2 cannot boot" is the failure mode of a runtime that compiles
|
||||
# kernels specialized to the batch shape — it refuses a slot count it has
|
||||
# never compiled for. This engine is shape-agnostic: seqs 2 boots, and
|
||||
# measured decode ties seqs 2 and 3 inside the +-3% noise floor — slots
|
||||
# buy concurrency, not speed.
|
||||
grep -q '^FRANK_ARCHON_MAX_SEQS=3$' "$ENV_FILE"
|
||||
grep -q '^FRANK_ARCHON_TP=2$' "$ENV_FILE"
|
||||
grep -q '^FRANK_ARCHON_TP_WIRE=wht6$' "$ENV_FILE"
|
||||
@@ -147,8 +148,8 @@ nosudo_bin() {
|
||||
# expert_tiered placement: vram_weights + the pinned host pool serve the
|
||||
# per-rank resident set TOGETHER, so cutting the VRAM slab to pay for the
|
||||
# KV pool moves the pool with it. KV is QUANTIZED fp8 (the engine takes
|
||||
# only bf16|fp8 — no per-tensor K/V split), the PLE n-gram table is pinned
|
||||
# in host RAM per Frank's law.
|
||||
# only bf16|fp8 — no per-tensor K/V split), and the PLE n-gram table is
|
||||
# pinned in host RAM so the cards read it without page-faulting mid-token.
|
||||
grep -q '^FRANK_ARCHON_PLACEMENT=expert_tiered$' "$ENV_FILE"
|
||||
grep -q '^FRANK_ARCHON_HOST_POOL_MIB=44928$' "$ENV_FILE"
|
||||
grep -q '^FRANK_ARCHON_VRAM_WEIGHTS_MIB=[1-9]' "$ENV_FILE"
|
||||
|
||||
Reference in new issue
Block a user