docs: record FreeToken compressed-tensors FP8 loader failures; Huihui restored
Ornith per-channel aborts in expert-source resolution (nonstandard tensor naming); HauhauCS block-fp8 128x128 aborts in _dequant_fp8_weight (shape mismatch). modelopt block-fp8 is the only FP8 path. Log entry + runbook quant matrix updated; dead downloads staged to host trash.
This commit is contained in:
1 parent
949f68e2b5
commit
fe34f04454
2 files changed
+48
-1
No files matched your search
@@ -11,6 +11,36 @@ timestamp: 2026-09-14
|
||||
|
||||
# Bundle Change Log
|
||||
|
||||
## 2026-09-01 — frank-default-small: two compressed-tensors FP8 swaps fail to load; Huihui restored
|
||||
- `/scripts/frank-default-small.env`, `/scripts/serve-frank-small.sh`,
|
||||
`/scripts/frank-default-small.service` (`af6cd72` → `34ab6b4` → reverted
|
||||
in `4d5bea4`) — attempted model swaps on FreeToken v0.1.2, both
|
||||
live-verified as loader failures and reverted the same day to the Huihui
|
||||
FP8 checkpoint:
|
||||
- `ornith-ai/Ornith-1.5-35B-A3B-FP8` (compressed-tensors per-channel):
|
||||
`ValueError: Missing MoE expert source layers: {'gate_up': ...}` — the
|
||||
checkpoint's expert tensors do not follow the
|
||||
`mlp.experts.{N}.gate_proj/up_proj/down_proj` naming the MoE provider
|
||||
scans for.
|
||||
- `lamianlbe/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-fp8`
|
||||
(compressed-tensors block-fp8 128×128, standard naming): experts
|
||||
resolve but `_dequant_fp8_weight` multiplies `weight × weight_scale`
|
||||
directly — block scales do not broadcast →
|
||||
`RuntimeError: The size of tensor a (2048) must match ...`.
|
||||
- Both failed cleanly at load (37 GB fits RAM — no swap-thrash, no
|
||||
outage); service was back on Huihui within the hour and re-verified with
|
||||
a real completion (reasoning parses; `17*23 → 391`, natural stop).
|
||||
- `/serverAppConfigs-docs/LLM/freetoken-frank-default-small.md` — quant
|
||||
matrix updated: modelopt block-fp8 is the ONLY FP8 path that loads; both
|
||||
compressed-tensors shapes documented with their exact errors.
|
||||
- **Deploy health-check trap (second occurrence)**: `deploy.sh` reported
|
||||
"healthy after approximately 6s" for BOTH failed loads — the health gate
|
||||
passes while the doomed worker is still starting. A model swap is only
|
||||
proven by the journal (Uvicorn startup) + a real completion.
|
||||
- Staged for trash (awaiting purge approval): `/home/dank/models/ornith-1.5-35b-a3b-fp8`
|
||||
(37 GB) and `/home/dank/models/hauhaucs-qwen36-35b-a3b-aggressive-fp8`
|
||||
(35 GB).
|
||||
|
||||
## 2026-09-01 — dankserver media stack standardized to quadlet; dankclaw data roots migrated
|
||||
- **Incident context**: Dankserver hard-crashed and rebooted 2026-09-01; every
|
||||
bare compose-era media container (RomM trio, Jellyfin, Calibre-Web,
|
||||
|
||||
Reference in new issue
Block a user