frank-large: serve the abliterated Swift-1.5 UD-Q8_K_XL
The target moves from unsloth/Qwen3.8-27B-GGUF:UD-Q8_K_XL to ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF's UD-Q8_K_XL — an abliterated fine-tune of the same base, under the non-OSI SWIFT OPEN LICENCE 1.0. Port, alias, context, drafter and client contract are unchanged. Compatibility was settled from the GGUF headers before fetching anything: both files parse to the same architecture (qwen35), the same 866 tensors with identical names in identical order, zero per-tensor ggml_type or dim mismatches, and the same MTP head. Two metadata differences that look alarming are no-ops, confirmed against gufo's source — general.file_type is deliberately not consulted (the file gufo already served records Q4_K_M while containing no Q4_K tensor), and Swift's extra qwen35.attention.recurrent_layers key is never read; layer kinds come from full_attention_interval, which both files carry as 4 and which agrees. The load test agreed: 9.2 s to listening, 66.5 GiB of the 116.7 GiB iGPU, no loader warnings, and a green contract battery including a two-turn tool loop. The DFlash2 drafter did not move, so the payload is now two files in two directories: DRAFTER_DIR is its own tunable. That broke the deployer's stray-run sweep, which keyed on the target filename and would have stopped matching — a stray run would then have held 7770 past the port gate. It now keys on the drafter, which every frank-large command line carries. The fetch script sends no auth header: the repo is public, and a token on the curl command line is world-readable via /proc/<pid>/cmdline. The anonymous transfer ran at 1.8 MiB/s; the host token through a mode-600 curl -K config reached 7 MiB/s. Test seam: the mutation pass found four real gaps. Two fetch assertions were satisfied by a header comment rather than the URL assignment, so repointing a repository left them green, and nothing bound the env's MODEL_FILE/DRAFTER_FILE to the filenames the fetch scripts download. Both are now explicit. A harness bug worth recording: a bats --filter that matches no test reports zero "not ok", indistinguishable from a mutation that survived — the harness now checks the 1..N count. 16/16 caught.
This commit is contained in:
@@ -76,9 +76,11 @@
|
||||
- **frank-large runtime swapped to gufo** (production change, Dankclaw).
|
||||
Frank asked for `github.com/gufo-org/gufo` — a vertical inference engine
|
||||
built for exactly this hardware (Ryzen AI MAX+ 395 / Radeon 8060S,
|
||||
`gfx1151`) — in place of the stock llama.cpp prebuilt. Payload, port 7770,
|
||||
alias `frank-large`, one 262,144-token session and the client contract are
|
||||
all unchanged; only the engine is new.
|
||||
`gfx1151`) — in place of the stock llama.cpp prebuilt. Port 7770, alias
|
||||
`frank-large`, one 262,144-token session and the client contract were all
|
||||
unchanged; only the engine was new, and the payload was the unsloth
|
||||
Qwen3.8-27B UD-Q8_K_XL **at that point** — it was swapped for the
|
||||
abliterated Swift-1.5 later the same day, see the entry above.
|
||||
- **The runtime is built from source on the host.** gufo ships no prebuilt
|
||||
Linux binary (the v0.1.0/v0.1.1 release assets are empty) and the host
|
||||
has no Nix. Pinned at `v0.1.1` / `b0f8673`, installed to
|
||||
|
||||
Reference in New Issue
Block a user