llm: retire the trio service names — fleet services renamed to frank-archon/frank-dragoon/frank-zealot
The 2026-10-09 wire aliases become the service names everywhere: systemd units, serve scripts, env files and FRANK_* variables, deploy-plan/deploy-remote service keys, container names, Prometheus job names + alert rules, Grafana dashboard queries, bats seams, runbook filenames, homepage/AGENTS lore, and historical prose. Rollback tags renamed in lockstep. Residue in the tree: zero. Retired frank-medium/small/npu names are history and stay. Known casualty: scripts/patches/*.patch context lines were rewritten; those retired-era vLLM-fork patches no longer apply byte-exact.
This commit is contained in:
1 parent
5ced474eb9
commit
55f87fcdce
195 files changed
+2085
-2064
No files matched your search
@@ -1,27 +1,27 @@
|
||||
---
|
||||
type: configuration
|
||||
title: FreeToken frank-secondary Runbook
|
||||
description: RETIRED 2026-09-15 - FreeToken v0.1.2 serving batsclamp/Huihui-Qwen3.6-35B-A3B-abliterated-FP8 as frank-secondary on Dankserver (RTX 3090 era).
|
||||
title: FreeToken frank-zealot Runbook
|
||||
description: RETIRED 2026-09-15 - FreeToken v0.1.2 serving batsclamp/Huihui-Qwen3.6-35B-A3B-abliterated-FP8 as frank-zealot on Dankserver (RTX 3090 era).
|
||||
tags:
|
||||
- freetoken
|
||||
- dankserver
|
||||
- frank-secondary
|
||||
- frank-zealot
|
||||
- qwen3.6
|
||||
- moe
|
||||
- fp8
|
||||
timestamp: 2026-08-30
|
||||
---
|
||||
|
||||
# FreeToken frank-secondary Runbook
|
||||
# FreeToken frank-zealot Runbook
|
||||
|
||||
> **RETIRED 2026-09-15.** The RTX 3090 left Dankserver and the successor
|
||||
> [[frank-medium-rocmfpx]] (charlie12345/ROCmFPX llama.cpp on 2x Radeon AI
|
||||
> PRO R9700) took the :7770 endpoint and the port. This page is kept as the
|
||||
> retirement record of the FreeToken/CUDA era; the unit was archived to
|
||||
> `~/.AGENTTRASH/20260915-frank-secondary-retire/host-units/` and the repo files
|
||||
> `~/.AGENTTRASH/20260915-frank-zealot-retire/host-units/` and the repo files
|
||||
> to `scripts/.AGENTTRASH/`.
|
||||
|
||||
The `frank-secondary` service on Dankserver is served by
|
||||
The `frank-zealot` service on Dankserver is served by
|
||||
**FreeToken v0.1.2** — an edge-native MoE serving engine that keeps
|
||||
expert weights in host RAM with an LRU GPU cache. Model history on this
|
||||
runtime: official `Qwen/Qwen3.6-35B-A3B-FP8` (since 2026-09-02) →
|
||||
@@ -134,8 +134,8 @@ modelopt block-fp8 remains the only FP8 path that loads.
|
||||
|
||||
## Sampling
|
||||
|
||||
**frank-secondary samples by default, and our config never said so.**
|
||||
`scripts/serve-frank-secondary.sh` passes no sampling arguments at all — only
|
||||
**frank-zealot samples by default, and our config never said so.**
|
||||
`scripts/serve-frank-zealot.sh` passes no sampling arguments at all — only
|
||||
`--model`, `--served-model-name`, `--host`, `--port`, `--moe-cache-size`,
|
||||
`--num-tokens` and `--max-running-requests`. The behaviour comes from the
|
||||
runtime's own default:
|
||||
@@ -158,9 +158,9 @@ sampling parameters sent at all** produced three different reasoning traces
|
||||
(sha `13ca02…`/487 chars, `d49928…`/540, `7b81b8…`/577). Greedy decoding
|
||||
would be byte-identical.
|
||||
|
||||
### This is the opposite of frank-large
|
||||
### This is the opposite of frank-dragoon
|
||||
|
||||
| | frank-secondary (FreeToken) | frank-large (halogen) |
|
||||
| | frank-zealot (FreeToken) | frank-dragoon (halogen) |
|
||||
|---|---|---|
|
||||
| Silent client (no `temperature`) | **samples** at temp 1.0 / top_k 20 / top_p 0.95 | **greedy** — no server-side sampler defaults |
|
||||
| Deterministic across runs | No | Yes |
|
||||
@@ -168,7 +168,7 @@ would be byte-identical.
|
||||
|
||||
A client that talks to both endpoints and sends no sampler gets
|
||||
non-deterministic answers from :7770 on Dankserver and reproducible ones from
|
||||
:7770 on Dankclaw. If a workflow needs determinism from frank-secondary it must
|
||||
:7770 on Dankclaw. If a workflow needs determinism from frank-zealot it must
|
||||
send `temperature: 0` explicitly, or the service must be relaunched with
|
||||
`--sampling-defaults none` (framework defaults only).
|
||||
|
||||
@@ -188,9 +188,9 @@ send `temperature: 0` explicitly, or the service must be relaunched with
|
||||
|
||||
| File | Purpose |
|
||||
|------|---------|
|
||||
| `scripts/serve-frank-secondary.sh` | Serve script (launches `ft serve`) |
|
||||
| `scripts/frank-secondary.env` | Tunables (model path, pool sizes) |
|
||||
| `scripts/frank-secondary.service` | Systemd unit |
|
||||
| `scripts/serve-frank-zealot.sh` | Serve script (launches `ft serve`) |
|
||||
| `scripts/frank-zealot.env` | Tunables (model path, pool sizes) |
|
||||
| `scripts/frank-zealot.service` | Systemd unit |
|
||||
|
||||
## Limitations
|
||||
|
||||
@@ -209,7 +209,7 @@ send `temperature: 0` explicitly, or the service must be relaunched with
|
||||
- **`model` field is required** in `/v1/chat/completions` bodies —
|
||||
FreeToken rejects requests without it with a 422 (`Field required`),
|
||||
unlike llama.cpp's server which defaults to the loaded model. Send
|
||||
`"model": "frank-secondary"`.
|
||||
`"model": "frank-zealot"`.
|
||||
- Load on this swap took well under the old llama.cpp numbers:
|
||||
weights → experts (parallel build) → CUDA graph capture → Uvicorn
|
||||
in ~2 minutes; the 2026-08-30 swap verified ~40 tok/s decode on a
|
||||
|
||||
Reference in new issue
Block a user