agent: repoint FLM-NPU model roles off the retired provider; sync memory/skills

config.yml: vision -> llamacpp (dankclaw)/frank-large:auto,
tiny -> llamacpp (dankserver)/frank-small:off,
task -> llamacpp (dankclaw)/frank-large:medium (was flm dankclaw-npu),
matching the flm (dankclaw-npu) provider removal in models.yml.

Memories/managed skills: rollouts and learned notes from the frank-large
KV-pool + sampler work and the noctalia recolor; merged the duplicate
noctalia-palette-recolor skill into noctalia-custom-palette-recolor (adds
the dotfiles-tracking step and the +show-config delta gotcha) and dropped
the superseded legacy memory skills whose ghostty USR1 reload recipe is
wrong for this fleet.
This commit is contained in:
Frank committed 2026-09-13 23:51:43 -07:00
1 parent c32584e093
commit 872e86399a
56 files changed
+318 -178

No files matched your search

@@ -0,0 +1,17 @@
# frank-large Operations
Deployed as rootless Quadlet on dankclaw. ~68 GiB weights + 14.4 GiB KV pool (524k positions, 3 slots). Total ~103.4 GiB.
## Ports
- Engine: :8730 (loopback)
- Front-end: :8731
- Published: :7770
## Logging & Env
- `podman logs frank-large` / `journalctl --user -u frank-large`
- Avoid `TEMP`, `HOST`, `GPU_MAX_HEAP_SIZE` (HIP bare TEMP)
## Sampling & API
- Large: greedy | Small: sampling (temp=1.0, top_k=20, top_p=0.95)
- Small determinism: `temperature: 0` or `--sampling-defaults none`
- `preserve_thinking`: client-side per-request (`chat_template_kwargs`)
- `max_tokens: 200` w/ empty content = thinking consumed budget
- File-cache shortage → uninterruptible sleep. `host_reserve_gib=24` protects n-gram table.
## Tests
- 285/286 pass (test 73 comfyui bug). `pyyaml` missing on system py3; `uv` available.
@@ -0,0 +1,5 @@
{
"model": "frank-small",
"temperature": 0,
"chat_template_kwargs": {"preserve_thinking": true}
}
@@ -0,0 +1,6 @@
#!/bin/bash
# Verify KV pool slots and memory stability
docker inspect frank-large --format '{{.Config.Env}}'
podman logs frank-large 2>&1 | grep -E '^(dmalloc|kv pool):'
echo "Slots: HALOGEN_KV_SLOTS"
echo "Memory: ~103.4 GiB (68W + 14.4KV + 21W)"
@@ -0,0 +1,6 @@
[Service]
ExecStart=/usr/bin/podman run ...
Environment=TEMP=...
Environment=HALOGEN_KV_SLOTS=3
[Install]
WantedBy=default.target