config.yml: vision -> llamacpp (dankclaw)/frank-large:auto, tiny -> llamacpp (dankserver)/frank-small:off, task -> llamacpp (dankclaw)/frank-large:medium (was flm dankclaw-npu), matching the flm (dankclaw-npu) provider removal in models.yml. Memories/managed skills: rollouts and learned notes from the frank-large KV-pool + sampler work and the noctalia recolor; merged the duplicate noctalia-palette-recolor skill into noctalia-custom-palette-recolor (adds the dotfiles-tracking step and the +show-config delta gotcha) and dropped the superseded legacy memory skills whose ghostty USR1 reload recipe is wrong for this fleet.
841 B
841 B
frank-large Operations
Deployed as rootless Quadlet on dankclaw. ~68 GiB weights + 14.4 GiB KV pool (524k positions, 3 slots). Total ~103.4 GiB.
Ports
- Engine: :8730 (loopback)
- Front-end: :8731
- Published: :7770
Logging & Env
podman logs frank-large/journalctl --user -u frank-large- Avoid
TEMP,HOST,GPU_MAX_HEAP_SIZE(HIP bare TEMP)
Sampling & API
- Large: greedy | Small: sampling (temp=1.0, top_k=20, top_p=0.95)
- Small determinism:
temperature: 0or--sampling-defaults none preserve_thinking: client-side per-request (chat_template_kwargs)max_tokens: 200w/ empty content = thinking consumed budget- File-cache shortage → uninterruptible sleep.
host_reserve_gib=24protects n-gram table.
Tests
- 285/286 pass (test 73 comfyui bug).
pyyamlmissing on system py3;uvavailable.