Frank
215d74f6ce
feat: swap both LLM services + remove config-assertion tests
Dankserver (frank-default-small):
- Stock llama.cpp (latest master, CUDA build) replaces ik_llama.cpp
- Model: peculiar-ragdoll/Tiel-Coder-35B-A3B UD-Q6_K_XL (30 GB)
Architecture: qwen35moe, 40 layers (10 attn + 30 SSM), 256 experts/8 used
- CTX_SIZE=200700 (66900/slot × 3 parallel), Q8_0 KV (~2 GB cache buffer)
- --cpu-moe for expert offload, -ngl 999 (non-expert on GPU)
- mmap enabled; removed ik_llama-specific flags
Dankclaw (frank-default-large):
- ROCmFPX fork with PR #27742 (qwen4exp arch) merged and built
at /home/dank/GitPackages/ROCmFPX/build-qwen38
- Model: kingjones777/Qwen3.8-Flash-Next-ROCmFP4-STRIX_LEAN (98.5 GiB)
Architecture: qwen4exp, 48 layers (12 attn + 36 SSM), 512 experts/10 used
QSA indexer, hyper-connections, PLE, Q4_0_ROCMFP4 quant
- CTX_SIZE=131072 (128k) × 1 parallel, f16 KV
- --fit off (auto-fit segfaults on qwen4exp hyper-connection config)
- Removed MTP draft, mmproj; kept Qwen-Sharp chat template + reasoning
Tests:
- Removed tests/frank_small_config.bats and tests/frank_large_config.bats
(moved to .AGENTTRASH/). These were config-assertion tests that checked
'is variable X set to Y' rather than testing the serve script's actual
behavior. All 199 remaining tests pass.
- Updated test-changed.sh mappings and changed_tests.bats to reflect the
removal.
2026-08-26 20:37:46 -07:00
..
2026-08-24 23:48:27 -07:00
2026-08-26 19:52:57 -07:00
2026-08-26 19:52:57 -07:00
2026-08-26 20:37:46 -07:00
2026-08-19 15:50:28 -07:00
2026-08-13 20:19:41 -07:00
2026-08-26 19:52:57 -07:00
2026-08-25 22:02:14 -07:00
2026-08-13 20:19:41 -07:00
2026-08-13 20:19:41 -07:00
2026-08-22 15:49:44 -07:00
2026-08-26 08:25:40 -07:00
2026-08-24 23:48:27 -07:00
2026-08-23 16:49:33 -07:00
2026-08-23 12:11:21 -07:00
2026-08-25 20:13:33 -07:00
2026-08-23 16:49:33 -07:00
2026-08-22 15:49:44 -07:00
2026-08-23 12:59:56 -07:00
2026-08-25 15:38:57 -07:00
2026-08-22 22:11:53 -07:00
2026-08-26 19:52:57 -07:00
2026-08-13 20:19:41 -07:00
2026-08-13 20:19:41 -07:00
2026-08-25 20:13:33 -07:00
2026-08-19 00:00:42 -07:00