 Frank
|
139686043b
|
ling B-test: spec off (--spec-type none), keep parallel=2 - isolate spec path as freeze trigger
|
2026-08-14 03:39:15 -07:00 |
|
|
Frank
|
7ba86812f7
|
ling A/B: verbosity 4->0, drop log file to isolate hang trigger (match known-good run)
|
2026-08-14 02:32:08 -07:00 |
|
|
Frank
|
6a6d673dca
|
ling A/B: revert batch 8192->3072 to isolate mid-stream freeze (suspect batch)
|
2026-08-14 02:20:52 -07:00 |
|
|
Frank
|
a5444e2c4d
|
ling: batch 8192 (ubatch 3072); add -lv verbosity + log file for stop-investigation
|
2026-08-14 02:12:35 -07:00 |
|
|
Frank
|
321f946660
|
ling: ubatch 512 -> 3072 (batch 3072) - using heap headroom, watch for OOM
|
2026-08-14 01:46:36 -07:00 |
|
|
Frank
|
a5b12e1062
|
ling: keep draft-mtp,ngram-mod active (A/B wash vs MTP alone, parallel-safe)
|
2026-08-14 01:45:22 -07:00 |
|
|
Frank
|
6647690ebd
|
ling A/B: bench draft-mtp alone vs draft-mtp,ngram-mod
|
2026-08-14 01:43:53 -07:00 |
|
|
Frank
|
3204b4b29e
|
ling trial: layer ngram-mod under draft-mtp; add ngram args to serve script
|
2026-08-14 01:40:46 -07:00 |
|
|
Frank
|
923e775354
|
dankclaw: Ling-3.0-flash Q6_K trial config (Vulkan+GTT+draft-mtp)
Trial replaces frank-default-large temporarily via frank-large-ling.service
(port 7770, same alias). Requires the aetherbird bailingmoe3-support llama.cpp
fork at /home/dank/llama.cpp-ling (stock llama.cpp cannot load bailingmoe3).
Memory: 8x16GB LPDDR5 = 128GB physical; Vulkan exposes ~111.2GiB heap (UMA
96GiB + GTT) vs ROCm's 96GiB. Q6_K = 98.26GiB; MLA/KDA KV is tiny so 256k
ctx x 2 slots fits with ~10GiB headroom. Verified: loads ~45s, concurrent
streams both complete (no DFlash-style kill), ~7.7 t/s gen.
Restore Qwen: systemctl stop frank-large-ling; systemctl start
frank-default-large.
|
2026-08-14 01:20:30 -07:00 |
|