dankclaw: bench cycle 2 - MTP sidecar drafter
ngram-mod benchmark + parallel-safety test passed (A and B both survive the LCP-reuse launch that killed DFlash). Now benching MTP sidecar (a4lg/Qwen3.6-27B-MTP-ONLY-Q8_0.gguf, draft-mtp, n_max 3).
This commit is contained in:
@@ -14,7 +14,7 @@ PARALLEL=3
|
||||
# draft-mtp - MTP sidecar draft (a4lg/Qwen3.6-27B-MTP-ONLY-Q8_0.gguf)
|
||||
# ngram-mod - draftless ngram matching (no draft model, no shared ctx)
|
||||
# Benched 2026-08-14: see docs/frank-default-large-benchmark.md for the winner.
|
||||
SPEC_TYPE=ngram-mod
|
||||
SPEC_TYPE=draft-mtp
|
||||
# Draft model file (only used when SPEC_TYPE contains 'draft-').
|
||||
# DFlash: Qwen3.6-27B-DFlash-Q8_0.gguf ; MTP: Qwen3.6-27B-MTP-ONLY-Q8_0.gguf
|
||||
DRAFT_FILE=Qwen3.6-27B-MTP-ONLY-Q8_0.gguf
|
||||
|
||||
Reference in New Issue
Block a user