fix(frank-large): load the model as its native 3-way split, not a concatenated file

The first cutover crash-looped the unit with 'invalid split file name':
the fetch script concatenated the three split parts into a single GGUF,
but part 1's header carries ggml.file_count=3, so the byte-correct
concatenation still advertises itself as a split and the loader demands
a -NNNNN-of-NNNNN filename.

- serve-frank-large.sh: -m points at part 1; llama.cpp loads the split
  natively (parts 2-3 auto-discovered in the same directory)
- deploy-remote.sh: LLM_LARGE_MODEL gate path follows
- download-frank-large-unsloth.sh: assembly removed; the parts ARE the
  canonical payload, verified against live Hub LFS oids
- docs: runbook model section + troubleshooting note, AGENTS.md, log
- the redundant 87 GiB assembled file is staged on dankclaw at
  ~/.AGENTTRASH/20260921-frank-large-assembled/
This commit is contained in:
Frank committed 2026-09-21 13:58:54 -07:00
1 parent 384747a72f
commit d6f9b8539a
11 files changed
+72 -36

No files matched your search

+8 -2
View File
@@ -51,10 +51,16 @@ if [[ ! -x "$SERVER_BIN" ]]; then
exit 1
fi
MODEL_FILE="$MODEL_DIR/Qwen3.8-Flash-Next-UD-IQ4_XS.gguf"
# Point -m at the FIRST split part, not a concatenated file: the parts
# carry ggml.file_count=3 metadata in part 1's header, so even a
# byte-correct concatenation still advertises itself as a 3-way split and
# the loader rejects a non-split filename ("invalid split file name").
# With -m on part 1, llama.cpp loads the 3-way split natively (parts 2-3
# are auto-discovered in the same directory).
MODEL_FILE="$MODEL_DIR/UD-IQ4_XS/Qwen3.8-Flash-Next-UD-IQ4_XS-00001-of-00003.gguf"
if [[ ! -r "$MODEL_FILE" ]]; then
echo "missing target model: $MODEL_FILE" >&2
echo "fetch and assemble it: bash $SCRIPT_DIR/download-frank-large-unsloth.sh" >&2
echo "fetch it: bash $SCRIPT_DIR/download-frank-large-unsloth.sh" >&2
exit 1
fi