frank-small: Swift-1.5-27B Uncensored RCO-IQ3_XXS with MTP back on (two 131072 slots, ubatch 512, q8_0 KV, publisher's BF16 mmproj)

This commit is contained in:
Frank committed 2026-10-06 01:10:43 -07:00
1 parent 713b126639
commit da36fa32cf
6 files changed
+151 -168

No files matched your search

+23 -27
View File
@@ -1,31 +1,27 @@
#!/usr/bin/env bash
# Download the frank-small payload for llama.cpp on the RTX 3090:
# ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF:IQ3_S **with the MTP head in the
# file** (the -mtp variant), plus a vision projector. No Swift repo ships a
# projector — ukisai's release is language-model-only ("A Swift 27B vision
# projector has not been verified for this release") — so this script fetches
# unsloth's mmproj-F16.gguf built from the shared base Qwen/Qwen3.8-27B.
# That substitution is proven, not assumed: on 2026-10-05 Swift-1.5's vision
# stack was hash-compared against the base over HTTP range reads — 333/333
# visual tensor names and 6/6 sampled tensors byte-identical (merger fc1/fc2,
# blocks 0/13/26) — so the base-model projector IS the model's own projector.
# Public repos — no auth header, and never a token on the command line (it is
# ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF:RCO-IQ3_XXS
# **with the MTP head in the file** (the -mtp variant), plus the
# PUBLISHER's OWN vision projector (mmproj-BF16.gguf, same repo). Public
# repo — no auth header, and never a token on the command line (it is
# world-readable in /proc/<pid>/cmdline).
#
# Fresh downloads, no resume (`curl -C -` once produced a 213 MB oversized file
# on a 31 GiB payload); -f/--fail-with-body so an HTTP error is not a success,
# then byte count and the Hub LFS sha256. Idempotent: complete files are
# skipped. The projector is stored under a self-documenting dest name; the
# URL name and sha stay pinned in the table below.
# Fresh downloads, no resume (`curl -C -` once produced a 213 MB oversized
# file on a 31 GiB payload); -f/--fail-with-body so an HTTP error is not a
# success, then byte count and sha256. This repo is on Xet storage, so
# the Hub tree/blob APIs expose no LFS oid: the sha256 values below were
# computed locally after the first verified fetch (byte counts match the
# Hub's declared sizes). Idempotent: complete files are skipped. The
# projector is stored under a self-documenting dest name; the URL name
# and sha stay pinned in the table below.
#
# 2026-10-05 (Frank, evening): the payload moved to Swift-1.5-27B GSQ-RCO
# IQ3_S-mtp — a 27B on the 24 GiB card: ONE 131,072-token slot, q8_0 K + q8_0
# V, the in-file MTP head drafting 3. This supersedes the Ornith-1.5-9B Q8_0
# swap (commits 77decb5..380aafa, same day), which was committed but never
# deployed — the live service was still MiMo-V2.6 Q6_K when Swift cut over.
# Rollback payloads stay on disk: /home/dank/models/Ornith-Q8/ and
# /home/dank/models/MiMo-Q6K/ (the payload that was live until this swap).
# Their re-fetch recipes are in git history (predecessors of this script).
# 2026-10-06 (Frank, evening): the payload moved to the UNCELERSED
# Swift-1.5-Qwen3.8-27B at RCO-IQ3_XXS (1.56 GiB lighter than the
# IQ3_S-mtp it replaced; the lighter quant funds the MTP draft ctx plus
# the second 131,072 slot). Rollback payload stays on disk:
# /home/dank/models/Swift15-IQ3S/ (the IQ3_S-mtp that was live until this
# swap); earlier payloads Ornith-Q8/ and MiMo-Q6K/ as well. Their
# re-fetch recipes are in git history (predecessors of this script).
#
# Usage:
# scripts/download-frank-small.sh [DEST_DIR] [--verify-only]
@@ -39,12 +35,12 @@ for arg in "$@"; do
*) DEST="$arg" ;;
esac
done
DEST="${DEST:-/home/dank/models/Swift15-IQ3S}"
DEST="${DEST:-/home/dank/models/Swift15-UncIQ3XXS}"
# repo | hub-name | dest-name | bytes | sha256 (the Hub LFS oid)
# repo | hub-name | dest-name | bytes | sha256 (computed locally; Xet repo)
FILES=(
"ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF|Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf|Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf|12120016896|9aecf1cd41b2cb2f32a74e0d889e33855ebef43b26f43b43feb5720239e677e5"
"unsloth/Qwen3.8-27B-GGUF|mmproj-F16.gguf|mmproj-Qwen3.8-27B-F16.gguf|927607488|cbb841a9ee0636b2ec172f5bb8df2ea8dfeb01e90fe7c6126581d662a0b4e43e"
"ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF|RCO/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-RCO-IQ3_XXS.gguf|Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-RCO-IQ3_XXS.gguf|10442827392|e13d3e7400b6c7f980ebd30c0edd6be43eb1865b50be8562a9db042706c7d803"
"ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF|mmproj-BF16.gguf|mmproj-BF16.gguf|931145888|19acd7fcf4ee504328566eddf0f8e603ef853a205b4830209d2a4908213abdea"
)
mkdir -p "$DEST"