dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

frank-default-small: swap Huihui FP8 for thomsonreuters/Thomson-1.0-Small

Browse Source
This commit is contained in:
Frank committed 2026-09-01 02:11:35 -07:00
1 parent bb5508b2ec
commit 415f64964a
1 file changed
+2 -2
Download Patch File Download Diff File Expand all files Collapse all files
scripts/frank-default-small.env
+2 -2
View File
@@ -32,8 +32,8 @@
# The ROCm HIP runtime reads those bare env vars (see the 2026-08-13 TEMP # The ROCm HIP runtime reads those bare env vars (see the 2026-08-13 TEMP
# incident). This box is NVIDIA/CUDA, but the rule keeps the env portable. # incident). This box is NVIDIA/CUDA, but the rule keeps the env portable.
# Model directory (safetensors checkpoint, ~35 GB, block-fp8). # Model directory (safetensors checkpoint, ~35 GB, BF16 qwen3_5_moe MoE).
MODEL_DIR=/home/dank/models/huihui-qwen36-35b-a3b-abliterated-fp8 MODEL_DIR=/home/dank/models/thomson-1.0-small
# FreeToken venv (uv-managed CPython 3.12, ft CLI, flashinfer, torch+cu130). # FreeToken venv (uv-managed CPython 3.12, ft CLI, flashinfer, torch+cu130).
FT_VENV=/home/dank/freetoken/.venv FT_VENV=/home/dank/freetoken/.venv