frank-default-small: retarget to lamianlbe/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-fp8
Ornith-1.5-35B-A3B-FP8 failed to load on FreeToken v0.1.2: its compressed-tensors checkpoint uses a nonstandard expert tensor layout (FreeToken: 'Missing MoE expert source layers: gate_up'). Retarget to the HauhauCS Aggressive FP8 finetune of the SAME Qwen3.6-35B-A3B arch Huihui used, which carries compressed-tensors BLOCK-fp8 (128x128) with the standard per-expert naming (mlp.experts.N.gate_proj/up_proj/down_proj + .weight_scale) that FreeToken's MoE loader reads. - MODEL_DIR -> /home/dank/models/hauhaucs-qwen36-35b-a3b-aggressive-fp8 - use the checkpoint's own chat_template.jinja (drop the Sharp override; forcing a template the finetune wasn't trained on risks format drift) - pool plan unchanged (same ~35 GB FP8 mass / qwen3_5_moe arch)
This commit is contained in:
1 parent
a14a70a404
commit
34ab6b4d0c
3 files changed
+42
-44
No files matched your search
@@ -1,5 +1,5 @@
|
||||
[Unit]
|
||||
Description=FreeToken Ornith-1.5-35B-A3B-FP8 qwen3_5_moe hybrid MoE (dankserver, frank-default-small)
|
||||
Description=FreeToken Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-FP8 qwen3_5_moe hybrid MoE (dankserver, frank-default-small)
|
||||
After=network-online.target
|
||||
Wants=network-online.target
|
||||
|
||||
|
||||
Reference in new issue
Block a user