Frank
af6cd72d02
- MODEL_DIR -> /home/dank/models/ornith-1.5-35b-a3b-fp8 (37 GB, compressed-tensors per-channel FP8, same qwen3_5_moe arch/mass as Huihui so the pool plan carries unchanged) - CHAT_TEMPLATE_FILE -> scripts/chat-template.jinja (Qwen-Sharp, shared with frank-default-large); the checkpoint's stock template mis-serializes reasoning per its own model card - env/serve/unit headers updated; loader-risk + BF16-does-not-fit note
16 lines
441 B
Desktop File
16 lines
441 B
Desktop File
[Unit]
|
|
Description=FreeToken Ornith-1.5-35B-A3B-FP8 qwen3_5_moe hybrid MoE (dankserver, frank-default-small)
|
|
After=network-online.target
|
|
Wants=network-online.target
|
|
|
|
[Service]
|
|
Type=simple
|
|
User=dank
|
|
Group=dank
|
|
Environment="FRANK_SMALL_ENV_FILE=/home/dank/serverAppConfigs/scripts/frank-default-small.env"
|
|
ExecStart=/home/dank/serverAppConfigs/scripts/serve-frank-small.sh
|
|
Restart=on-failure
|
|
RestartSec=10
|
|
|
|
[Install]
|
|
WantedBy=multi-user.target |