Frank
aa9c1d065a
- same qwen3_5_moe arch and native block-fp8 format (e4m3, 128x128 weight_block_size, un-fused per-expert layout) as the official Qwen FP8 checkpoint: identical FreeToken loader path, pool numbers unchanged (2048 MoE slots / 453005 KV tokens / 4 requests) - checkpoint downloaded to /home/dank/models/huihui-qwen36-35b-a3b-abliterated-fp8 (26 shards, ~35G); official checkpoint kept for rollback - ships froggeric fixed Qwen3.6 chat template, read from checkpoint - also refresh both .service Descriptions (large still said STRIX_LEAN)
16 lines
457 B
Desktop File
16 lines
457 B
Desktop File
[Unit]
|
|
Description=FreeToken Huihui-Qwen3.6-35B-A3B-abliterated-FP8 qwen3_5_moe hybrid MoE (dankserver, frank-default-small)
|
|
After=network-online.target
|
|
Wants=network-online.target
|
|
|
|
[Service]
|
|
Type=simple
|
|
User=dank
|
|
Group=dank
|
|
Environment="FRANK_SMALL_ENV_FILE=/home/dank/serverAppConfigs/scripts/frank-default-small.env"
|
|
ExecStart=/home/dank/serverAppConfigs/scripts/serve-frank-small.sh
|
|
Restart=on-failure
|
|
RestartSec=10
|
|
|
|
[Install]
|
|
WantedBy=multi-user.target |