dank/serverAppConfigs
1
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity

NPU: swap gemma4-it:e4b for qwen3.8-distilled-heretic:9b

Browse Source
This commit is contained in:
Frank
2026-09-01 01:51:44 -07:00
parent 5ba32ccecd
commit 1401bd42d4
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
scripts/frank-default-sightsound.env
+1 -1
View File
@@ -7,7 +7,7 @@
# endpoint trades "uncensored" for "sight + sound". The NPU draws from the
# unified RAM pool shared with frank-default-large (iGPU); ~31 GiB was
# available there at idle, so a 9.1 GB pack fits with headroom.
FLM_MODEL=gemma4-it:e4b
FLM_MODEL=qwen3.8-distilled-heretic:9b
FLM_HOST=0.0.0.0
FLM_PORT=7771
# turbo = max NPU power mode (xrt-smi configure --pmode turbo at serve start).