dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

NPU: swap gemma4-it:e4b for qwen3.8-distilled-heretic:9b

Browse Source
This commit is contained in:
Frank committed 2026-09-01 01:51:44 -07:00
1 parent 5ba32ccecd
commit 1401bd42d4
1 file changed
+1 -1
Download Patch File Download Diff File Expand all files Collapse all files
scripts/frank-default-sightsound.env
+1 -1
View File
@@ -7,7 +7,7 @@
# endpoint trades "uncensored" for "sight + sound". The NPU draws from the # endpoint trades "uncensored" for "sight + sound". The NPU draws from the
# unified RAM pool shared with frank-default-large (iGPU); ~31 GiB was # unified RAM pool shared with frank-default-large (iGPU); ~31 GiB was
# available there at idle, so a 9.1 GB pack fits with headroom. # available there at idle, so a 9.1 GB pack fits with headroom.
FLM_MODEL=gemma4-it:e4b FLM_MODEL=qwen3.8-distilled-heretic:9b
FLM_HOST=0.0.0.0 FLM_HOST=0.0.0.0
FLM_PORT=7771 FLM_PORT=7771
# turbo = max NPU power mode (xrt-smi configure --pmode turbo at serve start). # turbo = max NPU power mode (xrt-smi configure --pmode turbo at serve start).