sightsound: new FLM NPU sight+sound service on XDNA2 (gemma4-it:e4b)
New Dankclaw service frank-default-sightsound: FLM 1.0.1 serving the Gemma4-E4B-IT-NPU2 pack (vision+audio+reasoning, 131072 ctx) on the XDNA2 NPU at port 52626. Model choice rationale: gemma4-it is the only NPU2 model family with BOTH image and audio towers; the uncensored candidate qwythos:9b is text-only, so sight+sound wins over uncensored here. Deployer wiring: planner maps env/unit/serve files to the new service name; deploy-remote gains deploy_llm_sightsound (relink + daemon-reload + enable + restart + health gate on /v1/version — FLM has no /health route). Unlike the retired frank-default-npu relink-only path, this unit is boot-enabled.
This commit is contained in:
1 parent
0937cfb047
commit
c3ed3a6e12
6 files changed
+119
No files matched your search
@@ -0,0 +1,17 @@
|
||||
[Unit]
|
||||
Description=FastFlowLM NPU sight+sound inference (frank-default-sightsound) on Dankclaw
|
||||
After=network-online.target
|
||||
Wants=network-online.target
|
||||
|
||||
[Service]
|
||||
Type=simple
|
||||
User=dank
|
||||
Group=dank
|
||||
Environment="FLM_SIGHTSOUND_ENV_FILE=/home/dank/serverAppConfigs/scripts/frank-default-sightsound.env"
|
||||
ExecStart=/home/dank/serverAppConfigs/scripts/serve-frank-default-sightsound.sh
|
||||
LimitMEMLOCK=infinity
|
||||
Restart=on-failure
|
||||
RestartSec=10
|
||||
|
||||
[Install]
|
||||
WantedBy=multi-user.target
|
||||
Reference in new issue
Block a user