Frankandomp
53ef121180
halogen-flash-server already ships an NPU path on the pin we run: for each
model named in HALOGEN_NPU_MODELS it loads the vendor's precompiled AIE
programs (XDNA2 executes only AIE-compiled graphs) and answers them on
/v1/embeddings inside the SAME container behind port 7770. That gives the
fleet an in-house embedding endpoint without touching the iGPU trunk.
The lane is opt-in and one line wide: HALOGEN_NPU_MODELS blank is the
pre-lane endpoint byte for byte (no device, no mounts, no engine env).
The three host preconditions the vendor names are gated in the serve script
and mirrored in the deployer (the 2026-10-01 twin law), each refused by name:
- the staged model files. /models is read-only and HALOGEN_DOWNLOAD stays
unset so the container opens no outbound connection at boot, so
scripts/download-frank-dragoon-npu.sh stages them from the pinned
revision with the catalog's own byte counts and sha256s (the engine
re-checks both at boot);
- the distro XRT's libxrt_coreutil/libxrt_core/libxrt_driver_xdna, each
mounted twice — where the image looks for XRT and at its own path —
because those libraries find each other where they were installed and
an /opt/xilinx/xrt of symlinks dangles inside the container;
- the GPU fabric clock HELD. On Strix Halo the iGPU and the NPU co-running
hang the machine (and corrupt NPU results) while FCLK changes speed, and
halogen refuses to start in that state; it cannot read host sysfs from
inside, so the hold is proven host-side. dankclaw/host/ carries the
vendor's halogen-fabric-clock{,.service} verbatim at tag v0.16.2 (sha256
a3a4f7f4e0142e71… / 5f9f1cc4c85a1c02…); the deployer installs, enables
and gates it only while the lane is named, and releases the clock plus
drops the boot hook when it is not.
After health, the deployer's lane gate is a real embedding through
/v1/embeddings — a 200 on /health proves nothing about the NPU programs.
Planner: dankclaw/host/halogen-fabric-clock* re-dispatches frank-dragoon
(the deployer installs it); dankclaw/host/grub and the fetch script plan
nothing.
Seam: 11 new tests — the off arm really renders nothing lane-specific, the
on arm renders the device/mounts/env, every missing precondition refuses by
name, the deployer twins and the host unit shape are pinned.
Co-Authored-By: omp <omp@dankclaw>
66 lines
3.1 KiB
Bash
Executable File
66 lines
3.1 KiB
Bash
Executable File
#!/bin/sh
|
|
# halogen-fabric-clock hold | release | status: the AMD GPU's fabric clock (FCLK), held at its top level.
|
|
#
|
|
# On Strix Halo the GPU and the NPU working at the same time can hang the machine, and corrupt the NPU's results,
|
|
# while the GPU's fabric clock changes speed; held at its top level, the two run together cleanly. halogen-flash-server
|
|
# with HALOGEN_NPU_MODELS refuses to start until the clock is held. This holds it: the performance level `manual` and
|
|
# only the top pp_dpm_fclk level, on every amdgpu device that has the control (the GPU and SoC clocks stay automatic).
|
|
# Cost: about 1 W at idle. Run as root; halogen-fabric-clock.service runs `hold` at every boot and after a resume.
|
|
#
|
|
# hold hold it (waits up to 60 s for the GPU driver to come up)
|
|
# release give it back to the driver (the performance level `auto`)
|
|
# status print each device's state; exit 0 when every device is held
|
|
set -u
|
|
SYS="${HALOGEN_SYSFS:-/sys}"
|
|
|
|
devices() {
|
|
for d in "$SYS"/class/drm/card*/device; do
|
|
[ -w "$d/pp_dpm_fclk" ] || [ -r "$d/pp_dpm_fclk" ] || continue
|
|
[ -e "$d/power_dpm_force_performance_level" ] || continue
|
|
echo "$d"
|
|
done | sort -u
|
|
}
|
|
|
|
held() { # held DEVICE_DIR: the performance level high, or manual with only the top fclk level selected
|
|
perf=$(cat "$1/power_dpm_force_performance_level" 2>/dev/null)
|
|
[ "$perf" = high ] && return 0
|
|
[ "$perf" = manual ] || return 1
|
|
top=$(grep . "$1/pp_dpm_fclk" | tail -n 1)
|
|
[ "$(grep -c '\*' "$1/pp_dpm_fclk")" = 1 ] && [ "${top%\*}" != "$top" ]
|
|
}
|
|
|
|
cmd="${1:-status}"
|
|
case "$cmd" in
|
|
hold)
|
|
n=0
|
|
while [ -z "$(devices)" ] && [ "$n" -lt 60 ]; do sleep 1; n=$((n + 1)); done
|
|
[ -n "$(devices)" ] || { echo "halogen-fabric-clock: no amdgpu device with a fabric clock control (pp_dpm_fclk) under $SYS/class/drm" >&2; exit 1; }
|
|
rc=0
|
|
for d in $(devices); do
|
|
lvl=$(grep . "$d/pp_dpm_fclk" | tail -n 1 | cut -d: -f1)
|
|
# the driver applies the level several seconds after the write, so the read-back waits up to 30 s
|
|
ok=0
|
|
if echo manual > "$d/power_dpm_force_performance_level" && echo "$lvl" > "$d/pp_dpm_fclk"; then
|
|
t=0; until held "$d" || [ "$t" -ge 300 ]; do sleep 0.1; t=$((t + 1)); done
|
|
held "$d" && ok=1
|
|
fi
|
|
if [ "$ok" = 1 ]; then
|
|
echo "halogen-fabric-clock: $d: held at level $lvl ($(grep . "$d/pp_dpm_fclk" | tail -n 1 | awk '{print $2}'))"
|
|
else
|
|
echo "halogen-fabric-clock: $d: could not hold it (level $lvl)" >&2; rc=1
|
|
fi
|
|
done
|
|
exit "$rc" ;;
|
|
release)
|
|
for d in $(devices); do echo auto > "$d/power_dpm_force_performance_level" && echo "halogen-fabric-clock: $d: released (auto)"; done ;;
|
|
status)
|
|
[ -n "$(devices)" ] || { echo "halogen-fabric-clock: no amdgpu device with a fabric clock control"; exit 1; }
|
|
rc=0
|
|
for d in $(devices); do
|
|
if held "$d"; then echo "$d: held ($(cat "$d/power_dpm_force_performance_level"))"
|
|
else echo "$d: NOT held ($(cat "$d/power_dpm_force_performance_level"))"; rc=1; fi
|
|
done
|
|
exit "$rc" ;;
|
|
*) echo "usage: halogen-fabric-clock hold | release | status" >&2; exit 2 ;;
|
|
esac
|