frank-primary: 5th expert block onto ROCm0 (operator-directed fill)
Blocks 0-4 on ROCm0 + 45-47 on ROCm1. This exact shape was probed and battery-verified earlier the same session: card0 2.54 GiB free at boot, 2.11 GiB after the vision graph (steady under load), card1 unchanged at ~3.3 GiB. Card1 cannot take another block (0.82 GiB would OOM the vision graph + boot drift), so 5/3 is the physical limit at the 4x262144 / V-q8_0 shape. OT assertion pins the new value.
This commit is contained in:
1 parent
e330d56a06
commit
d317d6b246
2 files changed
+8
-6
No files matched your search
@@ -66,7 +66,7 @@ REMOTE_DEPLOY="$REPO_ROOT/scripts/deploy-remote.sh"
|
||||
! grep -q -- '--no-mmap' "$SERVE"
|
||||
! grep -q '^MMPROJ_ON_GPU' "$ENV_FILE"
|
||||
ot="$(sed -nE "s/^OT_OVERRIDES='(.*)'$/\1/p" "$ENV_FILE")"
|
||||
[ "$ot" = 'blk\.[0-3]\.ffn_(up|gate|down)_exps=ROCm0,blk\.4[5-7]\.ffn_(up|gate|down)_exps=ROCm1,exps=CPU,per_layer_token_embd.weight=CPU' ]
|
||||
[ "$ot" = 'blk\.[0-4]\.ffn_(up|gate|down)_exps=ROCm0,blk\.4[5-7]\.ffn_(up|gate|down)_exps=ROCm1,exps=CPU,per_layer_token_embd.weight=CPU' ]
|
||||
}
|
||||
|
||||
@test "the KV pool is V-quantized, K held at f16" {
|
||||
|
||||
Reference in new issue
Block a user