From e6fcf217b44e4052a7b372434ddde43d7ff2a2fc Mon Sep 17 00:00:00 2001 From: Frank Date: Wed, 21 Oct 2026 13:35:50 -0700 Subject: [PATCH] docs(comfyui): the GTT aperture is not free RAM beside frank-dragoon Measured 2026-10-21 with frank-dragoon live: MemAvailable 15.3 GiB, iGPU busy 1.75 GiB. The Qwen-Image weight sets (13.3-14.2 GB) do not fit that budget, and the page's 122 GB /system_stats figure is the aperture, not headroom. Adds the fit table and the stop-mask-render-verify procedure (the 3090 bench law, applied to the APU); ComfyUI.md gotcha links it. --- .../Dankclaw/ComfyUI Qwen-Image Workflows.md | 36 ++++++++++++++++--- serverAppConfigs-docs/Dankclaw/ComfyUI.md | 6 ++++ 2 files changed, 37 insertions(+), 5 deletions(-) diff --git a/serverAppConfigs-docs/Dankclaw/ComfyUI Qwen-Image Workflows.md b/serverAppConfigs-docs/Dankclaw/ComfyUI Qwen-Image Workflows.md index e36aebe..2924a7b 100644 --- a/serverAppConfigs-docs/Dankclaw/ComfyUI Qwen-Image Workflows.md +++ b/serverAppConfigs-docs/Dankclaw/ComfyUI Qwen-Image Workflows.md @@ -110,9 +110,9 @@ only `models`, `input`, `output`, `custom_nodes` and the healthcheck file ## Recommended additions -Quantized preferred, sized for the 8060S iGPU (GTT-backed — `/system_stats` -reports 122.4 GB of device VRAM on `cuda:0`, `curl http://127.0.0.1:8188/system_stats` -2026-10-18; the RTX 3090 is frank-zealot's). All repos verified 2026-10-05 and +Quantized preferred. The iGPU's GTT aperture is not free RAM beside +frank-dragoon — size every pick against *What actually fits beside +frank-dragoon* below (the RTX 3090 is frank-zealot's). All repos verified 2026-10-05 and all four still resolve today (`huggingface.co/lightx2v/Qwen-Image-Lightning` `huggingface.co/unsloth/Qwen-Image-Edit-2511-GGUF` `huggingface.co/Comfy-Org/Qwen-Image-DiffSynth-ControlNets` @@ -133,8 +133,34 @@ sha256 checks) or a plain `hf download` with the token in the environment — never on the command line. Skip list: the original `city96/Qwen-Image-gguf` conversions (superseded by -the 2.1 files already on disk), and any BF16 of #2/#4 (the iGPU does not need -them at GTT capacity, and they double the disk bill). +the 2.1 files already on disk), and any BF16 of #2/#4 — they double the disk +bill, and see *What actually fits beside frank-dragoon* for why raw GTT size +is not the real budget. + +## What actually fits beside frank-dragoon + +The 122 GB `/system_stats` figure is the GTT **aperture**, not free memory: on +an APU the aperture and `MemAvailable` are the same physical RAM, and +frank-dragoon pins tens of GiB of it. Measured 2026-10-21 with frank-dragoon +live: `MemAvailable` 15.3 GiB, iGPU busy 1.75 GiB — ComfyUI itself idles at +~10 MB, so the budget for a generation run is roughly what `free` says. + +Weights must land inside that budget with slack for compute buffers and +activations (the mmproj-class lesson: price a model at ~1.5× its file set): + +| Pipeline (weights) | Fits beside frank-dragoon? | +|---|---| +| Qwen-Image 2.1 int8_convrot + w4a8 + bf16 VAE (~14.2 GB) — the two proven workflows | **No** — thrash-or-fail; do not queue it while the endpoint serves | +| GGUF Q8_0 + w4a8 + small VAE (~13.3 GB) | No, same reason | +| Any BF16 combination | No | +| SDXL-Turbo / SD 1.5-class (~2–7 GB) | Yes, with real headroom | + +**The law: one process owns the memory — same rule as the 3090 bench law.** +For a Qwen-Image render: stop and mask frank-dragoon +(`sudo systemctl stop frank-dragoon` + `mask` — the mask stops +`Restart=always` from firing mid-render), generate, unmask, verify +`curl 192.168.0.143:7770/health`. The proven workflows above then run with +the whole machine. Do not treat `/system_stats`'s 122 GB as an invitation. ## See Also diff --git a/serverAppConfigs-docs/Dankclaw/ComfyUI.md b/serverAppConfigs-docs/Dankclaw/ComfyUI.md index b2dfd25..e946d86 100644 --- a/serverAppConfigs-docs/Dankclaw/ComfyUI.md +++ b/serverAppConfigs-docs/Dankclaw/ComfyUI.md @@ -129,6 +129,12 @@ bind-mounted to `/usr/local/bin/comfyui-healthcheck.py` and run as `HealthCmd` - Do not let pip reinstall the torch family. The Containerfile filters it out on purpose. - The base image is about 32 GiB (`podman image inspect localhost/comfyui-rocm:gfx1151` → 33,765,227,471 B ≈ 31.4 GiB, 2026-10-18). A code update means a rebuild, because the code is baked in. - The empty-models note from the 2026-09-16 era is retired: `/home/dank/comfyui-data/models` now holds the Qwen-Image 2.1 payload — three `diffusion_models`, three `text_encoders`, two VAEs (~35 GB, `ls -l` 2026-10-18), listed in [[ComfyUI Qwen-Image Workflows]]. New model classes (LoRA, ControlNet) still need their directories created first: `models/lora` and `models/controlnet` do not exist yet. +- **The 122 GB `/system_stats` VRAM figure is the GTT aperture, not free + memory.** On the APU it is system RAM, and frank-dragoon pins most of it + (`MemAvailable` 15.3 GiB with the endpoint live, measured 2026-10-21). A + Qwen-Image-class render beside the running endpoint is thrash-or-fail; the + stop-mask-render-verify procedure and the fit table are in + [[ComfyUI Qwen-Image Workflows]] → What actually fits beside frank-dragoon. ## See Also