fix: run Ling-3 vLLM from a cwd with no top-level vllm/ dir

The launcher does not change directory, so process cwd becomes sys.path[0]
for the 'python -m ...registry' model-inspection subprocess. From the CIRU
package root, the top-level vllm/ repo dir shadows the editable install as a
namespace package, breaking lazy imports (SamplingParams) and failing model
architecture inspection. cd to /home/dank/ling3-ciru before exec.
This commit is contained in:
Frank
2026-08-10 23:16:46 -07:00
parent 4a17948443
commit bf14ac7a7b
+7
View File
@@ -24,4 +24,11 @@ export HOST="${HOST:-0.0.0.0}"
export PORT="${PORT:-7770}"
export SERVED_MODEL_NAME="${SERVED_MODEL_NAME:-frank-default-large}"
# Run from a directory with no top-level 'vllm/' dir.
# Neither launcher changes directory, so the process cwd becomes sys.path[0]
# for the 'python -m ...registry' inspection subprocess. From the package root,
# the top-level vllm/ repo dir shadows the editable install as a namespace
# package and breaks lazy imports (for example, SamplingParams).
cd /home/dank/ling3-ciru
exec bash "$PKG/scripts/run-256k.sh"