frank-default-large: add --no-mmap to avoid teardown OOM
This commit is contained in:
@@ -101,6 +101,7 @@ exec "$LLAMA_BIN" \
|
||||
--cache-ram "$CACHE_RAM" \
|
||||
--cache-prompt \
|
||||
--metrics \
|
||||
--no-mmap \
|
||||
--spec-type draft-mtp \
|
||||
--spec-draft-device ROCm0 \
|
||||
--spec-draft-ngl 999 \
|
||||
|
||||
Reference in New Issue
Block a user