dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

frank-default-large: add --no-mmap to avoid teardown OOM

Browse Source
This commit is contained in:
Frank committed 2026-08-20 14:49:45 -07:00
1 parent d9bf09e144
commit 8bf9462f21
1 file changed
+1
Download Patch File Download Diff File Expand all files Collapse all files
scripts/serve-frank-large.sh
+1
View File
@@ -101,6 +101,7 @@ exec "$LLAMA_BIN" \
--cache-ram "$CACHE_RAM" \ --cache-ram "$CACHE_RAM" \
--cache-prompt \ --cache-prompt \
--metrics \ --metrics \
--no-mmap \
--spec-type draft-mtp \ --spec-type draft-mtp \
--spec-draft-device ROCm0 \ --spec-draft-device ROCm0 \
--spec-draft-ngl 999 \ --spec-draft-ngl 999 \