dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

Add --served-model-name frank-default-small

Browse Source
This commit is contained in:
Frank committed 2026-08-08 10:35:24 -07:00
1 parent 6a7025d01e
commit 35bd22cd75
1 file changed
+2 -1
Download Patch File Download Diff File Expand all files Collapse all files
vllm-qwen36.sh
+2 -1
View File
@@ -28,4 +28,5 @@ exec docker run --rm --name vllm-qwen36 \
--cpu-offload-gb 30 \ --cpu-offload-gb 30 \
--cpu-offload-params "experts" \ --cpu-offload-params "experts" \
--enable-chunked-prefill \ --enable-chunked-prefill \
--enable-prefix-caching --enable-prefix-caching \
--served-model-name frank-default-small