dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity
20 Commits 67 Branches 8 Tags
659fba6a5d967c2809f72a7d51a271bc8a966186
Commit Graph
2 Commits
Author SHA1 Message Date
Frank 659fba6a5d Lower --max-num-batched-tokens to 1536 to free VRAM for weights 2026-08-08 12:56:28 -07:00
Frank 4edcada2a8 Increase max-model-len to 32768, cpu-offload to 40GB, add reasoning-parser and tool-call-parser 2026-08-08 12:03:23 -07:00