Logo
Explore Help
Register Sign In
dank/serverAppConfigs
Watch 1
Star 0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity
31 Commits 67 Branches 8 Tags
ced4c6f46e50b836df48b37411fe2498717eb1f0
Commit Graph
4 Commits
Author SHA1 Message Date
Frank 69bb41057c Add --enable-auto-tool-choice and --tool-call-parser qwen3_xml for tool choice support 2026-08-08 11:23:57 -07:00
Frank 35bd22cd75 Add --served-model-name frank-default-small 2026-08-08 10:35:24 -07:00
Frank 6a7025d01e Iteration 2: Remove --enforce-eager to enable torch.compile (+14.6% prompt speed: 5.95 -> 6.82 tok/s) 2026-08-07 23:07:51 -07:00
Frank 1b90f421c6 Initial vLLM Qwen3.6-35B-A3B-FP8 serving with CPU expert offloading 2026-08-07 22:20:52 -07:00
Powered by Gitea Version: 28.2.0 Page: 40ms Template: 1ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API