Logo
Explore Help
Register Sign In
dank/serverAppConfigs
Watch 1
Star 0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity
23 Commits 67 Branches 8 Tags
ad96733340dc495f2dd58486a058c73daaf01c30
Commit Graph
4 Commits
Author SHA1 Message Date
Frank 69bb41057c Add --enable-auto-tool-choice and --tool-call-parser qwen3_xml for tool choice support 2026-08-08 11:23:57 -07:00
Frank 35bd22cd75 Add --served-model-name frank-default-small 2026-08-08 10:35:24 -07:00
Frank 6a7025d01e Iteration 2: Remove --enforce-eager to enable torch.compile (+14.6% prompt speed: 5.95 -> 6.82 tok/s) 2026-08-07 23:07:51 -07:00
Frank 1b90f421c6 Initial vLLM Qwen3.6-35B-A3B-FP8 serving with CPU expert offloading 2026-08-07 22:20:52 -07:00
Powered by Gitea Version: 28.2.0 Page: 13ms Template: 2ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API