Logo
Explore Help
Register Sign In
dank/serverAppConfigs
Watch 1
Star 0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity
33 Commits 67 Branches 8 Tags
3a64c8f3dd2640469e2267f17e1095e671942900
Commit Graph
4 Commits
Author SHA1 Message Date
Frank 69bb41057c Add --enable-auto-tool-choice and --tool-call-parser qwen3_xml for tool choice support 2026-08-08 11:23:57 -07:00
Frank 35bd22cd75 Add --served-model-name frank-default-small 2026-08-08 10:35:24 -07:00
Frank 6a7025d01e Iteration 2: Remove --enforce-eager to enable torch.compile (+14.6% prompt speed: 5.95 -> 6.82 tok/s) 2026-08-07 23:07:51 -07:00
Frank 1b90f421c6 Initial vLLM Qwen3.6-35B-A3B-FP8 serving with CPU expert offloading 2026-08-07 22:20:52 -07:00
Powered by Gitea Version: 28.2.0 Page: 13ms Template: 1ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API