 Frank
|
69bb41057c
|
Add --enable-auto-tool-choice and --tool-call-parser qwen3_xml for tool choice support
|
2026-08-08 11:23:57 -07:00 |
|
|
Frank
|
dd19627635
|
Update validation script to use frank-default-small model name
|
2026-08-08 10:38:30 -07:00 |
|
|
Frank
|
35bd22cd75
|
Add --served-model-name frank-default-small
|
2026-08-08 10:35:24 -07:00 |
|
|
Frank
|
6a7025d01e
|
Iteration 2: Remove --enforce-eager to enable torch.compile (+14.6% prompt speed: 5.95 -> 6.82 tok/s)
|
2026-08-07 23:07:51 -07:00 |
|
|
Frank
|
1b90f421c6
|
Initial vLLM Qwen3.6-35B-A3B-FP8 serving with CPU expert offloading
|
2026-08-07 22:20:52 -07:00 |
|