dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity
2 Commits 67 Branches 8 Tags
6a7025d01e1a00eee175fa2649d1576be31961df
Commit Graph
2 Commits
Author SHA1 Message Date
Frank 6a7025d01e Iteration 2: Remove --enforce-eager to enable torch.compile (+14.6% prompt speed: 5.95 -> 6.82 tok/s) 2026-08-07 23:07:51 -07:00
Frank 1b90f421c6 Initial vLLM Qwen3.6-35B-A3B-FP8 serving with CPU expert offloading 2026-08-07 22:20:52 -07:00