4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Frank	dd19627635	Update validation script to use frank-default-small model name	2026-08-08 10:38:30 -07:00
Frank	35bd22cd75	Add --served-model-name frank-default-small	2026-08-08 10:35:24 -07:00
Frank	6a7025d01e	Iteration 2: Remove --enforce-eager to enable torch.compile (+14.6% prompt speed: 5.95 -> 6.82 tok/s)	2026-08-07 23:07:51 -07:00
Frank	1b90f421c6	Initial vLLM Qwen3.6-35B-A3B-FP8 serving with CPU expert offloading	2026-08-07 22:20:52 -07:00