Frank b854ec78ad frank-default-small: enable prefix caching (opt-in for hybrid models; big TTFT win for pi's repeated system prompt)

2026-08-17 18:25:28 -07:00

..

deploy.sh

fix: make serve scripts + deploy.sh executable

2026-08-17 15:24:40 -07:00

frank-default-large.env

record performance fixes: FA_ALL_QUANTS build flag (dankserver), RDNA triton FA env (dankclaw)

2026-08-17 16:30:22 -07:00

frank-default-large.service

fleet redo 2026-08-17: retire PP+NPU, new topology

2026-08-17 15:23:46 -07:00

frank-default-small.env

frank-default-small: enable prefix caching (opt-in for hybrid models; big TTFT win for pi's repeated system prompt)

2026-08-17 18:25:28 -07:00

frank-default-small.service

fleet redo 2026-08-17: retire PP+NPU, new topology

2026-08-17 15:23:46 -07:00

serve-frank-large.sh

fix: make serve scripts + deploy.sh executable

2026-08-17 15:24:40 -07:00

serve-frank-small.sh

frank-default-small: enable prefix caching (opt-in for hybrid models; big TTFT win for pi's repeated system prompt)

2026-08-17 18:25:28 -07:00