Frank 764a65080f Validation: 2 parallel prompts, ~18 tok/s with DFlash ...

- Add second parallel prompt (Byzantine Empire history vs ML)
- Both hit 1024 tokens, combined 2048 in 111.6s = 18.34 tok/s
- Parallel throughput matches single-stream baseline

2026-08-07 16:21:20 -07:00

..

llama-server.service

Enable DFlash speculative decoding, remove mlock

2026-08-07 16:10:55 -07:00

serve-llamacpp-dflash.sh

Enable DFlash speculative decoding, remove mlock

2026-08-07 16:10:55 -07:00

validate.sh

Validation: 2 parallel prompts, ~18 tok/s with DFlash

2026-08-07 16:21:20 -07:00