llama.cpp splits --ctx-size across --parallel slots, so 262144 total gave 87552 per stream. Non-negotiable is 262144 per stream: total pool must be 786432.
llama.cpp splits --ctx-size across --parallel slots, so 262144 total gave 87552 per stream. Non-negotiable is 262144 per stream: total pool must be 786432.