thread_id: 01a0a7ff-dae2-71fd-9bd0-a8aa7c9d3676
updated_at: 1789533306

llama.cpp parallelism types: two real model-parallelism modes (pipeline/layer split = default, tensor = experimental), plus deprecated 'row' and single-GPU 'none'. --parallel is a separate serving-level concurrency axis, not model splitting. No first-class context/sequence parallelism. Tensor mode requires flash attention, non-quantized KV, and excludes MoE/Mamba/SSM architectures.