--- type: reference title: "llama.cpp RPC" description: "llama.cpp distributed inference via ggml-rpc-server and the --rpc flag: architecture, CLI, versions, limitations, and RPC-compatible speculative decoding." tags: - pipeline-parallelism - research timestamp: 2026-08-14 ---