Files
serverAppConfigs/llm/docs/ling-3.0-flash-vllm-plan.md
T
Frank 918fe4eaec Merge vllmScripts under llm/ (history-preserving import)
The vllmScripts repository (LLM inference fleet: serve scripts, systemd
units, env tunables, deployment runbook, research docs) is merged into
this repository. Its full history is grafted under llm/ with a
two-parent merge commit so no commit is lost.

A follow-up commit reorganizes llm/ into the repo layout:
llm/docs -> docs/LLM, llm/scripts -> scripts, llm/old -> old.
2026-08-22 15:03:03 -07:00

544 B

Ling-3.0-flash on Dankclaw — vLLM-ROCm Deployment Plan (never shipped)

This page was the plan for a vLLM-ROCm deployment of jcbtc/Ling-3.0-Flash-CIRU-int4-Strix-native (INT4 W4A16, ~62 GB) on Dankclaw. The deployment never shipped. The actual Ling work used the llama.cpp Q6_K fork trial instead: ling-3.0-flash-trial.

The trial service (frank-large-ling) is retired and disabled under the boot policy (2026-08-17). frank-default-large is the Qwen3.8-27B PP head, not the Ling path. See git history for the full decision table.