Frank
918fe4eaec
The vllmScripts repository (LLM inference fleet: serve scripts, systemd units, env tunables, deployment runbook, research docs) is merged into this repository. Its full history is grafted under llm/ with a two-parent merge commit so no commit is lost. A follow-up commit reorganizes llm/ into the repo layout: llm/docs -> docs/LLM, llm/scripts -> scripts, llm/old -> old.
11 lines
544 B
Markdown
11 lines
544 B
Markdown
# Ling-3.0-flash on Dankclaw — vLLM-ROCm Deployment Plan (never shipped)
|
|
|
|
This page was the plan for a vLLM-ROCm deployment of
|
|
`jcbtc/Ling-3.0-Flash-CIRU-int4-Strix-native` (INT4 W4A16, ~62 GB) on
|
|
Dankclaw. The deployment never shipped. The actual Ling work used the
|
|
llama.cpp Q6_K fork trial instead: [[ling-3.0-flash-trial]].
|
|
|
|
The trial service (`frank-large-ling`) is retired and disabled under the
|
|
boot policy (2026-08-17). `frank-default-large` is the Qwen3.8-27B PP
|
|
head, not the Ling path. See git history for the full decision table.
|