Switch frank-default-small to Ornith Q6_K
This commit is contained in:
1 parent
3cc99d81cc
commit
af6ffeeb64
8 files changed
+115
-60
No files matched your search
+2
-2
@@ -19,8 +19,8 @@ graph LR
|
||||
A[RTX 3090 24GB + 62GB RAM]
|
||||
B[upstream llama.cpp b10121
|
||||
frank-default-small, port 7770]
|
||||
C[Ornith-1.5-35B-A3B-CRACK Q8_0
|
||||
native MTP, MoE experts offloaded via override, 688128 ctx]
|
||||
C[Ornith-1.5-35B-A3B-CRACK Q6_K
|
||||
native MTP, selected experts offloaded via override, 589824 ctx]
|
||||
A --> B --> C
|
||||
end
|
||||
|
||||
|
||||
Reference in new issue
Block a user