Use ngram-mod and prioritize attention experts
This commit is contained in:
1 parent
37fb420fcd
commit
cd14d7bf68
8 files changed
+108
-84
No files matched your search
+1
-1
@@ -20,7 +20,7 @@ graph LR
|
||||
B[upstream llama.cpp b10121
|
||||
frank-default-small, port 7770]
|
||||
C[Ornith-1.5-35B-A3B-CRACK Q6_K
|
||||
native MTP, selected experts offloaded via override, 491520 ctx]
|
||||
ngram-mod, selected experts offloaded via override, 491520 ctx]
|
||||
A --> B --> C
|
||||
end
|
||||
|
||||
|
||||
Reference in new issue
Block a user