Lower dankserver compute threads 8→7 to leave CPU headroom
This commit is contained in:
1 parent
df41aaafe7
commit
a74c1c5bcb
1 file changed
+2
-1
@@ -30,5 +30,6 @@ UBATCH_SIZE=2048
|
|||||||
# Load the model into RAM rather than lazy-mapping it. The MoE experts live on
|
# Load the model into RAM rather than lazy-mapping it. The MoE experts live on
|
||||||
# CPU, so eager RAM load avoids page faults during decode (uses ~31GB RAM).
|
# CPU, so eager RAM load avoids page faults during decode (uses ~31GB RAM).
|
||||||
NO_MMAP=1
|
NO_MMAP=1
|
||||||
THREADS=8
|
# Compute threads lowered to 7 so other processes on the box keep a core.
|
||||||
|
THREADS=7
|
||||||
THREADS_HTTP=8
|
THREADS_HTTP=8
|
||||||
Reference in new issue
Block a user