dank/serverAppConfigs
1
0
Fork 0
Code Issues 4 Pull Requests 1 Actions Packages Projects Releases Wiki Activity

ling A/B: revert batch 8192->3072 to isolate mid-stream freeze (suspect batch)

Browse Source
This commit is contained in:
Frank
2026-08-14 02:20:52 -07:00
parent a5444e2c4d
commit 6a6d673dca
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
scripts/frank-default-large.ling.env
+1 -1
View File
@@ -32,7 +32,7 @@ DEVICE=Vulkan0
N_GPU_LAYERS=all N_GPU_LAYERS=all
FLASH_ATTN=auto FLASH_ATTN=auto
# Batch kept small-leaning for the tight memory budget; tune with CTX_SIZE. # Batch kept small-leaning for the tight memory budget; tune with CTX_SIZE.
BATCH_SIZE=8192 BATCH_SIZE=3072
UBATCH_SIZE=3072 UBATCH_SIZE=3072
# Diagnostics: high verbosity + a dedicated log file for investigating the # Diagnostics: high verbosity + a dedicated log file for investigating the