smtek/ Qwen3.8-27B:Q4_K_XL

26.4K 1 month ago

Quants from Q2 up to Q5 from Unsloth K_M and UD_K_XL and builds for 12, 16 and 24 GB

vision
... /
params
ffe083c8aa23 ยท 212B
{
"draft_num_predict": 4,
"min_p": 0,
"num_batch": 512,
"num_ctx": 122880,
"num_gpu": 999,
"num_predict": -1,
"presence_penalty": 0,
"repeat_penalty": 1,
"stop": [
"<|im_end|>"
],
"temperature": 0.6,
"top_k": 20,
"top_p": 0.95
}