SetneufPT/ Qwen3.5-9B-Coder_Q4_256k_ABL_16GB-GPU:latest

1,727 3 months ago

Custom model for coding with agents to use locally with 16gb GPUs (working very fine...)

vision tools thinking
... /
params
661c3162d6b9 ยท 144B
{
"min_p": 0,
"num_ctx": 256000,
"num_gpu": 999,
"num_predict": 8192,
"presence_penalty": 0,
"repeat_penalty": 1,
"temperature": 0.6,
"top_k": 20,
"top_p": 0.95
}