SetneufPT/ ccode79v2_9b_q4_64k_16gb-gpu:latest

45 9 hours ago

Custom model v2 for Claude Code to use locally with 16gb or 2x8gb GPUs (working fine...)

vision tools thinking
... /
params
5cc9cd0e9250 · 132B
{
"num_ctx": 64000,
"presence_penalty": 1.5,
"repeat_last_n": 4096,
"repeat_penalty": 1.2,
"seed": 79,
"temperature": 0,
"top_k": 20,
"top_p": 0.8
}