SetneufPT/ ccode79v2_4b_q4_32k_8gb-gpu:latest

26 10 hours ago

Custom model v2 for Claude Code to use locally with 8gb GPUs (maybe tiny miracles?...)

vision tools thinking
... /
params
00f98f08ad12 · 134B
{
"num_ctx": 32000,
"presence_penalty": 1.5,
"repeat_last_n": 2048,
"repeat_penalty": 1.1,
"seed": 79,
"temperature": 0.1,
"top_k": 20,
"top_p": 0.8
}