SetneufPT/ Gemma4-12B_Q4_64K_16GB-GPU:latest

456 1 week ago

Custom model for coding with agents to use locally with 16gb or 2x8gb GPUs (working fine...)

tools thinking
... /
params
ee764033034c · 140B
{
"num_ctx": 64000,
"repeat_last_n": 4096,
"repeat_penalty": 1.1,
"seed": 79,
"stop": [
"<turn|>"
],
"temperature": 0.1,
"top_k": 20,
"top_p": 0.8
}