424 1 week ago

Gemma4 model 2B parameters with Q4_K_S quatization. Thinking removed. Context set to 4096

tools thinking
7a86509331be · 193B
{
"num_ctx": 4086,
"repeat_penalty": 1,
"stop": [
"<|end_of_turn|>",
"<|file_separator|>",
"<|assistant|>",
"<|user|>"
],
"temperature": 0.7,
"top_k": 64,
"top_p": 0.95
}