doomgrave/
qwen3:1.7b-Q3_K_S

127 5 months ago

Gemma3:8b, quantized to Q2_K and Q3_K_S for GPU with 4gb Vram or less.Edit

tools
... /
params
3992395081f4 · 122B
{
"repeat_penalty": 1.2,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.6,
"top_k": 20,
"top_p": 0.95
}