ProAdminGod/ gemma3-tuned:latest

56 4 months ago

A tuned version of Gemma3n with 4 active parameters and a total of 7. Works well on low power devices like raspberry pi 5 with 16GB of RAM

... /
params
5e8c1f5c82b4 · 103B
{
"num_ctx": 32000,
"num_thread": 4,
"repeat_last_n": 128,
"repeat_penalty": 1.2,
"temperature": 0.4,
"top_k": 20
}