janimpasanen/ qwen3.5-32k-jani:4b-mlx

12 6 days ago

32k token limit, for running on mac book pro with 16GB (~ 10 GB available for AI without anything else running)

vision tools thinking
... /
params
a621e28f36d5 · 115B
{
"min_p": 0,
"num_ctx": 32768,
"presence_penalty": 1.5,
"repeat_penalty": 1.05,
"temperature": 0.15,
"top_k": 20,
"top_p": 0.9
}