oamazonasgabriel/ qwen2.5-coder.1.5b-mlx:fp16-8gbGPU

1 6 hours ago

Code-specialized 1.5B model in F16 precision, optimized for MLX workflows. 32K context, fill-in-the-middle support, and fast inference on GPUs with 8 GB+ memory. Ideal for code generation, completion, and bug fixing.

... /
params
a2340c55f44a · 163B
{
"num_ctx": 32768,
"repeat_penalty": 1.1,
"stop": [
"<|im_start|>",
"<|im_end|>",
"<|endoftext|>"
],
"temperature": 0.7,
"top_k": 20,
"top_p": 0.8
}