ExpedientFalcon/
qwen2.5-coder-3b-instruct-q6_k:latest

74 5 months ago

This repo contains the instruction-tuned 3B Qwen2.5-Coder model in the GGUF Format: https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct-GGUF/tree/main

tools
... /
params
ffa606a5e4e9 · 105B
{
"num_batch": 512,
"num_ctx": 16384,
"num_predict": 1024,
"repeat_penalty": 1.05,
"temperature": 0.7,
"top_p": 0.8
}