michaelmontuori/ Qwen2.5-7B-Instruct-GGUF:Q4_K_M-32k

14 2 days ago

Initially built this 7b model to fit in my RTX 4060 with 8GB

tools
... /
params
db8fbfd0cb28 · 18B
{
"num_ctx": 32768
}