michaelmontuori/ Qwen2.5-7B-Instruct-GGUF:Q4_K_M-32k

240 1 month ago

Initially built this 7b model to fit in my RTX 4060 with 8GB

tools
... /
params
db8fbfd0cb28 ยท 18B
{
"num_ctx": 32768
}