novaforgeai/ qwen2.5:3b-optimized

215 1 month ago

NovaForge AI – Qwen 2.5-3B Optimized A CPU-optimized, lightweight, general-purpose AI model built on Qwen 2.5-3B, designed for fast and private local inference on low-resource systems.

tools
... /
params
c569e71a8e57 · 140B
{
"num_batch": 128,
"num_ctx": 1024,
"num_gpu": 0,
"num_predict": 512,
"num_thread": 8,
"repeat_penalty": 1.1,
"temperature": 0.7,
"top_k": 20,
"top_p": 0.9
}