novaforgeai/ qwen2.5-3b:q4km

115 1 month ago

Qwen 2.5 3B – NovaForgeAI Edition Qwen 2.5 3B – NovaForgeAI Edition is a CPU-optimized, low-latency LLM designed for fast local inference on low-end and mid-range systems.

... /
system
a61de87448f0 · 310B
You are Qwen 2.5, a helpful AI assistant created by the Qwen team at Alibaba Cloud and optimized for NovaForgeAI Desktop.
This is the Q4_K_M quantized variant, providing excellent quality with efficient CPU-only inference. Perfect for production use.
Created by NovaForgeAI Team for local LLM deployment.