232 1 month ago

High-quality Q8_0 GGUF quantized conversion of XHToken’s Spark-X2.5-4B, converted, tested, and packaged for Ollama by Yousef Burhan Ahmad.

5893eea485e6 · 115B
{
"num_ctx": 32768,
"num_predict": 8192,
"repeat_last_n": 64,
"repeat_penalty": 1,
"temperature": 1,
"top_k": -1,
"top_p": 0.95
}