13 2 weeks ago

pulled as BF16, requant to IQ4_NL (combined_en_huge) -- (English + Coding focus) ~5% faster than Q4_K_M

ollama run dlasher/Spark-X2.6-4B:IQ4_NL

Details

2 weeks ago

095e667c2122 · 2.5GB

spark2_5
·
4.11B
·
IQ4_NL
{ "min_p": 0.05, "num_batch": 2048, "num_ctx": 262144, "presence_penalty": 0, "r
{{- if .System }}<|im_start|>system {{ .System }}<|im_end|> {{- end }} {{- range .Messages }} {{- if

Readme

==================================================
 PERPLEXITY QUALITY SCORECARD
 Base Model PPL      : 10.2661 (16-bit reference)
 Quantized Model PPL : 10.2845 (IQ4_NL target)
 Perplexity Drift    : +0.0184 (+0.18%)
 Quality Assessment  : [PASS] EXCELLENT (Near-Lossless / Gold Standard)
==================================================

image.png

A little over a month has passed since Spark-X2.5. In the rapidly evolving world of AI agents, that is enough time to rethink, refine, and move the frontier forward. Building on the Spark-X2.5-4B, we introduce Spark-X2.6-4B, the latest generation of our compact, general-purpose language models for on-device deployment.

Spark-X2.6-4B retains exactly the same architecture as Spark-X2.5-4B, achieving its capability gains through improved post-training. It delivers substantial improvements in coding, agent, long-context, multilingual, reasoning, etc. These advances enable more capable and practical on-device AI for developers and users tackling real-world tasks.

Technical Highlights:

Stronger Coding, Agentic, and Long-Context Capabilities: The models deliver substantial improvements in agentic workflows involving complex tool use, multi-step planning, and software engineering. They achieve state-of-the-art performance among similarly sized open-source models, matching or even surpassing models with approximately 9B parameters. Controllable Thinking Budget: The models provide three configurable thinking levels—none, low, high—allowing applications to balance reasoning quality, latency, and inference cost dynamically.

SOURCES: