18 2 weeks ago

pulled as BF16, vocab slice (combined_en_huge) requant to IQ4_NL (combined_en_huge) -- (English + Coding focus) - ~10% faster than unsloth Q4_K_M

ollama run dlasher/Spark-X2.6-4B-ENG:IQ4_NL

Details

2 weeks ago

b43c5b1f6f57 · 2.3GB

spark2_5
·
3.93B
·
IQ4_NL
{{- if .System }}<|im_start|>system {{ .System }}<|im_end|> {{- end }} {{- range .Messages }} {{- if
{ "min_p": 0.05, "num_batch": 2048, "num_ctx": 262144, "presence_penalty": 0, "r

Readme

NOTE: This model has been heavily vocab-sliced to reduce non-coding and non-English tokens. YMMV. (Mandarin, Korean, Vietnamese, Hindi, Arabic, Japanese, Russian)

==================================================
 PERPLEXITY QUALITY SCORECARD
 Base Model PPL      : 10.8559 (16-bit reference)
 Quantized Model PPL : 10.8594 (IQ4_NL target)
 Perplexity Drift    : +0.0035 (+0.03%)
 Quality Assessment  : [PASS] EXCELLENT (Near-Lossless / Gold Standard)
==================================================

image.png

A little over a month has passed since Spark-X2.5. In the rapidly evolving world of AI agents, that is enough time to rethink, refine, and move the frontier forward. Building on the Spark-X2.5-4B, we introduce Spark-X2.6-4B, the latest generation of our compact, general-purpose language models for on-device deployment.

Spark-X2.6-4B retains exactly the same architecture as Spark-X2.5-4B, achieving its capability gains through improved post-training. It delivers substantial improvements in coding, agent, long-context, multilingual, reasoning, etc. These advances enable more capable and practical on-device AI for developers and users tackling real-world tasks.

Technical Highlights:

Stronger Coding, Agentic, and Long-Context Capabilities: The models deliver substantial improvements in agentic workflows involving complex tool use, multi-step planning, and software engineering. They achieve state-of-the-art performance among similarly sized open-source models, matching or even surpassing models with approximately 9B parameters. Controllable Thinking Budget: The models provide three configurable thinking levels—none, low, high—allowing applications to balance reasoning quality, latency, and inference cost dynamically.

SOURCES: