238 yesterday

Open-weight local LLM ladder, 2B–27B — agentic tool calling with a published 32K context budget. Base 9B scores 89.5% on a 77-task suite, measured on the exact blobs. Seed-tier brain of the Orvyth organism. Intelligence. Governed.

tools
ollama run Orvyth/engrym-seed:flash

Details

yesterday

57ede1d5c2db · 4.6GB ·

qwen35
·
4.33B
·
Q8_0
Engrym Seed is a derivative of Qwen3.5 and inherits the Qwen license of its base model; consult the
{ "num_ctx": 32768, "num_predict": 8192, "stop": [ "<|im_end|>", "<|im_s
{{- if .Messages }} {{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{

Readme

Engrym Seed

ENGRYM SEED

Orvyth's seed-tier brain — a local model family for tool-using agents.

Engrym Seed tier 2B to 27B 262144 native context Q8_0 Tool calling verified


Seed runs local; Epoch and Axiom are hosted tiers.

Not a chatbot. A substrate.


Run Engrym Seed

ollama run Orvyth/engrym-seed

Pulled before 2026-08-09? Re-pull. Ollama does not refresh a tag it already holds, and every tag was rebuilt: a real chat template (older builds shipped a raw passthrough that silently discarded system prompts and made tool calling unavailable), a sane default context, and a header repair that fixed artifacts which would not load at all.

The Seed ladder

TagClassSize 77-taskTool callsNotes
:nano · :nano-v1g2Seed Nano 2B2.1 GB 90.8/14312/12Micro / edge.
:flash · :flash-v1g2Seed Flash 4B4.6 GB 124/14312/12Fastest to act. Strong value.
:base · :base-v1.2ag1 · :latestSeed Base 9B 9.5 GB131/14312/12 Recommended download.
:pro-27b-q4Seed Pro 27B v2 (Q4_K_M)16.5 GB 134/14312/1227B class, smaller download.
:pro · :pro-v1g2Seed Pro 27B v2 (Q8_0)28.6 GB 134/14312/12Largest stable artifact.
:v1Legacy V1 9B (f16)18 GB not measuredHistorical. Superseded.

Experimental channel

-e tags are the staging channel: internal evaluation, never :latest, published so results can be reproduced rather than because they are finished. "E" builds are trained on multi-step tool loops — their advantage is step efficiency (reaching a goal in fewer tool calls), not raw knowledge.

TagArtifactSize77-taskTool calls
:pro-ePro-E 27B28.6 GB137/14312/12
:pro-e-v2Pro-E 27B v2 merged28.6 GBnot measured
:pro-e-v2-textPro-E 27B v2 text-only28.6 GBnot measured
:pro-e-9bPro-E 9B (archived early attempt)9.5 GB105/14312/12

📊 Measured evaluations

These are first-party numbers. One ruleset applied identically to every row: 77 tasks · 143 points · temperature=0 · max_tokens=16384 · seed=42 · one attempt per task · deterministic validators · no LLM judge. Runner: Ollama on a single NVIDIA B200. Scores are bound to the exact published blobs, not to an internal build.

Read these as single-run figures, not a ranking. Each row is one run. We have measured meaningful run-to-run variation on this suite — a task timeout that fires under load can cost a large model double-digit points — so differences of a few points between adjacent rows are not evidence that one model is better than another. A repeated-run study is in progress and these numbers will be restated with spread when it completes. Public reproduction receipts are pending.

ArtifactScorePercent
Pro-E 27B :pro-e137.0 / 14395.8%
Pro 27B v2 :pro / :pro-27b-q4134.0 / 14393.7%
Base 9B :base131.0 / 14391.6%
Flash 4B :flash124.0 / 14386.7%
Pro-E 9B :pro-e-9b105.0 / 14373.4%
Nano 2B :nano90.8 / 14363.5%

Compute modes are real, and the numbers above are floors

Every score above was produced with one terse system prompt at the model's default effort. Asking a model to work deliberately — reason step by step, verify against every constraint, then answer — recovers points on tasks it otherwise fails. Measured by retrying only the failed tasks under a deliberate-mode prompt:

ArtifactDefaultDeliberateGain
:pro-e137137+0
:pro / :pro-27b-q4134137+3
:base131134+3
:flash124130+6
:pro-e-9b105117+12
:nano90.8102.6+11.8

The gain is largest for the smallest models. Pro-E gains nothing because it already deliberates by default; Nano gains twelve points because it answers quickly unless told otherwise. If you want accuracy over latency, say so in your system prompt — it is worth more than a model upgrade on the small end.

Tool calling — measured under a realistic agent load

Tested through Ollama's /api/chat tools interface with a 45-tool schema and a full agent system prompt, across three scenarios, 12 trials each. A trial passes only if the response populates tool_calls; prose describing the action counts as a failure. Every published build scored 12/12, in both a 2-tool short-prompt profile and the 45-tool profile.

Context and memory — measured

Native context is 262,144 tokens. Larger requests are silently clamped: ask for 524,288 and Ollama logs requested context size too large for model, n_ctx_train=262144 and gives you 262,144. There is no 512K mode — that would require RoPE extension and retraining.

num_ctxBase 9B footprint
8,1929.0 GB
16,3849.2 GB
32,768 (shipped default)9.8 GB
65,53611 GB
131,07213 GB
262,144 (native max)18 GB

Context is cheap here because most layers are linear-attention: 32× the window for roughly 2× the memory. The default is 32,768 rather than the native maximum because defaulting to 262,144 made a 9.5 GB model request roughly 19 GB of RAM just to start, and the 27B would not load at all on a 32 GB machine.

If your prompt exceeds num_ctx, Ollama returns HTTP 400 (request (N tokens) exceeds the available context size) — it does not silently drop part of your prompt. A 45-tool schema plus an agent system prompt is roughly 6–8k tokens, so it fits comfortably at the shipped default. Raise num_ctx for long conversation histories, not for tool schemas.

Sampling defaults

Defaults are per class, chosen from measured temperature sensitivity rather than a single house value.

SettingNano · Flash · Base · ProE builds
temperature0.20.1
top_p0.90.9
top_k2020
num_ctx3276832768
num_predict81928192
stop<|im_end|>, <|im_start|>

The E builds run cooler because the tools-trained line is measurably less temperature-robust: it loses roughly 13 points between temperature 0 and 1.0, where the plain Base line holds within a few points. Benchmarks are run at temperature=0.

What changed in this release

FixWhat it was
Artifacts that would not load Several builds declared one more transformer block than they contained, failing with missing tensor blk.N.attn_norm.weight and HTTP 500. Fixing it requires correcting both block_count and nextn_predict_layers — correcting only the first makes the loader demand blk.N-1.nextn.eh_proj.weight instead. Four of six 27B artifacts were affected; all six now load.
Chat template Builds previously shipped {{ .Prompt }}, a raw passthrough: system prompts were silently discarded and tool calling was unavailable through Ollama. All tags now carry a real ChatML template with tool-call support.
Defaults num_ctx 32768 and num_predict 8192, uniform across every tag.
Quantization The ladder ships Q8_0; the 27B is also offered as Q4_K_M.

Corrections

Claims previously published here that did not hold up, withdrawn rather than quietly edited:

  • The V1.1a "86.7%, tied #2" composite and its 58-model leaderboard. Produced by an artifact that does not load, graded against two incorrect gold answers. Void.
  • GSM8K / IFEval / HellaSwag / WinoGrande / ARC figures. Measured on artifacts and precisions that are no longer what ships here.
  • "VRAM @ 262K = 14 GB." Measured at 18 GB.
  • "The 9B is a reasoning model, not a tool driver." False — it was true only while the artifact shipped no chat template.
  • "A small num_ctx truncates the tool schema out of the prompt." Incorrect. Ollama returns HTTP 400 for an oversized prompt; it does not truncate. Tool calling was verified working at 32768, 8192 and 7000.
  • A published table attributing a 1/12 tool-call result to num_ctx 8192. That figure came from a third party whose harness explicitly requested 65536. It was never measured at 8192, and the cause of that result remains unexplained.
  • :v1 described as a 5.6 GB Q4 artifact scoring 85.3%. The published :v1 is an 18 GB f16 build that has never been run against the corrected suite. No score is claimed for it.

Model profile — Base 9B

FieldValue
Parameters9.0B
Architectureqwen35 — Qwen3.5 hybrid family
Layer stack32 layers: 24 linear-attention + 8 full-attention
Native context262,144 tokens (default num_ctx 32,768)
Vocabulary248,320 tokens
QuantizationQ8_0
CapabilitiesCompletion · tool calling · thinking
RuntimeOllama 0.30.11 or newer

Lineage

StageProvenance
BaseQwen/Qwen3.5 — hybrid linear-attention generation
MergeOrnith-1.0-9B × Qwythos-9B — TIES, 0.5 / 0.5 (9B line)
TuneOrvyth identity + chip-calling; LoRA merged into the weights
BuildBuilt, converted and quantized in-house with Orvyth trainkit

OpenAI-compatible API

curl http://localhost:11434/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Orvyth/engrym-seed",
    "messages": [
      {
        "role": "user",
        "content": "..."
      }
    ]
  }'

What is in the artifact, and what is not

This is the bare seed brain: weights, identity, and tool-call generation. Memory, governed tool execution, safety enforcement, adapters, voices and multi-agent routing are Orvyth platform concerns and are not in the GGUF. Tool calling is an output capability — the host remains responsible for tool definitions, argument validation, authorization, execution and result delivery.

The Engrym line

TierDefinitionStatus
🌱 SEED≤27B class · runs localLive — Nano, Flash, Base, Pro.
🌊 EPOCH36B+ class · hostedIn training
⚖️ AXIOMLarger · hostedReserved / planned
Honest limits
ConstraintGround truth
EvidenceAll scores here are first-party and single-run. Public reproduction receipts are pending. Treat small gaps between adjacent models as unresolved.
TierSeed-tier is the fast, cheap, always-on layer. Route hard problems up-tier.
Context262,144 is the enforced native ceiling; larger requests are clamped, not honoured.
IdentityThe identity tune is light by design. Under a heavy external system prompt, behavior can defer toward the base model.
Reasoning budgetThese are reasoning models. A harness that caps output too low truncates mid-thought and returns prose with no tool call.
27B latencyThe 27B takes substantially longer per tool call than the 9B and smaller. Prefer Base or Flash for agent loops.
E buildsTool-loop specialists. Step-efficient, but measurably less temperature-robust and weaker on general knowledge than the stable line.
Speculative decodingThe base model's MTP head is not included in these builds.
Pin by digestTags are mutable. Pin the artifact digest for production and for evaluations.

ORVYTH

Intelligence. Governed.

Ground truth over hype. Prove before you claim.