238 Downloads Updated yesterday
ollama run Orvyth/engrym-seed:v1.1a
Updated yesterday
yesterday
c88b3413f937 · 9.5GB ·
Orvyth's seed-tier brain — a local model family for tool-using agents.
Seed runs local; Epoch and Axiom are hosted tiers.
Not a chatbot. A substrate.
ollama run Orvyth/engrym-seed
Pulled before 2026-08-09? Re-pull. Ollama does not refresh a tag it already holds, and every tag was rebuilt: a real chat template (older builds shipped a raw passthrough that silently discarded system prompts and made tool calling unavailable), a sane default context, and a header repair that fixed artifacts which would not load at all.
| Tag | Class | Size | 77-task | Tool calls | Notes |
|---|---|---|---|---|---|
:nano · :nano-v1g2 | Seed Nano 2B | 2.1 GB | 90.8/143 | 12/12 | Micro / edge. |
:flash · :flash-v1g2 | Seed Flash 4B | 4.6 GB | 124/143 | 12/12 | Fastest to act. Strong value. |
:base · :base-v1.2ag1 · :latest | Seed Base 9B | 9.5 GB | 131/143 | 12/12 | Recommended download. |
:pro-27b-q4 | Seed Pro 27B v2 (Q4_K_M) | 16.5 GB | 134/143 | 12/12 | 27B class, smaller download. |
:pro · :pro-v1g2 | Seed Pro 27B v2 (Q8_0) | 28.6 GB | 134/143 | 12/12 | Largest stable artifact. |
:v1 | Legacy V1 9B (f16) | 18 GB | not measured | — | Historical. Superseded. |
-e tags are the staging channel: internal evaluation, never :latest,
published so results can be reproduced rather than because they are finished. "E" builds are
trained on multi-step tool loops — their advantage is step efficiency (reaching a goal in
fewer tool calls), not raw knowledge.
| Tag | Artifact | Size | 77-task | Tool calls |
|---|---|---|---|---|
:pro-e | Pro-E 27B | 28.6 GB | 137/143 | 12/12 |
:pro-e-v2 | Pro-E 27B v2 merged | 28.6 GB | not measured | — |
:pro-e-v2-text | Pro-E 27B v2 text-only | 28.6 GB | not measured | — |
:pro-e-9b | Pro-E 9B (archived early attempt) | 9.5 GB | 105/143 | 12/12 |
These are first-party numbers. One ruleset applied identically to every row: 77 tasks · 143
points · temperature=0 · max_tokens=16384 · seed=42 · one
attempt per task · deterministic validators · no LLM judge. Runner: Ollama on a single
NVIDIA B200. Scores are bound to the exact published blobs, not to an internal build.
Read these as single-run figures, not a ranking. Each row is one run. We have measured meaningful run-to-run variation on this suite — a task timeout that fires under load can cost a large model double-digit points — so differences of a few points between adjacent rows are not evidence that one model is better than another. A repeated-run study is in progress and these numbers will be restated with spread when it completes. Public reproduction receipts are pending.
| Artifact | Score | Percent |
|---|---|---|
Pro-E 27B :pro-e | 137.0 / 143 | 95.8% |
Pro 27B v2 :pro / :pro-27b-q4 | 134.0 / 143 | 93.7% |
Base 9B :base | 131.0 / 143 | 91.6% |
Flash 4B :flash | 124.0 / 143 | 86.7% |
Pro-E 9B :pro-e-9b | 105.0 / 143 | 73.4% |
Nano 2B :nano | 90.8 / 143 | 63.5% |
Every score above was produced with one terse system prompt at the model's default effort. Asking a model to work deliberately — reason step by step, verify against every constraint, then answer — recovers points on tasks it otherwise fails. Measured by retrying only the failed tasks under a deliberate-mode prompt:
| Artifact | Default | Deliberate | Gain |
|---|---|---|---|
:pro-e | 137 | 137 | +0 |
:pro / :pro-27b-q4 | 134 | 137 | +3 |
:base | 131 | 134 | +3 |
:flash | 124 | 130 | +6 |
:pro-e-9b | 105 | 117 | +12 |
:nano | 90.8 | 102.6 | +11.8 |
The gain is largest for the smallest models. Pro-E gains nothing because it already deliberates by default; Nano gains twelve points because it answers quickly unless told otherwise. If you want accuracy over latency, say so in your system prompt — it is worth more than a model upgrade on the small end.
Tested through Ollama's /api/chat tools interface with a 45-tool schema and a
full agent system prompt, across three scenarios, 12 trials each. A trial passes only if the
response populates tool_calls; prose describing the action counts as a failure.
Every published build scored 12/12, in both a 2-tool short-prompt profile and the 45-tool
profile.
Native context is 262,144 tokens. Larger requests are silently clamped: ask for
524,288 and Ollama logs requested context size too large for model, n_ctx_train=262144
and gives you 262,144. There is no 512K mode — that would require RoPE extension and retraining.
num_ctx | Base 9B footprint |
|---|---|
| 8,192 | 9.0 GB |
| 16,384 | 9.2 GB |
| 32,768 (shipped default) | 9.8 GB |
| 65,536 | 11 GB |
| 131,072 | 13 GB |
| 262,144 (native max) | 18 GB |
Context is cheap here because most layers are linear-attention: 32× the window for roughly 2× the memory. The default is 32,768 rather than the native maximum because defaulting to 262,144 made a 9.5 GB model request roughly 19 GB of RAM just to start, and the 27B would not load at all on a 32 GB machine.
If your prompt exceeds num_ctx, Ollama returns HTTP 400
(request (N tokens) exceeds the available context size) — it does not silently drop
part of your prompt. A 45-tool schema plus an agent system prompt is roughly 6–8k tokens, so it
fits comfortably at the shipped default. Raise num_ctx for long conversation
histories, not for tool schemas.
Defaults are per class, chosen from measured temperature sensitivity rather than a single house value.
| Setting | Nano · Flash · Base · Pro | E builds |
|---|---|---|
temperature | 0.2 | 0.1 |
top_p | 0.9 | 0.9 |
top_k | 20 | 20 |
num_ctx | 32768 | 32768 |
num_predict | 8192 | 8192 |
stop | <|im_end|>, <|im_start|> | |
The E builds run cooler because the tools-trained line is measurably less temperature-robust: it
loses roughly 13 points between temperature 0 and 1.0, where the plain Base line holds within a few
points. Benchmarks are run at temperature=0.
| Fix | What it was |
|---|---|
| Artifacts that would not load |
Several builds declared one more transformer block than they contained, failing with
missing tensor blk.N.attn_norm.weight and HTTP 500. Fixing it requires correcting
both block_count and nextn_predict_layers — correcting only
the first makes the loader demand blk.N-1.nextn.eh_proj.weight instead. Four of
six 27B artifacts were affected; all six now load.
|
| Chat template |
Builds previously shipped {{ .Prompt }}, a raw passthrough: system prompts were
silently discarded and tool calling was unavailable through Ollama. All tags now carry a real
ChatML template with tool-call support.
|
| Defaults | num_ctx 32768 and num_predict 8192, uniform across every tag. |
| Quantization | The ladder ships Q8_0; the 27B is also offered as Q4_K_M. |
Claims previously published here that did not hold up, withdrawn rather than quietly edited:
num_ctx truncates the tool schema out of the prompt." Incorrect. Ollama returns HTTP 400 for an oversized prompt; it does not truncate. Tool calling was verified working at 32768, 8192 and 7000.num_ctx 8192. That figure came from a third party whose harness explicitly requested 65536. It was never measured at 8192, and the cause of that result remains unexplained.:v1 described as a 5.6 GB Q4 artifact scoring 85.3%. The published :v1 is an 18 GB f16 build that has never been run against the corrected suite. No score is claimed for it.| Field | Value |
|---|---|
| Parameters | 9.0B |
| Architecture | qwen35 — Qwen3.5 hybrid family |
| Layer stack | 32 layers: 24 linear-attention + 8 full-attention |
| Native context | 262,144 tokens (default num_ctx 32,768) |
| Vocabulary | 248,320 tokens |
| Quantization | Q8_0 |
| Capabilities | Completion · tool calling · thinking |
| Runtime | Ollama 0.30.11 or newer |
| Stage | Provenance |
|---|---|
| Base | Qwen/Qwen3.5 — hybrid linear-attention generation |
| Merge | Ornith-1.0-9B × Qwythos-9B — TIES, 0.5 / 0.5 (9B line) |
| Tune | Orvyth identity + chip-calling; LoRA merged into the weights |
| Build | Built, converted and quantized in-house with Orvyth trainkit |
curl http://localhost:11434/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "Orvyth/engrym-seed",
"messages": [
{
"role": "user",
"content": "..."
}
]
}'
This is the bare seed brain: weights, identity, and tool-call generation. Memory, governed tool execution, safety enforcement, adapters, voices and multi-agent routing are Orvyth platform concerns and are not in the GGUF. Tool calling is an output capability — the host remains responsible for tool definitions, argument validation, authorization, execution and result delivery.
| Tier | Definition | Status |
|---|---|---|
| 🌱 SEED | ≤27B class · runs local | Live — Nano, Flash, Base, Pro. |
| 🌊 EPOCH | 36B+ class · hosted | In training |
| ⚖️ AXIOM | Larger · hosted | Reserved / planned |
| Constraint | Ground truth |
|---|---|
| Evidence | All scores here are first-party and single-run. Public reproduction receipts are pending. Treat small gaps between adjacent models as unresolved. |
| Tier | Seed-tier is the fast, cheap, always-on layer. Route hard problems up-tier. |
| Context | 262,144 is the enforced native ceiling; larger requests are clamped, not honoured. |
| Identity | The identity tune is light by design. Under a heavy external system prompt, behavior can defer toward the base model. |
| Reasoning budget | These are reasoning models. A harness that caps output too low truncates mid-thought and returns prose with no tool call. |
| 27B latency | The 27B takes substantially longer per tool call than the 9B and smaller. Prefer Base or Flash for agent loops. |
| E builds | Tool-loop specialists. Step-efficient, but measurably less temperature-robust and weaker on general knowledge than the stable line. |
| Speculative decoding | The base model's MTP head is not included in these builds. |
| Pin by digest | Tags are mutable. Pin the artifact digest for production and for evaluations. |
ORVYTH
Intelligence. Governed.
Ground truth over hype. Prove before you claim.