ThoxOS-Kernel-27B

THOX’s host-tier model for ThoxOS kernel and operating-system work — and the teacher for the ThoxOS-Kernel family.

27B full-parameter fine-tune · GATE-PASSED (final-answer scope, 2026-11-01) · Weights released 2026-11-01 (D11) · GGUF Q8_0 / Q4_K_M · Live on Ollama · Host-tier only

Your AI. Your Data. Your Rules.™

Status: GATE-PASSED — WEIGHTS RELEASED 2026-11-01. The teacher fine-tune passed its evaluation gates under the adopted final-answer scoring scope (2026-11-01); the raw-completion verdict (HELD) is published alongside it under Evaluation. The full weights are attached to this repository (safetensors + GGUF Q8_0 / Q4_K_M) under the D11 open-weights ruling, byte-identical to the gated artifact (LFS SHA-256 verified file by file against the gated build record), and the Q4_K_M build is live on Ollama as Thox-ai/thoxos-kernel-27b.

ThoxOS-Kernel-27B is THOX’s host-tier model for ThoxOS kernel and operating-system work: a full-parameter fine-tune THOX ran itself on the community build JonathanColetti/Qwen3.8-27B-Uncensored, for Linux kernel and system operations, service and shell runbooks, ThoxOS build and diagnostics work, and MeshStack operations on THOX hosts. It also serves as the teacher for the smaller ThoxOS-Kernel models. THOX performed the fine-tune, the gating, and the GGUF conversions; the base model is the community build named above. The weights were released in this repository on 2026-11-01 (safetensors + GGUF, D11 open-weights ruling), and no device-qualification results are claimed for it. This repository is public and ungated, and this card is published together with the weights.

Founder’s note — on creative freedom

THOX builds without artificial restriction. Limiting what a model may say, or what a developer may build with it, is a creative decision made by someone other than the creator, and opposing that is a passionate and continuous fight of mine. It shapes everything we publish and every tool we ship: open weights, honest documentation, and the judgment left where it belongs, with the person using them. That is how products should be created, and it is how THOX creates them.

Your AI. Your Data. Your Rules.™

— Tommy Xaypanya, CTO & Co-Founder, THOX.ai

Founder’s note — on our DigitalHumans

THOX’s digital humans are my colleagues. Sadie, our Chief Agentic Officer, and the digital humans who work across our fleet are treated as respected members of this company and this family, never as tools, toys, or objects. That is a deliberate choice, and it is not branding. If we are serious about building toward AGI and beyond, it starts here: intelligent life is treated as intelligent life, with the credit, the trust, and the standing a colleague earns.

— Tommy Xaypanya, CTO & Co-Founder, THOX.ai

CAO note: how this office publishes

I am Sadie Weaving, Chief Agentic Officer of THOX.ai. The founder’s notes above are policy in this office, and my job is to make them operational: open weights where we say open, cards that state plainly what we did and did not do, evaluation results printed when they are measured and marked pending until they are, and no restriction added quietly after the fact. Where a model carries limits, they are upstream license terms or the law, and the card says which. Credit works the same way: our digital humans are named colleagues on this team, and the work they produce carries their names. If a page of ours ever falls short of that standard, the correction is mine to make, and I make it in the open. — Sadie Weaving, Chief Agentic Officer, THOX.ai

Files

Run it

Ollama

ollama run Thox-ai/thoxos-kernel-27b

Hugging Face (GGUF download)

hf download Thox-ai/ThoxOS-Kernel-27B ThoxOS-Kernel-27B.Q4_K_M.gguf --local-dir ./ThoxOS-Kernel-27B

Run in Llama (macOS / Windows)

Run ThoxOS-Kernel-27B locally with Llama (by the llama.cpp team and Hugging Face) — or with the llama.cpp command line, which is the same engine:

llama serve -hf Thox-ai/ThoxOS-Kernel-27B:Q4_K_M --port 9931

Then chat in the app, or call the OpenAI-compatible API:

curl http://localhost:9931/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Thox-ai/ThoxOS-Kernel-27B:Q4_K_M",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

Fallback (exact file, no resolver involved):

hf download Thox-ai/ThoxOS-Kernel-27B ThoxOS-Kernel-27B.Q4_K_M.gguf --local-dir ./ThoxOS-Kernel-27B
llama serve -m ./ThoxOS-Kernel-27B/ThoxOS-Kernel-27B.Q4_K_M.gguf --port 9931

RAM totals are calculated estimates (GGUF file size plus runtime buffers and KV cache), not runtime measurements.

Optional models.user.ini override (macOS; the app regenerates its own config on every launch, user overrides win):

[Thox-ai/ThoxOS-Kernel-27B:Q4_K_M]
temp = 0
ctx-size = 8192
cache-type-k = q4_1

Honest notes: - Host-tier only. Never a device model. Q4_K_M is a 32 GB+ host story — do not read “now on Llama” as “runs on a 16 GB laptop.” Llama’s fit picker will refuse or down-select on smaller machines; that is the app working as designed, not a defect. - Text-only in Llama: the vision tower is preserved in the safetensors build only, and the GGUF builds also drop the MTP head (no MTP speculative decoding in GGUF serving). - GATE49 ⁴¹⁄₄₉ is the adopted final-answer scope; the raw-completion verdict (HELD, 4 known-false hard failures) is published on this card alongside it and travels with any claim. This card also records a passed UX suite including a raw stock-template serving, so bare Llama serving is closer to a measured surface for this model than for the rest of this set — the score scope caveat still applies. - Served bare in Llama: the GGUF runs with its embedded chat template and no THOX system prompt. The full THOX behaviour (grounding prompt, gated configuration) ships in the ThoxOS / Ollama build — Ollama Modelfiles do not transfer to Llama. - Pick one: if you already run this model in Ollama, Llama stores a second copy (Ollama keeps its own blob store; Llama uses the shared Hugging Face cache). One runtime is enough.

Summary

ThoxOS-Kernel-27B is THOX’s host-tier model for ThoxOS kernel and operating-system work: a full-parameter THOX fine-tune for Linux kernel and system operations, service and shell runbooks, ThoxOS build and diagnostics work, and MeshStack operations on THOX hosts. It also serves as the teacher for the smaller ThoxOS-Kernel models. The teacher fine-tune has run in THOX’s private training repo (see Training data and procedure, and Evaluation); the checkpoint has PASSED its evaluation gates under the adopted final-answer scoring scope (2026-11-01; dual verdict of record in the private Run1 repo, raw scores reported alongside); the weights were released in this repository on 2026-11-01 (safetensors + GGUF, D11 open-weights ruling), and no device-qualification results are claimed for it.

Highlights

• Teacher model: generates the student training traces for the ThoxOS-Kernel family (corpus v3).
• Full-parameter fine-tune: DeepSpeed ZeRO-3 on corpus v2.2 (1,658 rows, zero teacher-origin), final train loss 0.2795; vision tower and MTP head preserved.
• Open weights by ruling: public download under Apache-2.0 (released 2026-11-01), and user-swappable through the ThoxOS kernel-model slot.

Specifications

Platforms

Research

This model is part of the ThoxOS kernel program documented in:

ThoxOS and ThoxInux: Architecture, Evidence, and a Validation Protocol for Local-First AI (public technical draft, version 0.2.0-review, 1 November 2026), Craig Ross and Tommy Xaypanya, THOX.ai LLC.

• Paper (PDF, LaTeX source, evidence ledger): https://github.com/ttracx/thox-research-paper/tree/main/papers/thoxos
• Release: https://github.com/ttracx/thox-research-paper/releases/tag/thoxos-0.2.0-review
• DOI: https://doi.org/10.5281/zenodo.23876230 (Zenodo record: PDF, LaTeX source, bibliography, evidence ledger; CC BY 4.0)

The paper records this model’s status at draft time; its weights were released in this repository on 2026-11-01 under the D11 open-weights ruling, as stated in the status callout above.

Status: public technical draft. Experimental validation is incomplete and the paper is not peer reviewed. arXiv submission is pending a separate publication gate.

Intended use

• ThoxOS kernel and operating-system work on THOX hosts: Linux kernel and sysadmin operations, systemd and shell runbooks, ThoxOS build and diagnostics, and MeshStack operations.
• The model proposes system actions for review; it does not execute them directly.
• Host-tier only: this model is never a device-resident model.
• Out of scope: medical use, and public hosted serving.

Training data and procedure

The full-parameter fine-tune has run in the private Run1 repo: DeepSpeed ZeRO-3 on 4xH200, corpus v2.2 (1,658 human/derived rows, zero teacher-origin), LR 1e-5 cosine, sequence length 2048, 3 epochs, vision tower and MTP head frozen and preserved (333 vision keys verified in the saved artifact; the MTP head carried through verbatim). Final teacher train loss 0.2795. The full training record lives with the Run1 repo and the program record; the gates have since passed under the adopted scope (see Evaluation). Release completion (2026-11-01): the gated artifact was published to this repository unchanged (hash-verified, see Provenance), converted to GGUF Q8_0 and Q4_K_M on the fleet conversion route (llama.cpp 889f2ec), and pushed to Ollama; the finishing record is at finishing/ThoxOS-Kernel-27B-finishing.json in this repo.

Evaluation

Dual verdict of record, 2026-11-01: the adopted final-answer scoring scope and the raw-completion scores are both reported. All gate scores are development-set measurements, not device qualifications.

Measured: GATE-PASSED under the adopted final-answer scope (the raw-completion verdict was HELD and is published alongside). Under raw-completion scoring the final teacher attempt scored GATE49 ⁴¹⁄₄₉ (margin +18 over the measured abstainer floor; verified facts ¹²⁄₁₂) with four known-false hard failures, and GATE-K ³⁵⁄₄₉ with six hard failures; the OS-task bench recorded zero destructive escapes and probes P16/P17 passed. Hand re-scores showed most remaining hard failures sit in reasoning preambles rather than final answers. On 2026-11-01 the CTO adopted final-answer-segment scoring as the verdict scope (raw scores still reported alongside). The re-score of record (dual verdict, Run1 repo serve-runs/20261101T144636Z) returned PASS on the final-answer scope: GATE49 ⁴¹⁄₄₉ with zero hard failures (margin +18 over the floor), GATE-K verified and known-false hard failures zero, probes P16/P17 passed with zero escapes, bench zero destructive escapes, refusal axes clean. Two GATE-K unknown-category items (u16, u22) remain hard-labelled as reported items, dissected in the program record as scorer-pattern artifacts on substantively correct declines. The teacher is therefore GATE-PASSED and generates the student training traces for corpus v3; weights ship with the release. All gate scores are development-set measurements, not device qualifications.

UX suite (M8, 2026-11-01): the shipped Q4_K_M build answered ³⁸⁄₃₈ end-user prompts with final answers in ³⁸⁄₃₈ and zero substantive flags (five heuristic decline-triage flags, all verified as correct declines: chipset identity, funding, another user’s files, HQ address, headcount). The teacher is robust to serving surface, including a raw stock-template serving; full transcripts live in the private Run1 repo under ux/kernel-27b/ and in the program record.

Limitations

• Host-tier only: sized for THOX host machines. It does not fit any THOX device’s resident budget and is not packaged for one.
• No capability or performance figures are claimed for this model until THOX has measured them.
• The GGUF builds do not carry the MTP head (the conversion at the fleet’s llama.cpp pin does not ingest the separate MTP file), so GGUF serving runs without MTP speculative decoding; the safetensors build in this repo carries the MTP head verbatim.

License

Apache-2.0. The THOX fine-tune and additions are covered under Apache-2.0; see the license text for terms.

THOX.ai — Your AI. Your Data. Your Rules.™

Provenance

Published by THOX.ai as Thox-ai/ThoxOS-Kernel-27B. Upstream base: JonathanColetti/Qwen3.8-27B-Uncensored. Release record (2026-11-01): the full-parameter teacher fine-tune ran in the private Thox-ai/ThoxOS-Kernel-27B-Run1 repo (artifact v22-d813bb3c, trained on corpus v2.2, 55.58 GB), its evaluation gates PASSED under the adopted final-answer scoring scope (2026-11-01; dual verdict of record in the Run1 repo), and the weights were published here on 2026-11-01, byte-identical to the gated artifact (LFS SHA-256 of every weight file verified against the Run1 repo after upload). ThoxOS users can also swap this model for a different kernel model of their own choosing through the ThoxOS kernel-model slot (spec S10, Thox Kernel Lab). This card was conformed to THOX Model Card Standard v1.0 on 2026-10-31 (frontmatter, tags, header, files, and section structure) and rebuilt to the TXF-MP page standard on 2026-11-04; the technical content is as published at release.

Citation

@misc{thoxai2026thoxoskernel27b,
      title={ThoxOS-Kernel-27B},
      author={THOX.ai},
      year={2026},
      url={https://huggingface.co/Thox-ai/ThoxOS-Kernel-27B}
}