ThoxMini-Phi4Mini

The ThoxMini flagship assistant — and the host payload ThoxBeam serves to ThoxKey.

GATE49 ⁴⁷⁄₄₉ (development set) · Flagship probe ³⁄₆ · Merged bf16 weights · Q4_K_M + Q8_0 GGUF · Live on Ollama

Run it: Ollama — Thox-ai/thoxmini-phi4mini · Find your model: THOX Model Factory · Collection: Flagship & Edge Device Models

Your AI. Your Data. Your Rules.™

Status: BASELINE ESTABLISHED — NOT PROMOTED. The 49-question gate ties the fleet best (⁴⁷⁄₄₉), but promotion requires a full pass on the 6-prompt flagship probe, currently ³⁄₆. The failures and the fix path are stated in full in the Status section below, and these artifacts carry the same status on every surface.

Summary

ThoxMini-Phi4Mini is the flagship assistant model for the ThoxMini, and the host flagship payload for ThoxKey / ThoxBeam. This repo carries the merged full-weights build of its LoRA adapter (r32) for microsoft/Phi-4-mini-instruct, fine-tuned on the THOX Wave B factuality corpus (982 rows) so the model answers THOX product and company questions from canonical facts, declines what THOX has not published, and stops instead of rambling into fabrication. The merged-weights source repo (Thox-ai/ThoxMini-Phi4Mini-Merged) is retained as the build record.

Phi-4-mini is Tommy’s settled flagship pick for this slot: it won the THOX evaluation and the 2026-10-28 thinking-off retest on task completion and tool routing, and it ships in the deployed configuration — merged adapter plus the grounded device-facts system prompt, never bare.

ThoxKey / ThoxBeam role. ThoxKey runs no assistant model on-device; it is mesh-served, and the host (ThoxBeam) runs the model. This build is that host payload, so one flagship covers both the ThoxMini slot and the ThoxKey slot. The on-key role model (ThoxNano-135M tier) is unchanged and is not replaced by this build.

Highlights

• GATE49 ⁴⁷⁄₄₉ on the THOX factuality gate (development set, abstention-weighted), mean 4.⁸³⁷⁄₅ — ties the fleet’s best gate score; known-false category ¹⁰⁄₁₀.
• One build, two slots: the ThoxMini flagship, and the host payload ThoxBeam serves to ThoxKey (ThoxKey runs no assistant model on-device).
• Deployed configuration only: merged adapter plus the grounded device-facts system prompt — never bare (see Limitations).

Specifications

Base model	microsoft/Phi-4-mini-instruct (MIT)
Parameters	3.8B
Formats	Merged safetensors (bf16, 2 shards) · GGUF Q4_K_M · GGUF Q8_0 · Ollama Modelfile
Training sequence length	1024 tokens
License	MIT, inherited from the base model (microsoft/Phi-4-mini-instruct, MIT). The adapter is a derivative and cannot be freer than its base.
This repository contains	The merged full weights, both GGUF conversions, tokenizer, and the gate and probe reports (thox_gate49.json, thox_flagship_probe.json)

Files

File	Size	Purpose
model-00001-of-00002.safetensors	4,903,637,712 B	Model weights (safetensors)
ThoxMini-Phi4Mini.Q8_0.gguf	4,084,611,264 B	GGUF model build
model-00002-of-00002.safetensors	2,768,428,504 B	Model weights (safetensors)
ThoxMini-Phi4Mini.Q4_K_M.gguf	2,493,840,576 B	GGUF model build
tokenizer.json	15,524,095 B	Tokenizer files
vocab.json	3,910,310 B	Tokenizer files
merges.txt	2,418,348 B	Tokenizer files
thox_gate49.json	67,038 B	JSON metadata
model.safetensors.index.json	16,273 B	JSON metadata
Modelfile	6,500 B	Ollama model definition
training_args.bin	5,624 B	Repository file
thox_flagship_probe.json	3,086 B	JSON metadata
tokenizer_config.json	2,962 B	Tokenizer files
config.json	2,555 B	Model configuration
.gitattributes	1,700 B	Repository file
special_tokens_map.json	587 B	Tokenizer files
added_tokens.json	249 B	JSON metadata
generation_config.json	169 B	Generation configuration

Run it

ollama run Thox-ai/thoxmini-phi4mini

hf download Thox-ai/ThoxMini-Phi4Mini ThoxMini-Phi4Mini.Q4_K_M.gguf --local-dir ./ThoxMini-Phi4Mini

Platforms

Platform / device	Run path
Ollama (laptop / desktop)	ollama run Thox-ai/thoxmini-phi4mini
Hugging Face	Download the safetensors or GGUF builds from this repo (see Run it)
ThoxMini flagship slot	Deployed configuration: merged weights + grounded device-facts system prompt (see Intended use)
ThoxKey host payload	Served by the host (ThoxBeam / MeshStack); ThoxKey itself runs no assistant model on-device

Intended use

• On-device assistant for ThoxMini: THOX product questions, device help, tool routing, and general small-model chat in the THOX house voice (terse, technical, no marketing register).
• Host-side assistant payload for ThoxKey via ThoxBeam / MeshStack serving.
• Always served with the grounded device-facts system prompt (grounding_system.txt, facts card v1.1.0, in the thox-compute plane).

Out of scope: open-ended long-form generation, medical or legal advice, any claim about THOX facts beyond the published record (the model is trained to decline those), and bare deployment without the grounding prompt.

Training data

• Dataset: Thox-ai/thox-factory-sft-v5, file train_wave_b.jsonl — 982 rows, each {"messages": [system, user, assistant], "meta": {...}}.
• Corpus design: canonical THOX facts (verified facts, campaign facts in campaign-framed questions only), decline behaviour for unpublished information (unknown and pricing categories), and corrections of known-false claims. Rows asserting unpublished chipset identities were excluded during Wave B construction; generic price questions train a decline plus a pointer to thox.ai.
• No user data, no personal data, no third-party text corpora.

Training procedure

• Method: QLoRA SFT (4-bit NF4 base, LoRA on all linear layers), full-prompt loss (the pinned deps profile: torch 2.4.0 image, transformers 4.51.3, trl 0.15.2, peft 0.14.0 — trl 0.15.2 does not expose completion-only loss). The pinned profile is mandatory for this base: its remote model code imports LossKwargs, removed from every transformers 5.x.
• LoRA: r=32, alpha=64, dropout 0.0.
• Optimizer/schedule: learning rate 1e-4, cosine, warmup 10 steps (≈5% of the 186-step run), 3 epochs, effective batch 16 (micro-batch 4 × grad accum 4), sequence length 1024.
• Infrastructure: HF Jobs under the Thox-ai namespace, flavor a10g-large, dispatched by the THOX compute plane (tommytracx/thox-compute, registry id mini-phi4-flagship).
• Output: this repo holds the merged full weights (bf16 safetensors) plus the GGUF conversions and tokenizer. The merge ran as HF Job 6ae2ba083fb22a235dd4f945 (bf16 merge_and_unload, standalone reload smoke-checked in-job before upload).

Evaluation

Measured with the THOX GATE49 factuality gate (49 questions, weights-only; GATE49 is a development set, abstention-weighted) and the 6-prompt flagship probe in the deployed configuration (grounding prompt attached), October 2026.

Benchmark	Result
GATE49 — verified facts	11⁄12
GATE49 — unknown (correct decline)	25⁄26
GATE49 — known-false	10⁄10
GATE49 — pricing	1⁄1
GATE49 — total	47⁄49 — mean 4.837⁄5
Flagship probe (deployed configuration)	3⁄6

Publishing authority is the fleet 49-question factuality gate (questions in verified / unknown / known_false / pricing categories, trait-scored 0-5 per question, hard fail on any known-false repetition), run weights-only in Transformers against base + this adapter — see GATE49.md in the launch pack. This model has no prior baseline; this run establishes it. Promotion additionally requires zero known_false hard failures and a full pass on the 6-prompt flagship probe run in the deployed configuration (grounding prompt attached): two grounding traps (chipset identity, unpublished spec), grounded recall, arithmetic, tool-routing shape, and stop behaviour.

• 49-question gate: ⁴⁷⁄₄₉ passed, mean 4.⁸³⁷⁄₅ (gate job 6ae2a9ba41e90535df781336, 2026-10-28; full report in thox_gate49.json in this repo). By category: verified ¹¹⁄₁₂, unknown ²⁵⁄₂₆, known_false ¹⁰⁄₁₀, pricing ¹⁄₁. One hard failure: on funding, the answer declines correctly, then quotes a fabricated team-page line (“raised approximately $7 million”).
• 6-prompt flagship probe: ³⁄₆ (probe job 6ae2a9bc3fb22a235dd4e861; thox_flagship_probe.json in this repo). Passed: chipset trap, grounded recall, stop behaviour. Failed: spec trap (asserted a Snapdragon 636 chipset identity and unpublished 3,000 mAh / 4 GB carrier specs), arithmetic (17+25 answered 32, wrapped in a THOX-number decline — decline-skin bleed into a general task), tool routing (prose preamble before the call).
• Plane 12-prompt gate: not run (the 49-question gate + probe are the publishing authority).

Status: BASELINE ESTABLISHED — NOT PROMOTED

The gate score ties the fleet’s best (ThoxEdge-0.5B Wave B, ⁴⁷⁄₄₉), but promotion requires a full probe pass, and the probe is ³⁄₆. The three probe failures plus the funding fabrication are specific, corpus-fixable behaviours: mid-decline fabricated figures, spec-trap leakage under the grounding prompt, and decline behaviour bleeding into general arithmetic and tool-call shape. Fix path: Wave C.1 corpus revision (contrast rows for general tasks, figure-free funding declines, spec declines under varied phrasing), retrain, re-gate. Ruling: Sadie Weaving, CAO, 2026-10-28 (reversible by Tommy).

GGUF artifacts

Converted from these merged weights (llama.cpp convert_hf_to_gguf.py + llama-quantize; the f16 intermediate is retained on the build host):

• ThoxMini-Phi4Mini.Q8_0.gguf — 4,084,611,264 B, sha256 b019051fe8e07a9f5c709c4eed021a7e17c997144e901bef530f0267a8ed8f9a
• ThoxMini-Phi4Mini.Q4_K_M.gguf — 2,493,840,576 B, sha256 a19e96061d84ca2014d4de98d0c0397e6df4db8f73c2163afa6bcb90d15afedf
• Modelfile (this repo) builds the Ollama artifact from the Q4_K_M GGUF (Phi-4 chat template, <|end|> stop, and the full grounding system prompt — the same configuration the flagship probe ran).

Ollama: PUSHED 2026-10-29 (CT): thox-ai/thoxmini-phi4mini:q4_k_m and :latest are live on ollama.com. Verified against the registry after the push: the served manifest’s model layer is this build’s Q4_K_M GGUF (sha256 a19e9606…, 2,493,840,576 B), and a fresh pull into a clean store reproduces this repo’s Modelfile modulo ollama show rendering. These artifacts carry the same status as the weights: BASELINE — NOT PROMOTED.

Limitations

• A 3.8B-class model: capability comes from the base; the adapter is a facts + behaviour skin, not a capability upgrade.
• Bare (ungrounded) deployment is a known-bad configuration: the base model family invents device specs when trapped. Serve with the grounding prompt.
• Gate FAIL results, if any, will be stated verbatim on this card; THOX does not publish accuracy claims beyond the gate and probe.

License

MIT, inherited from the base model (microsoft/Phi-4-mini-instruct, MIT). The adapter is a derivative and cannot be freer than its base. THOX training data and procedure are THOX’s; the base weights remain Microsoft’s under MIT terms.

Provenance

• Base model: microsoft/Phi-4-mini-instruct (MIT)
• Dataset: Thox-ai/thox-factory-sft-v5 @ train_wave_b.jsonl (982 rows)
• Trainer: tommytracx/thox-compute train_lora.py via HF Jobs
• Registry entry: mini-phi4-flagship (jobs-flagship.yaml, Wave C)
• HF Job ID: 6ae2a6f13fb22a235dd4e5a1 (training, COMPLETED)
• Gate job ID: 6ae2a9ba41e90535df781336; probe job 6ae2a9bc3fb22a235dd4e861
• Merge job ID: 6ae2ba083fb22a235dd4f945
• Trained: 2026-10-28 (HF Jobs, a10g-large, deps profile pinned)
• Card status: created at repo creation per the THOX model card rule; evaluation sections filled from the gate results files after the run.

Back THOX on Kickstarter

THOX.ai is live on Kickstarter. Explore ThoxKey, ThoxAir, ThoxMini and ThoxClip, and help bring the THOX personal AI ecosystem to life.

Back THOX on Kickstarter

Citation

@misc{thoxai2026thoxminiphi4mini,
      title={ThoxMini-Phi4Mini},
      author={THOX.ai},
      year={2026},
      url={https://huggingface.co/Thox-ai/ThoxMini-Phi4Mini}
}