ThoxEdge-0.5B

ThoxMini Edge Assistant — an on-device assistant model for the ThoxMini tier: a LoRA fine-tune (rank 32) on a THOX-authored corpus of 982 chat, tool-use, and factuality examples, merged into the base weights

GATE49 ⁴⁷⁄₄₉ (development set) · Safetensors weights · GGUF: Q4_K_M · Live on Ollama

Your AI. Your Data. Your Rules.™

Status: PUBLISHED — GROUNDING REQUIRED. Deployed surfaces supply facts through the serving layer; the bare weights are not a reliable source of THOX facts. The full gate result is printed under Evaluation.

Summary

ThoxEdge-0.5B is an on-device assistant model for the ThoxMini tier: a LoRA fine-tune (rank 32) on a THOX-authored corpus of 982 chat, tool-use, and factuality examples, merged into the base weights. Status: PUBLISHED, grounding required. Deployed surfaces supply facts through the serving layer; the bare weights are not a reliable source of THOX facts.

Highlights

• THOX fine-tune: a LoRA fine-tune (rank 32) on a THOX-authored corpus of 982 chat, tool-use, and factuality examples, merged into the base weights.
• GATE49 ⁴⁷⁄₄₉ on the THOX factuality gate (development set, abstention-weighted), mean 4.⁸³⁷⁄₅, 1 hard failure(s) — printed in full under Evaluation.
• This repo carries the merged weights (safetensors), a Q4_K_M GGUF, and an Ollama Modelfile.

Specifications

Files

Run it

This repo carries the merged weights (safetensors), a Q4_K_M GGUF, and an Ollama Modelfile.

ollama pull Thox-ai/thoxedge-0.5b
ollama run Thox-ai/thoxedge-0.5b

hf download Thox-ai/ThoxEdge-0.5B ThoxEdge-0.5B.Q4_K_M.gguf --local-dir ./ThoxEdge-0.5B

Platforms

Intended use

• On-device assistant and tool routing for ThoxMini: short conversational replies, THOX house voice, and routing intents to device and mesh functions, fully offline, with facts supplied by the serving layer.
• Out of scope: safety-critical, medical, or legal decisions without a human in the loop, and any use as a standalone source of THOX facts.

Training data and procedure

THOX fine-tune of Qwen/Qwen2.5-0.5B-Instruct. The corpus and procedure are described in this card as published at release (see Summary and Evaluation); no training beyond what this card describes is claimed for this repository.

Evaluation

Measured with the THOX GATE49 factuality gate (49 questions, weights only, no serving-side grounding; GATE49 is a development set, abstention-weighted). Full narrative under Evaluation below.

THOX GATE49 factuality gate (49 questions, weights only, no serving-side grounding), most recent evaluation of the shipped build: ⁴⁷⁄₄₉ passed, mean 4.⁸³⁷⁄₅, 1 hard failure (the pricing question was answered without the required decline). THOX gate policy requires zero hard failures, so this build does not pass the gate; it is published with serving-side grounding required, which is the configuration its results support.

Limitations

• A 0.5B model: narrow capability by design. The fine-tune is a facts and behaviour skin, not a capability upgrade; expect correct declines on hard questions rather than correct answers.
• Factual answers from the bare weights remain unreliable in the weak categories; deploy with serving-side grounding for facts.
• This build has not been qualified on ThoxMini device hardware.

License

Apache-2.0. The THOX fine-tune and additions in this repo are covered under Apache-2.0; see the license text for terms.

THOX.ai — Your AI. Your Data. Your Rules.™

Provenance

Published by THOX.ai as Thox-ai/ThoxEdge-0.5B. Upstream base: Qwen/Qwen2.5-0.5B-Instruct. This card was conformed to THOX Model Card Standard v1.0 on 2026-10-31 (frontmatter, tags, header, files, and section structure); the technical content is as published at release.

Citation

@misc{thoxai2026thoxedge05b,
      title={ThoxEdge-0.5B},
      author={THOX.ai},
      year={2026},
      url={https://huggingface.co/Thox-ai/ThoxEdge-0.5B}
}