7 3 weeks ago

Dizel 1.5 is an experimental Qwen2-based language model, developed for research and local inference. The checkpoints are experimental and may produce incorrect, incomplete or inconsistent responses.

ollama run D4niel-dev/Dizel-1.5

Details

3 weeks ago

f4c261239b10 · 1.1GB

qwen2
·
557M
·
F16
{{- if .System }}<|system|>{{ .System }}<|end|>{{ end }} {{- range .Messages }}{{ if eq .Role "user"
{ "num_ctx": 2048, "stop": [ "<|end|>", "</s>" ], "temperature": 0.7

Readme

Dizel 1.5

Experimental · ~455M parameters · F16 GGUF · 2,048-token context

Dizel 1.5 is a small, from-scratch causal language model by D4niel-dev, packaged for local inference with Ollama and llama.cpp. It is a research preview, not a production assistant.

Architecture note: the GGUF uses the qwen2 architecture identifier so it can run in Ollama and llama.cpp. Dizel 1.5 is not a Qwen model or a Qwen fine-tune. Qwen2.5-0.5B-Instruct was used only as a teacher for LoRA distillation; the student weights, vocabulary, and identity are Dizel’s.

Quick start

ollama run D4niel-dev/Dizel-1.5

The first run downloads the F16 model (~1.1 GB). This release was tested with Ollama 0.34.0; use a current release, since older versions may not support the multi-turn .Messages template shown below.

>>> Hello!
>>> Explain what a for loop does in one paragraph.

If the model starts repeating, press Ctrl+C, lower temperature, and raise repeat_penalty (see Settings).

At a glance

Field Value
Model Dizel 1.5 (v1.5.0)
Creator D4niel-dev
Status Experimental preview
Parameters ~455M unique (454,779,904)
Ollama parameter display 557.18M serialized tensor elements
Architecture Dense decoder-only Transformer, Qwen2-compatible GGUF layout
Layers 28
Hidden size 1,024
Attention 16 heads, 8 KV heads (GQA), head dim 64
Feed-forward SwiGLU, 3,072
Normalization RMSNorm (eps=1e-6)
Position encoding RoPE, theta 10,000
Context length 2,048 tokens
Vocabulary 100,000 SentencePiece BPE tokens, byte fallback
Modalities Text only
Quantization F16
Model size ~1.1 GB
License Apache-2.0 (model weights)

Ollama displays 557.18M parameters because the tied input/output embedding is serialized twice in the GGUF. The model has 454,779,904 unique parameters (~455M). The source GGUF files are 1.04 GiB (1,116,875,808 bytes) each; the published Ollama package is about 1.1 GB.

Intended use

Dizel 1.5 is intended for:

  • Local experiments with a small from-scratch language model.
  • Testing the Dizel training, conversion, and Ollama packaging pipeline.
  • Offline demos, education, and prompt-format experiments.
  • Comparing checkpoints and generation settings.

It is not intended for:

  • Production or customer-facing use.
  • Medical, legal, financial, safety-critical, or other high-stakes decisions.
  • Autonomous agents, tool execution, or unattended code generation.
  • Processing personal, confidential, or regulated data.
  • Any use where a wrong or fabricated answer could cause harm.

Prompt format

Dizel 1.5 was trained with literal role markers. The format is:

<|system|>You are Dizel, a helpful assistant.<|end|><|user|>Hello!<|end|><|assistant|>

The assistant response should end with <|end|>. The special tokens are:

Token ID Purpose
<|system|> 6 system turn
<|user|> 4 user turn
<|assistant|> 5 assistant turn
<|end|> 8 turn terminator
</s> 2 end of sequence
<s> 1 beginning of sequence

Do not use ChatML (<|im_start|>), Llama headers, or [INST] formatting. Those formats were not used during training and will produce poor results.

Build locally from a GGUF

If you have an F16 GGUF, create an Ollama model with the template and parameters below. The FROM path is relative to the Modelfile.

FROM ./Dizel-1.5-f16.gguf

TEMPLATE """{{- if .System }}<|system|>{{ .System }}<|end|>{{ end }}
{{- range .Messages }}{{ if eq .Role "user" }}<|user|>{{ .Content }}<|end|>{{ else if eq .Role "assistant" }}<|assistant|>{{ .Content }}<|end|>{{ end }}{{ end }}
{{- if .Prompt }}<|user|>{{ .Prompt }}<|end|>{{ end }}<|assistant|>"""

PARAMETER stop <|end|>
PARAMETER stop </s>
PARAMETER temperature 0.7
PARAMETER top_p 0.9
PARAMETER num_ctx 2048

Save it as Modelfile, then run:

ollama create dizel-1.5 -f Modelfile
ollama run dizel-1.5

The published Ollama tag uses this exact template and these parameters. If you build from one of the repository GGUFs, replace ./Dizel-1.5-f16.gguf with the actual filename (Dizel-SFT.gguf or Dizel-Distill.gguf).

Settings

These are the published defaults plus practical tuning tips:

Setting Published default Notes
temperature 0.7 Lower values reduce rambling.
top_p 0.9 Nucleus sampling.
num_ctx 2048 Maximum context; do not exceed.
stop <|end|>, </s> Required; both are stop sequences.
num_predict unset Try 256 to cap rambling output.
repeat_penalty unset Try 1.15; raise toward 1.2–1.35 if it loops.

The model has a known repetition failure mode. A repetition penalty can help, but setting it too high may make the answer worse. Start conservatively and compare outputs at a fixed seed.

API examples

Python, using the Ollama Python library:

from ollama import chat

response = chat(
    model="D4niel-dev/Dizel-1.5",
    messages=[
        {"role": "system", "content": "You are Dizel. Answer concisely."},
        {"role": "user", "content": "Hello!"},
    ],
)
print(response.message.content)

cURL:

curl http://localhost:11434/api/chat -d '{
  "model": "D4niel-dev/Dizel-1.5",
  "messages": [{"role": "user", "content": "Hello!"}],
  "stream": false
}'

For raw completions, send the prompt format above to /api/generate.

Files and release status

Artifact Format Size Status
D4niel-dev/Dizel-1.5:latest F16 GGUF ~1.1 GB Published Ollama tag
Dizel-SFT.gguf F16 GGUF 1.04 GiB Repository source artifact
Dizel-Distill.gguf F16 GGUF 1.04 GiB Repository source artifact

This release is F16 only. Q4_K_M, Q8_0, and other quantized tags are not published. Do not assume a Q4/Q8 artifact exists; third-party quantizations are unofficial and have not been verified for this release.

A technical note for people inspecting GGUF metadata: some older local F16 builds contain a stale general.file_type=2 value. The tensor data is F16/F32, and the published Ollama tag reports F16. That metadata value does not indicate a Q4 release.

Training

Dizel 1.5 is a dense model trained from scratch on a curated corpus of roughly 378M tokens (code, math, general text, and safety data).

Phase Description
A.1 General pretraining, 15K steps
A.2 Reasoning/code emphasis, 5K steps
B.1 Supervised fine-tuning, 10K steps
C.1/C.2 LoRA distillation from Qwen2.5-0.5B-Instruct
  • Tokenizer: 100K SentencePiece BPE with byte fallback.
  • Context: 2,048 tokens; the model was not trained for longer contexts.
  • Alignment: SFT and LoRA distillation. DPO remains experimental and is not part of this release.
  • Training data: D4niel-dev/Dizel-Datasets.
  • Teacher: Qwen2.5-0.5B-Instruct (Apache-2.0), used for behavior/quality distillation only. Dizel keeps its own identity and does not share Qwen’s weights.

Evaluation and known limitations

No standardized benchmark results are published for Dizel 1.5. It is a research preview, and the internal evaluation is qualitative.

Internal prompt checks found that simple greetings can work, but arithmetic, grammar correction, list following, long-form answers, and repetition are unreliable. The model can produce off-topic, incomplete, repetitive, or fabricated text. It is not comparable to Qwen2.5-0.5B-Instruct or other instruction-tuned models.

Known limitations:

  • 2,048-token context; long documents are truncated.
  • English- and code-oriented training data; limited multilingual ability.
  • No vision, tool calling, function calling, or reliable structured output.
  • Weak arithmetic and grammar; frequent repetition on open-ended prompts.
  • No safety alignment guarantee. It may produce harmful or biased content.
  • Only F16 is published; there are no official Q4/Q8 tags.

Treat every output as a draft. Verify facts, code, and instructions before using them. If you need reliable answers, use a larger instruction-tuned model.

License

  • Model weights: Apache-2.0.
  • Dizel repository code: MIT.
  • Training data: source datasets retain their original licenses; see the dataset card.
  • Teacher: Qwen2.5-0.5B-Instruct is Apache-2.0. Dizel is an independent project and is not affiliated with or endorsed by Alibaba or the Qwen team.
  • Dizel name and banner: D4niel-dev.

If you redistribute the model, keep the license and attribution notices.

Links

Citation

@misc{dizel15,
  author       = {D4niel-dev},
  title        = {Dizel 1.5},
  year         = {2026},
  howpublished = {\url{https://huggingface.co/D4niel-dev/Dizel-1.5}}
}

Acknowledgements

Thanks to the Qwen team for the teacher model, SentencePiece for the tokenizer tooling, and the llama.cpp and Ollama projects for local inference.


Model card updated 2026-10-21. Dizel 1.5 is an experimental release; behavior and packaging may change without notice.