Next Version has Released! v4

Pushing the limits of the Zeta-2-Dataset. New: Zeta 3

Zeta 3 is a new LLM that challenges itself to outperform Zeta-2, even though it uses the same Zeta-2-Dataset.

Models

• Transformer - Normal
• GGUF - Static Quant
• GGUF - Weighted/imatrix Quant

Prompt Template

{{ if .System }}{{ .System }}{{ end }}
{{ if .Prompt }}<USER>{{ .Prompt }}</USER>{{ end }}
<ASSISTANT>

Stop Token

</ASSISTANT>

Computer Spec

Machine: RunPod VM(GPU, NVIDIA A100 PCIe)

This time, I used the RunPod service to study more efficiently.

Thanks to RunPod, I was able to use CUDA and had the optimization options available.

Dataset

Details of the dataset used can be found here

Links

GitHub: Zeta

---

Zeta is just a small SLM. But don’t forget that it has big dreams inside.