9 Downloads Updated 4 months ago
Zeta 3 - Pushing the limits of the Zeta-2-Dataset.
Models
View all →Name
37 models
Zeta-3:latest
934MB · 32K context window · Text · 5 months ago
Zeta-3:Q2_K
247MB · 32K context window · Text · 4 months ago
Zeta-3:Q3_K_S
267MB · 32K context window · Text · 4 months ago
Zeta-3:Q3_K_M
283MB · 32K context window · Text · 4 months ago
Zeta-3:Q3_K_L
297MB · 32K context window · Text · 4 months ago
Zeta-3:Q4_K_S
309MB · 32K context window · Text · 4 months ago
Zeta-3:Q4_K_M
320MB · 32K context window · Text · 4 months ago
Zeta-3:Q5_K_S
346MB · 32K context window · Text · 4 months ago
Zeta-3:Q5_K_M
352MB · 32K context window · Text · 4 months ago
Zeta-3:Q6_K
387MB · 32K context window · Text · 4 months ago
Zeta-3:Q8_0
499MB · 32K context window · Text · 4 months ago
Zeta-3:IQ4_XS
299MB · 32K context window · Text · 4 months ago
Zeta-3:f16
934MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ3_M
274MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q2_K
247MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q2_K_S
237MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q3_K_S
267MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q3_K_M
283MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q3_K_L
297MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q4_0
308MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q4_1
327MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q4_K_S
309MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q4_K_M
320MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q5_K_S
346MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q5_K_M
352MB · 32K context window · Text · 4 months ago
Zeta-3:i1-Q6_K
387MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ1_S
180MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ1_M
186MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ2_XXS
195MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ2_XS
204MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ2_S
211MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ2_M
219MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ3_XXS
229MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ3_XS
259MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ3_S
267MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ4_XS
298MB · 32K context window · Text · 4 months ago
Zeta-3:i1-IQ4_NL
307MB · 32K context window · Text · 4 months ago
Readme
Next Version has Released! v4
Pushing the limits of the Zeta-2-Dataset. New: Zeta 3
Zeta 3 is a new LLM that challenges itself to outperform Zeta-2, even though it uses the same Zeta-2-Dataset.
Models
Prompt Template
{{ if .System }}{{ .System }}{{ end }}
{{ if .Prompt }}<USER>{{ .Prompt }}</USER>{{ end }}
<ASSISTANT>
Stop Token
</ASSISTANT>
Computer Spec
Machine: RunPod VM(GPU, NVIDIA A100 PCIe)
This time, I used the RunPod service to study more efficiently.
Thanks to RunPod, I was able to use CUDA and had the optimization options available.
Dataset
Details of the dataset used can be found here
Links
GitHub: Zeta
Zeta is just a small SLM. But don’t forget that it has big dreams inside.