21 Downloads Updated 3 months ago
Zeta-4.5 - A little improvement
Models
View all →Name
37 models
Zeta-4.5:latest
934MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q2_K
247MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q3_K_S
267MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q3_K_M
283MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q3_K_L
297MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q4_K_S
309MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q4_K_M
320MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q5_K_S
346MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q5_K_M
352MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q6_K
387MB · 32K context window · Text · 3 months ago
Zeta-4.5:Q8_0
499MB · 32K context window · Text · 3 months ago
Zeta-4.5:IQ4_XS
299MB · 32K context window · Text · 3 months ago
Zeta-4.5:f16
934MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ3_M
274MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q2_K
247MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q2_K_S
237MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q3_K_S
267MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q3_K_M
283MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q3_K_L
297MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q4_0
308MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q4_1
327MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q4_K_S
309MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q4_K_M
320MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q5_K_S
346MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q5_K_M
352MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-Q6_K
387MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ1_S
180MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ1_M
186MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ2_XXS
195MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ2_XS
204MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ2_S
211MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ2_M
219MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ3_XXS
229MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ3_XS
259MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ3_S
267MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ4_XS
298MB · 32K context window · Text · 3 months ago
Zeta-4.5:i1-IQ4_NL
307MB · 32K context window · Text · 3 months ago
Readme
Zeta 4.5: A little improvement.
Models
Prompt Template
{{ if .System }}{{ .System }}{{ end }}
{{ if .Prompt }}<USER>{{ .Prompt }}</USER>{{ end }}
<ASSISTANT>
Stop Token
</ASSISTANT>
Computer Spec
Machine: RunPod VM(GPU, NVIDIA A100 PCIe)
Dataset
Details of the dataset used can be found here
Links
GitHub: Zeta
Zeta is just a small SLM. But don’t forget that it has big dreams inside.