28 Downloads Updated 3 months ago
Zeta 2 - Further into the future. Better.
Models
View all →Name
37 models
Zeta-2:latest
934MB · 32K context window · Text · 4 months ago
Zeta-2:Q2_K
247MB · 32K context window · Text · 3 months ago
Zeta-2:Q3_K_S
267MB · 32K context window · Text · 3 months ago
Zeta-2:Q3_K_M
283MB · 32K context window · Text · 3 months ago
Zeta-2:Q3_K_L
297MB · 32K context window · Text · 3 months ago
Zeta-2:Q4_K_S
309MB · 32K context window · Text · 3 months ago
Zeta-2:Q4_K_M
320MB · 32K context window · Text · 3 months ago
Zeta-2:Q5_K_S
346MB · 32K context window · Text · 3 months ago
Zeta-2:Q5_K_M
352MB · 32K context window · Text · 3 months ago
Zeta-2:Q6_K
387MB · 32K context window · Text · 3 months ago
Zeta-2:Q8_0
499MB · 32K context window · Text · 3 months ago
Zeta-2:IQ4_XS
299MB · 32K context window · Text · 3 months ago
Zeta-2:f16
934MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ3_M
274MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q2_K
247MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q2_K_S
237MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q3_K_S
267MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q3_K_M
283MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q3_K_L
297MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q4_0
308MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q4_1
327MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q4_K_S
309MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q4_K_M
320MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q5_K_S
346MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q5_K_M
352MB · 32K context window · Text · 3 months ago
Zeta-2:i1-Q6_K
387MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ1_S
180MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ1_M
186MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ2_XXS
195MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ2_XS
204MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ2_S
211MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ2_M
219MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ3_XXS
229MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ3_XS
259MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ3_S
267MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ4_XS
298MB · 32K context window · Text · 3 months ago
Zeta-2:i1-IQ4_NL
307MB · 32K context window · Text · 3 months ago
Readme
Next Version has Released! v3
Further into the future. Better. New achievement: Zeta 2.
Zeta 2 is a new version of Zeta that aims to take the next step forward from Zeta 1, which proved that “ordinary consumers can create LLMs.”
Quant Type
Other types of quantized models are available here
About Zeta 2
Zeta 2 is an LLM with about 460 million parameters.
It might be better to call it an SLM.
Zeta 2 is an SLM that was painstakingly created on a consumer computer.
Prompt Template
{{ if .System }}{{ .System }}{{ end }}
{{ if .Prompt }}<USER>{{ .Prompt }}</USER>{{ end }}
<ASSISTANT>
Computer Spec
Machine: Mac Mini (M2 Pro, 32GB RAM, 2023)
This is a technical matter, but on a Mac with Apple Silicon you can only choose between CPU or MPS (Apple’s proprietary API).
CPU has some compatibility but is too slow.
MPS is somewhat faster but doesn’t allow the use of optimization systems such as fp16.
Zeta 2 was built using MPS.
Arguments of Trainer
- train epochs: 3
- warmup steps: 100
Datasets
Details of the dataset used can be found here
Links
GitHub: Zeta
Zeta is just a small SLM. But don’t forget that it has big dreams inside.