13 Downloads Updated 2 months ago
Challenging the limit of 464M params
Models
View all →Readme
Challenging the limit of 464M params: Zeta 4
Models
Prompt Template
{{ if .System }}{{ .System }}{{ end }}
{{ if .Prompt }}<USER>{{ .Prompt }}</USER>{{ end }}
<ASSISTANT>
Stop Token
</ASSISTANT>
Computer Spec
Machine: RunPod VM(GPU, NVIDIA A100 PCIe)
Dataset
Details of the dataset used can be found here
Links
GitHub: Zeta
Zeta is just a small SLM. But don’t forget that it has big dreams inside.