DiamondGotCat/
Zeta-4:IQ4_XS

13 2 months ago

Challenging the limit of 464M params

2 months ago

e773b69900c7 · 299MB

model
qwen2
·
464M
·
IQ4_XS
template
{{ if .System }}{{ .System }}{{ end }} {{ if .Prompt }}<USER>{{ .Prompt }}</USER>{{ end }} <ASSISTAN
params
{ "stop": [ "</ASSISTANT>" ] }

Readme

Zeta-4-Model-Image.png

Challenging the limit of 464M params: Zeta 4

Models

Prompt Template

{{ if .System }}{{ .System }}{{ end }}
{{ if .Prompt }}<USER>{{ .Prompt }}</USER>{{ end }}
<ASSISTANT>

Stop Token

</ASSISTANT>

Computer Spec

Machine: RunPod VM(GPU, NVIDIA A100 PCIe)

Dataset

Details of the dataset used can be found here

Links

GitHub: Zeta

Zeta is just a small SLM. But don’t forget that it has big dreams inside.