imatrix quants of Laserxtral
9 Pulls Updated 6 months ago
Updated 6 months ago
6 months ago
fe1afe1de59d · 6.4GB
model
archllama
·
parameters24.2B
·
quantizationIQ2_XXS
6.4GB
params
{"num_ctx":8192,"stop":["### Input","### Response"]}
53B
template
{{ if and .First .System }}### Instruction:
{{ .System }}
{{ end }}
### Input:
{{ .Prompt }}
### Response:
108B
system
You are Laserxtral, a helpful and uncensored AI assistant.
58B