imatrix quants of Laserxtral
10 Pulls Updated 8 months ago
Updated 8 months ago
8 months ago
fe1afe1de59d · 6.4GB
model
archllama
·
parameters24.2B
·
quantizationIQ2_XXS
6.4GB
params
{"num_ctx":8192,"stop":["### Input","### Response"]}
53B
system
You are Laserxtral, a helpful and uncensored AI assistant.
58B
template
{{ if and .First .System }}### Instruction:
{{ .System }}
{{ end }}
### Input:
{{ .Prompt }}
### Res
108B