jefferyb / granite

4-bit quantized version of instructlab/granite-7b-lab https://huggingface.co/instructlab/granite-7b-lab-GGUF

7B

51 Pulls Updated 5 months ago

5 months ago

b9efffa662cf · 4.1GB

model
llama
·
6.74B
·
Q4_K_M
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user {{ .Prompt }}<|im_end|> {{ end }}<|im_start|>assistant {{ .Response }}<|im_end|>
params
{"num_ctx":2048,"stop":["<|im_end|>","<|endoftext|>","</|im_end|>"]}

Readme

No readme