grf / mixtral_wa_q4_cp

This model was built from the https://huggingface.co/paulkl/mixtral-8x7b-instruct-v0.1_Q4b_wa (gguf)

8x7B

10 Pulls Updated 6 months ago

6 months ago

7dc5a45be6b6 · 26GB

model
llama
·
46.7B
·
Q4_0
template
[INST] {{ .Prompt }} [/INST]
params
{"num_ctx":32768,"num_thread":8}

Readme

No readme