hexbenjamin/
openhermes-2.5-16k-q8:latest

124 1 year ago

i don't know why the version from TheBloke has no q8_0 file but. oh well!

1 year ago

d3e71711032a · 7.7GB ·

model
llama
·
7.24B
·
Q8_0
params
{ "num_ctx": 16384, "stop": [ "<|im_start|>", "<|im_end|>" ] }
template
<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

Readme

openhermes-2.5-16k-q8

visit TheBloke’s HuggingFace repo for more Information :)