hexbenjamin/
openhermes-2.5-16k-q8:latest

124 1 year ago

i don't know why the version from TheBloke has no q8_0 file but. oh well!

... /
params
60d76624f6e4 · 75B
{
"num_ctx": 16384,
"stop": [
"<|im_start|>",
"<|im_end|>"
]
}