SetneufPT/ hermes79_9b_q4_200k_16gb-gpu:latest

25 4 days ago

Custom model for Hermes to use locally with 16gb or 2x8gb GPUs (working fine...)

tools thinking
... /
params
2f132042e133 · 167B
{
"num_ctx": 200000,
"repeat_last_n": 4096,
"repeat_penalty": 1.2,
"seed": 42,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0,
"top_k": 20,
"top_p": 0.7
}