SetneufPT/ hermes79_2b_q4_128k_8gb-gpu:latest

50 5 days ago

Custom model for Hermes to use locally with 8gb GPUs (expect no miracles...)

vision tools thinking
... /
params
5d9a661f0063 · 136B
{
"num_ctx": 128000,
"presence_penalty": 1.5,
"repeat_last_n": 2048,
"repeat_penalty": 1.15,
"seed": 42,
"temperature": 0.1,
"top_k": 20,
"top_p": 0.8
}