SetneufPT/ ocode79_9b_q4_64k_16gb-gpu:latest

5 8 hours ago

Custom model for Open Code to use locally with 16gb or 2x8gb GPUs (working fine?...)

tools thinking
... /
params
24dae3a23e2b · 112B
{
"num_ctx": 64000,
"repeat_last_n": 2048,
"repeat_penalty": 1.12,
"seed": 79,
"temperature": 0.1,
"top_k": 20,
"top_p": 0.8
}