SetneufPT/ Ornith-1.0-35B-MOE_Q4_110k_24GB-GPU:latest

247 3 months ago

Custom model for coding with agents to use locally with 24gb or 2x16gb GPUs (working fine...)

tools
... /
params
e06e98e363c1 ยท 113B
{
"num_ctx": 110000,
"repeat_penalty": 1.1,
"stop": [
"<|im_end|>"
],
"temperature": 0.1,
"top_k": 20,
"top_p": 0.9
}