SetneufPT/ Ornith-1.0-35B-MOE_Q4_200k_32GB-GPU:latest

30 2 weeks ago

Custom model for coding with agents to use locally with 32gb, 2x16gb or 5x8gb GPUs (working very well!!)

... /
params
bbe0fe4cbe5f · 112B
{
"num_ctx": 200000,
"num_predict": 8096,
"stop": [
"<|im_end|>"
],
"temperature": 0.2,
"top_k": 40,
"top_p": 0.95
}