779 8 months ago

Tried my best to make gpt-4o-mini from chevalblanc to be more optimized for CPU usage... and I did

vision
d41176fc135e · 170B
{
"mirostat": 1,
"mirostat_eta": 0.1,
"num_ctx": 16384,
"repeat_penalty": 1.2,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.5,
"top_k": 50,
"top_p": 0.95
}