JetBrains/ mellum2-instruct-q8_0:latest

17 1 week ago

Low latency instruct LLM by JetBrains

tools
... /
params
860de822e3d4 · 118B
{
"num_ctx": 131072,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.6,
"top_k": 20,
"top_p": 0.95
}