kmamaroziqov/ alloma-3b-q4:latest

79 8 months ago

4-bit quantized model of Uzbek open-source model on HuggingFace at uzlm/alloma-3B-Instruct

... /
params
2c190063527b ยท 152B
{
"num_ctx": 8192,
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
],
"temperature": 0.7,
"top_k": 40,
"top_p": 0.9
}