yanjia/ qwopus3.5-27b-v3:q4km

195 6 months ago

Quantization based on Jackrong / Qwopus3.5-27B-v3

... /
params
ad8173fe6a79 ยท 69B
{
"num_ctx": 8192,
"num_gpu": 99,
"repeat_penalty": 1.1,
"temperature": 0.7
}