164 1 month ago

Quantization based on Jackrong / Qwopus3.5-27B-v3

ad8173fe6a79 · 69B
{
"num_ctx": 8192,
"num_gpu": 99,
"repeat_penalty": 1.1,
"temperature": 0.7
}