SetneufPT/ Qwopus3.6-27B-MTP_Q3_48K_16GB-GPU:latest

468 1 month ago

Custom model for coding with agents to use locally with 16gb GPUs (working fine...)

... /
params
09a87e8624ae · 111B
{
"num_ctx": 48000,
"repeat_last_n": 4096,
"repeat_penalty": 1.1,
"seed": 79,
"temperature": 0.1,
"top_k": 20,
"top_p": 0.8
}