VenomBlood/ yicoder-q4:latest

158 6 months ago

Yi-Coder 9B Chat quantized to Q4_K_M using llama.cpp, reducing size from ~18 GB to ~5.3 GB. Runs on 8 GB RAM. Optimized for Python test generation with pytest. Produces clean, ready-to-run code. Apache 2.0 licensed.

... /
params
d1379962b653 ยท 125B
{
"num_ctx": 8192,
"repeat_penalty": 1.1,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.1,
"top_p": 0.9
}