turintech/ minicpm5-2b-artemis:latest

136 6 days ago

MiniCPM5-2B compressed with Artemis by TurinTech: a 1.53 GB GGUF that got 188/200 held-out tool calls and 215/250 maths problems, against 182 and 180 for OpenBMB's Q4_K_M. Measured Q4_K_S: Mean KLD 0.050 vs BF16 on two texts (mean).

... /
params
ce4a164fc046 ยท 17B
{
"num_ctx": 8192
}