turintech/ minicpm5-2b-artemis

136 6 days ago

MiniCPM5-2B compressed with Artemis by TurinTech: a 1.53 GB GGUF that got 188/200 held-out tool calls and 215/250 maths problems, against 182 and 180 for OpenBMB's Q4_K_M. Measured Q4_K_S: Mean KLD 0.050 vs BF16 on two texts (mean).

2 models

minicpm5-2b-artemis:latest
4a91a0dc45bd • 1.5GB • 128K context window •
Text input • 6 days ago
minicpm5-2b-artemis:q4_k_s
4a91a0dc45bd • 1.5GB • 128K context window •
Text input • 6 days ago