byczech/ glm-4.7-flash-16G-UD-IQ3_XSS:30b

239 3 months ago

GLM-4.7 Flash 30B text model with tool-calling support, quantized to IQ3_XSS and optimized for 16 GB VRAM. The model supports up to 202,752 tokens context window, with approximately 180K fitting within 16 GB in suitable configurations.

tools thinking 30b
... /
params
543c6a8262f9 ยท 63B
{
"min_p": 0.01,
"repeat_penalty": 1,
"temperature": 1,
"top_p": 0.95
}