Models

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters.

KoboldAI/LLaMA2-13B-Tiefighter

Zhipu GLM-4.7-Flash 30B-A3B Uncensored MLA+MoE (:30b-a3b Q4_K_M 18.5GB & :iq3 IQ3_M 13.6GB for 16GB GPUs). 202.2 tok/s Decode (:iq3 196.2 tok/s), 50.0% Precision, 66.7% Hallucination, 100% Zero-Refusal. License: MIT.