Hand-picked and tested models for 16 GB VRAM video cards and 24 GB M1+ Mac
-
gemma-4
12B — QAT — GGUF — MLX — uncensored — sampling | ~7-13 GB
vision tools thinking audio655 Pulls 5 Tags Updated 1 week ago
-
ornith-1.5
9B — GGUF — MLX — uncensored — sampling | ~5-11 GB
vision tools thinking102 Pulls 12 Tags Updated 2 days ago
-
mellum2.1
12B — GGUF — sampling | ~8-10 GB
tools thinking5 Pulls 2 Tags Updated yesterday