adrienbrault/
mattshumer-hermes2pro-11b

117 1 year ago

https://huggingface.co/MaziyarPanahi/Hermes-2-Pro-11B-GGUF

Models

View all →

10 models

mattshumer-hermes2pro-11b:Q2_K

4.2GB · 32K context window · Text · 1 year ago

mattshumer-hermes2pro-11b:Q3_K_S

4.9GB · 32K context window · Text · 1 year ago

mattshumer-hermes2pro-11b:Q3_K_M

5.4GB · 32K context window · Text · 1 year ago

mattshumer-hermes2pro-11b:Q3_K_L

5.9GB · 32K context window · Text · 1 year ago

mattshumer-hermes2pro-11b:Q4_K_S

6.4GB · 32K context window · Text · 1 year ago

mattshumer-hermes2pro-11b:Q4_K_M

6.7GB · 32K context window · Text · 1 year ago

mattshumer-hermes2pro-11b:Q5_K_S

7.7GB · 32K context window · Text · 1 year ago

mattshumer-hermes2pro-11b:Q5_K_M

7.9GB · 32K context window · Text · 1 year ago

mattshumer-hermes2pro-11b:Q6_K

9.2GB · 32K context window · Text · 1 year ago

mattshumer-hermes2pro-11b:Q8_0

12GB · 32K context window · Text · 1 year ago

Readme

See https://huggingface.co/MaziyarPanahi/Hermes-2-Pro-11B-GGUF

Pushed using https://github.com/adrienbrault/hf-gguf-to-ollama