adrienbrault/
maziyarpanahi-phi3-mini-4k

82 1 year ago

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3-GGUF

Models

View all →

10 models

maziyarpanahi-phi3-mini-4k:q2_K

1.4GB · 4K context window · Text · 1 year ago

maziyarpanahi-phi3-mini-4k:q3_K_S

1.7GB · 4K context window · Text · 1 year ago

maziyarpanahi-phi3-mini-4k:q3_K_M

2.0GB · 4K context window · Text · 1 year ago

maziyarpanahi-phi3-mini-4k:q3_K_L

2.1GB · 4K context window · Text · 1 year ago

maziyarpanahi-phi3-mini-4k:q4_K_S

2.2GB · 4K context window · Text · 1 year ago

maziyarpanahi-phi3-mini-4k:q4_K_M

2.4GB · 4K context window · Text · 1 year ago

maziyarpanahi-phi3-mini-4k:q5_K_S

2.6GB · 4K context window · Text · 1 year ago

maziyarpanahi-phi3-mini-4k:q5_K_M

2.8GB · 4K context window · Text · 1 year ago

maziyarpanahi-phi3-mini-4k:q6_K

3.1GB · 4K context window · Text · 1 year ago

maziyarpanahi-phi3-mini-4k:q8_0

4.1GB · 4K context window · Text · 1 year ago

Readme

Uploaded with https://github.com/adrienbrault/hf-gguf-to-ollama

Ollama models of https://huggingface.co/MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3-GGUF.