Quantized versions of the new mixtral 7b from Mistral! This is purely for research purposes and not for commercial distribution
611 Pulls 13 Tags Updated 1 year ago
This model was built from the https://huggingface.co/paulkl/mixtral-8x7b-instruct-v0.1_Q4b_wa (gguf)
56 Pulls 1 Tag Updated 2 years ago
This is an ollama version of the paulkl/mixtral-8x7b-instruct-v0.1_Q4b_wa model
6 Pulls 1 Tag Updated 2 years ago