569 3 months ago

Dolphin 3.0 llama3.2 馃惉 - A powerful, customizable AI model for local use.

1b 3b

Models

View all →

Readme

I鈥檝e uploaded the quants of these models that I find most useful. I quantized them myself using the fp16 GGUF files.

  • For 1.5b: Q5_K_M, Q8_0 (default), F16

  • For 3b: Q4_K_M (default), Q5_K_M, Q8_0, F16

Dolphin 3.0 llama3.2 馃惉

The ultimate general-purpose local AI model, enabling coding, math, and more.

  • You鈥檙e in control: Set the system prompt, alignment, and guidelines.
  • Your data stays yours: No more worries about your data being used by others.
  • Built for your needs: Tailor Dolphin to your specific use case.

References:

Created by the cognitivecomputations team.

HuggingFace