dolphin-llama3:8b-256k-v2.9-q4_0

321K 1 year ago

Dolphin 2.9 is a new model with 8B and 70B sizes by Eric Hartford based on Llama 3 that has a variety of instruction, conversational, and coding skills.

8b 70b

1 year ago

9f4257eb39a8 · 4.7GB

model
llama
·
8.03B
·
Q4_0
system
You are Dolphin, a helpful AI assistant.
license
META LLAMA 3 COMMUNITY LICENSE AGREEMENT Meta Llama 3 Version Release Date: April 18, 2024 “Agree
params
{ "stop": [ "<|im_start|>", "<|im_end|>" ] }
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user

Readme

🐬 Dolphin 2.9 Llama 3

Dolphin-2.9 has a variety of instruction, conversational, and coding skills. It also has initial agentic abilities and supports function calling.

Dolphin is uncensored. The dataset has been filtered to remove alignment and bias. This makes the model more compliant.

Curated and trained by Eric Hartford, Lucas Atkins, and Fernando Fernandes, and Cognitive Computations.

Sizes

  • dolphin-llama3:8b
  • dolphin-llama3:70b

256K Context Window

Note: using a 256k context window requires at least 64GB of memory.

Dolphin Llama 3 also has a 256k context window version. To extend the context window use:

API

curl http://localhost:11434/api/generate -d '{
  "model": "dolphin-llama3:8b-256k",
  "prompt": "Why is the sky blue?",
  "options": {
    "num_ctx": 256000
  }
}'

CLI

ollama run dolphin-llama3:8b-256k
>>> /set parameter num_ctx 256000

References

HuggingFace