dhiltgen/dolphin-llama3

dhiltgen/ dolphin-llama3

1,796 Downloads Updated 3 months ago

ollama run dhiltgen/dolphin-llama3:8b-256k-v2.9-fp16-ggml

curl http://localhost:11434/api/chat \
  -d '{
    "model": "dhiltgen/dolphin-llama3:8b-256k-v2.9-fp16-ggml",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='dhiltgen/dolphin-llama3:8b-256k-v2.9-fp16-ggml',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'dhiltgen/dolphin-llama3:8b-256k-v2.9-fp16-ggml',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Models

View all →

Name

18 models

Size / Usage

Context

Input

dolphin-llama3:8b-256k-v2.9-fp16-ggml

16GB · 250K context window · Text · 3 months ago

dolphin-llama3:8b-256k-v2.9-fp16-ggml

16GB

250K

Text

dolphin-llama3:8b-256k-v2.9-fp16-llamacpp

16GB · 250K context window · Text · 3 months ago

dolphin-llama3:8b-256k-v2.9-fp16-llamacpp

16GB

250K

Text

dolphin-llama3:8b-256k-v2.9-q4_K_M-ggml

4.9GB · 250K context window · Text · 3 months ago

dolphin-llama3:8b-256k-v2.9-q4_K_M-ggml

4.9GB

250K

Text

dolphin-llama3:8b-256k-v2.9-q4_K_M-llamacpp

4.9GB · 250K context window · Text · 3 months ago

dolphin-llama3:8b-256k-v2.9-q4_K_M-llamacpp

4.9GB

250K

Text

dolphin-llama3:8b-256k-v2.9-q8_0-ggml

8.5GB · 250K context window · Text · 3 months ago

dolphin-llama3:8b-256k-v2.9-q8_0-ggml

8.5GB

250K

Text

dolphin-llama3:8b-256k-v2.9-q8_0-llamacpp

8.5GB · 250K context window · Text · 3 months ago

dolphin-llama3:8b-256k-v2.9-q8_0-llamacpp

8.5GB

250K

Text

dolphin-llama3:8b-v2.9-fp16-ggml

16GB · 8K context window · Text · 3 months ago

dolphin-llama3:8b-v2.9-fp16-ggml

16GB

Text

dolphin-llama3:8b-v2.9-fp16-llamacpp

16GB · 8K context window · Text · 3 months ago

dolphin-llama3:8b-v2.9-fp16-llamacpp

16GB

Text

dolphin-llama3:8b-v2.9-q4_K_M-ggml

4.9GB · 8K context window · Text · 3 months ago

dolphin-llama3:8b-v2.9-q4_K_M-ggml

4.9GB

Text

dolphin-llama3:8b-v2.9-q4_K_M-llamacpp

4.9GB · 8K context window · Text · 3 months ago

dolphin-llama3:8b-v2.9-q4_K_M-llamacpp

4.9GB

Text

dolphin-llama3:8b-v2.9-q8_0-ggml

8.5GB · 8K context window · Text · 3 months ago

dolphin-llama3:8b-v2.9-q8_0-ggml

8.5GB

Text

dolphin-llama3:8b-v2.9-q8_0-llamacpp

8.5GB · 8K context window · Text · 3 months ago

dolphin-llama3:8b-v2.9-q8_0-llamacpp

8.5GB

Text

dolphin-llama3:70b-v2.9-fp16-ggml

141GB · 8K context window · Text · 3 months ago

dolphin-llama3:70b-v2.9-fp16-ggml

141GB

Text

dolphin-llama3:70b-v2.9-fp16-llamacpp

141GB · 8K context window · Text · 3 months ago

dolphin-llama3:70b-v2.9-fp16-llamacpp

141GB

Text

dolphin-llama3:70b-v2.9-q4_K_M-ggml

43GB · 8K context window · Text · 3 months ago

dolphin-llama3:70b-v2.9-q4_K_M-ggml

43GB

Text

dolphin-llama3:70b-v2.9-q4_K_M-llamacpp

43GB · 8K context window · Text · 3 months ago

dolphin-llama3:70b-v2.9-q4_K_M-llamacpp

43GB

Text

dolphin-llama3:70b-v2.9-q8_0-ggml

75GB · 8K context window · Text · 3 months ago

dolphin-llama3:70b-v2.9-q8_0-ggml

75GB

Text

dolphin-llama3:70b-v2.9-q8_0-llamacpp

75GB · 8K context window · Text · 3 months ago

dolphin-llama3:70b-v2.9-q8_0-llamacpp

75GB

Text

Readme

No readme