dhiltgen/gemma3

dhiltgen/ gemma3

1,141 Downloads Updated 1 week ago

Testing new conversion patterns...

vision

ollama run dhiltgen/gemma3:270m-it-bf16-ggml

curl http://localhost:11434/api/chat \
  -d '{
    "model": "dhiltgen/gemma3:270m-it-bf16-ggml",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='dhiltgen/gemma3:270m-it-bf16-ggml',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'dhiltgen/gemma3:270m-it-bf16-ggml',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Models

View all →

Name

43 models

Size / Usage

Context

Input

gemma3:270m-it-bf16-ggml

543MB · 32K context window · Text · 2 months ago

gemma3:270m-it-bf16-ggml

543MB

32K

Text

gemma3:270m-it-bf16-llamacpp

543MB · 32K context window · Text · 2 months ago

gemma3:270m-it-bf16-llamacpp

543MB

32K

Text

gemma3:270m-it-fp16-ggml

543MB · 32K context window · Text · 2 months ago

gemma3:270m-it-fp16-ggml

543MB

32K

Text

gemma3:270m-it-fp16-llamacpp

543MB · 32K context window · Text · 2 months ago

gemma3:270m-it-fp16-llamacpp

543MB

32K

Text

gemma3:270m-it-q8_0-ggml

292MB · 32K context window · Text · 2 months ago

gemma3:270m-it-q8_0-ggml

292MB

32K

Text

gemma3:270m-it-q8_0-llamacpp

292MB · 32K context window · Text · 2 months ago

gemma3:270m-it-q8_0-llamacpp

292MB

32K

Text

gemma3:270m-it-qat-ggml

241MB · 32K context window · Text · 2 months ago

gemma3:270m-it-qat-ggml

241MB

32K

Text

gemma3:270m-it-qat-llamacpp

241MB · 32K context window · Text · 2 months ago

gemma3:270m-it-qat-llamacpp

241MB

32K

Text

gemma3:1b-it-fp16-ggml

2.0GB · 32K context window · Text · 2 months ago

gemma3:1b-it-fp16-ggml

2.0GB

32K

Text

gemma3:1b-it-fp16-llamacpp

2.0GB · 32K context window · Text · 1 week ago

gemma3:1b-it-fp16-llamacpp

2.0GB

32K

Text

gemma3:1b-it-q4_K_M-ggml

815MB · 32K context window · Text · 2 months ago

gemma3:1b-it-q4_K_M-ggml

815MB

32K

Text

gemma3:1b-it-q4_K_M-llamacpp

806MB · 32K context window · Text · 1 week ago

gemma3:1b-it-q4_K_M-llamacpp

806MB

32K

Text

gemma3:1b-it-q8_0-ggml

1.1GB · 32K context window · Text · 2 months ago

gemma3:1b-it-q8_0-ggml

1.1GB

32K

Text

gemma3:1b-it-q8_0-llamacpp

1.1GB · 32K context window · Text · 1 week ago

gemma3:1b-it-q8_0-llamacpp

1.1GB

32K

Text

gemma3:1b-it-qat-ggml

1.0GB · 32K context window · Text · 3 months ago

gemma3:1b-it-qat-ggml

1.0GB

32K

Text

gemma3:1b-it-qat-llamacpp

1.0GB · 32K context window · Text · 3 months ago

gemma3:1b-it-qat-llamacpp

1.0GB

32K

Text

gemma3:4b-it-bf16-llamacpp

8.6GB · 128K context window · Text, Image · 1 week ago

gemma3:4b-it-bf16-llamacpp

8.6GB

128K

Text, Image

gemma3:4b-it-fp16-ggml

8.6GB · 128K context window · Text, Image · 3 months ago

gemma3:4b-it-fp16-ggml

8.6GB

128K

Text, Image

gemma3:4b-it-fp16-llamacpp

8.6GB · 128K context window · Text, Image · 1 week ago

gemma3:4b-it-fp16-llamacpp

8.6GB

128K

Text, Image

gemma3:4b-it-q4_K_M-ggml

3.3GB · 128K context window · Text, Image · 3 months ago

gemma3:4b-it-q4_K_M-ggml

3.3GB

128K

Text, Image

gemma3:4b-it-q4_K_M-llamacpp

3.4GB · 128K context window · Text, Image · 1 week ago

gemma3:4b-it-q4_K_M-llamacpp

3.4GB

128K

Text, Image

gemma3:4b-it-q8_0-ggml

5.0GB · 128K context window · Text, Image · 3 months ago

gemma3:4b-it-q8_0-ggml

5.0GB

128K

Text, Image

gemma3:4b-it-q8_0-llamacpp

5.0GB · 128K context window · Text, Image · 1 week ago

gemma3:4b-it-q8_0-llamacpp

5.0GB

128K

Text, Image

gemma3:4b-it-qat-ggml

4.0GB · 128K context window · Text, Image · 3 months ago

gemma3:4b-it-qat-ggml

4.0GB

128K

Text, Image

gemma3:4b-it-qat-llamacpp

4.0GB · 128K context window · Text, Image · 1 week ago

gemma3:4b-it-qat-llamacpp

4.0GB

128K

Text, Image

gemma3:12b-it-bf16-llamacpp

24GB · 128K context window · Text, Image · 1 week ago

gemma3:12b-it-bf16-llamacpp

24GB

128K

Text, Image

gemma3:12b-it-fp16-ggml

24GB · 128K context window · Text, Image · 3 months ago

gemma3:12b-it-fp16-ggml

24GB

128K

Text, Image

gemma3:12b-it-fp16-llamacpp

24GB · 128K context window · Text, Image · 1 week ago

gemma3:12b-it-fp16-llamacpp

24GB

128K

Text, Image

gemma3:12b-it-q4_K_M-ggml

8.1GB · 128K context window · Text, Image · 3 months ago

gemma3:12b-it-q4_K_M-ggml

8.1GB

128K

Text, Image

gemma3:12b-it-q4_K_M-llamacpp

8.2GB · 128K context window · Text, Image · 1 week ago

gemma3:12b-it-q4_K_M-llamacpp

8.2GB

128K

Text, Image

gemma3:12b-it-q8_0-ggml

13GB · 128K context window · Text, Image · 3 months ago

gemma3:12b-it-q8_0-ggml

13GB

128K

Text, Image

gemma3:12b-it-q8_0-llamacpp

13GB · 128K context window · Text, Image · 1 week ago

gemma3:12b-it-q8_0-llamacpp

13GB

128K

Text, Image

gemma3:12b-it-qat-ggml

8.9GB · 128K context window · Text, Image · 3 months ago

gemma3:12b-it-qat-ggml

8.9GB

128K

Text, Image

gemma3:12b-it-qat-llamacpp

8.9GB · 128K context window · Text, Image · 1 week ago

gemma3:12b-it-qat-llamacpp

8.9GB

128K

Text, Image

gemma3:27b-it-bf16-llamacpp

55GB · 128K context window · Text, Image · 1 week ago

gemma3:27b-it-bf16-llamacpp

55GB

128K

Text, Image

gemma3:27b-it-fp16-ggml

55GB · 128K context window · Text, Image · 3 months ago

gemma3:27b-it-fp16-ggml

55GB

128K

Text, Image

gemma3:27b-it-fp16-llamacpp

55GB · 128K context window · Text, Image · 1 week ago

gemma3:27b-it-fp16-llamacpp

55GB

128K

Text, Image

gemma3:27b-it-q4_K_M-ggml

17GB · 128K context window · Text, Image · 3 months ago

gemma3:27b-it-q4_K_M-ggml

17GB

128K

Text, Image

gemma3:27b-it-q4_K_M-llamacpp

17GB · 128K context window · Text, Image · 1 week ago

gemma3:27b-it-q4_K_M-llamacpp

17GB

128K

Text, Image

gemma3:27b-it-q8_0-ggml

30GB · 128K context window · Text, Image · 3 months ago

gemma3:27b-it-q8_0-ggml

30GB

128K

Text, Image

gemma3:27b-it-q8_0-llamacpp

30GB · 128K context window · Text, Image · 1 week ago

gemma3:27b-it-q8_0-llamacpp

30GB

128K

Text, Image

gemma3:27b-it-qat-ggml

18GB · 128K context window · Text, Image · 3 months ago

gemma3:27b-it-qat-ggml

18GB

128K

Text, Image

gemma3:27b-it-qat-llamacpp

18GB · 128K context window · Text, Image · 1 week ago

gemma3:27b-it-qat-llamacpp

18GB

128K

Text, Image

Readme

No readme