seamon67/Gemma3-Abliterated

seamon67/ Gemma3-Abliterated

1,693 Downloads Updated 3 months ago

Various Quants and Versions of Abliterated Gemma3.

vision

ollama run seamon67/Gemma3-Abliterated:4b-q4_K_M

curl http://localhost:11434/api/chat \
  -d '{
    "model": "seamon67/Gemma3-Abliterated:4b-q4_K_M",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='seamon67/Gemma3-Abliterated:4b-q4_K_M',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'seamon67/Gemma3-Abliterated:4b-q4_K_M',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Models

View all →

Name

6 models

Size

Context

Input

Gemma3-Abliterated:4b-q4_K_M

3.3GB · 128K context window · Text, Image · 3 months ago

Gemma3-Abliterated:4b-q4_K_M

3.3GB

128K

Text, Image

Gemma3-Abliterated:4b-q8_0

4.9GB · 128K context window · Text, Image · 3 months ago

Gemma3-Abliterated:4b-q8_0

4.9GB

128K

Text, Image

Gemma3-Abliterated:4b-f16

8.6GB · 128K context window · Text, Image · 3 months ago

Gemma3-Abliterated:4b-f16

8.6GB

128K

Text, Image

Gemma3-Abliterated:27b-q4_K_M

17GB · 128K context window · Text, Image · 5 months ago

Gemma3-Abliterated:27b-q4_K_M

17GB

128K

Text, Image

Gemma3-Abliterated:27b-q8_0

30GB · 128K context window · Text, Image · 5 months ago

Gemma3-Abliterated:27b-q8_0

30GB

128K

Text, Image

Gemma3-Abliterated:27b-f16

55GB · 128K context window · Text, Image · 5 months ago

Gemma3-Abliterated:27b-f16

55GB

128K

Text, Image

Readme

27b (Vision Included): https://huggingface.co/mlabonne/gemma-3-27b-it-abliterated