aqualaguna/gemma-3-27b-it-abliterated-GGUF

aqualaguna/ gemma-3-27b-it-abliterated-GGUF

3,764 Downloads Updated 11 months ago

clone of https://huggingface.co/mlabonne/gemma-3-27b-it-abliterated-GGUF

ollama run aqualaguna/gemma-3-27b-it-abliterated-GGUF:q2_k

curl http://localhost:11434/api/chat \
  -d '{
    "model": "aqualaguna/gemma-3-27b-it-abliterated-GGUF:q2_k",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='aqualaguna/gemma-3-27b-it-abliterated-GGUF:q2_k',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'aqualaguna/gemma-3-27b-it-abliterated-GGUF:q2_k',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Models

View all →

Name

6 models

Size

Context

Input

gemma-3-27b-it-abliterated-GGUF:q2_k

11GB · 128K context window · Text · 11 months ago

gemma-3-27b-it-abliterated-GGUF:q2_k

11GB

128K

Text

gemma-3-27b-it-abliterated-GGUF:q3_k_m

13GB · 128K context window · Text · 11 months ago

gemma-3-27b-it-abliterated-GGUF:q3_k_m

13GB

128K

Text

gemma-3-27b-it-abliterated-GGUF:q4_k_m

17GB · 128K context window · Text · 11 months ago

gemma-3-27b-it-abliterated-GGUF:q4_k_m

17GB

128K

Text

gemma-3-27b-it-abliterated-GGUF:q5_k_m

19GB · 128K context window · Text · 11 months ago

gemma-3-27b-it-abliterated-GGUF:q5_k_m

19GB

128K

Text

gemma-3-27b-it-abliterated-GGUF:q6_k

22GB · 128K context window · Text · 11 months ago

gemma-3-27b-it-abliterated-GGUF:q6_k

22GB

128K

Text

gemma-3-27b-it-abliterated-GGUF:q8_0

29GB · 128K context window · Text · 11 months ago

gemma-3-27b-it-abliterated-GGUF:q8_0

29GB

128K

Text

Readme

clone of https://huggingface.co/mlabonne/gemma-3-27b-it-abliterated-GGUF