jean-luc/ tiger-gemma

1,209 Downloads Updated 1 year ago

Decensored Gemma 9b finetuned by TheDrummer (Source: https://huggingface.co/TheDrummer/Tiger-Gemma-9B-v1)

ollama run jean-luc/tiger-gemma:9b-v1a-Q2_K

curl http://localhost:11434/api/chat \
  -d '{
    "model": "jean-luc/tiger-gemma:9b-v1a-Q2_K",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='jean-luc/tiger-gemma:9b-v1a-Q2_K',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'jean-luc/tiger-gemma:9b-v1a-Q2_K',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Models

Name

7 models

Size

Context

Input

tiger-gemma:9b-v1a-Q2_K

3.8GB · 8K context window · Text · 1 year ago

tiger-gemma:9b-v1a-Q2_K

3.8GB

8K

Text

tiger-gemma:9B-v1a-Q3_K_M

4.8GB · 8K context window · Text · 1 year ago

tiger-gemma:9B-v1a-Q3_K_M

4.8GB

8K

Text

tiger-gemma:9B-v1a-Q4_K_M

5.8GB · 8K context window · Text · 1 year ago

tiger-gemma:9B-v1a-Q4_K_M

5.8GB

8K

Text

tiger-gemma:9B-v1a-Q5_K_M

6.6GB · 8K context window · Text · 1 year ago

tiger-gemma:9B-v1a-Q5_K_M

6.6GB

8K

Text

tiger-gemma:9B-v1a-Q6_K

7.6GB · 8K context window · Text · 1 year ago

tiger-gemma:9B-v1a-Q6_K

7.6GB

8K

Text

tiger-gemma:9b-v1a-Q8_0

9.8GB · 8K context window · Text · 1 year ago

tiger-gemma:9b-v1a-Q8_0

9.8GB

8K

Text

tiger-gemma:9B-v1a-fp16

18GB · 8K context window · Text · 1 year ago

tiger-gemma:9B-v1a-fp16

18GB

8K

Text

Readme

Tiger Gemma 9B v1

Decensored Gemma 9B. No refusals so far. No apparent brain damage.

GGUF: https://huggingface.co/TheDrummer/Tiger-Gemma-9B-v1-GGUF

In memory of Tiger (the happy street cat on the right)