LESSTHANSUPER/DARK_PLANET_REBEL

LESSTHANSUPER/ DARK_PLANET_REBEL_FURY-Llama3-25b

148 Downloads Updated 2 months ago

Storytelling mixture of experts model for consumer GPUs. Made by DavidAU (Huggingface).

tools

ollama run LESSTHANSUPER/DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S

curl http://localhost:11434/api/chat \
  -d '{
    "model": "LESSTHANSUPER/DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='LESSTHANSUPER/DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'LESSTHANSUPER/DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Applications

Claude Code ollama launch claude --model LESSTHANSUPER/DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S

Codex ollama launch codex --model LESSTHANSUPER/DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S

OpenCode ollama launch opencode --model LESSTHANSUPER/DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S

OpenClaw ollama launch openclaw --model LESSTHANSUPER/DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S

Models

View all →

Name

7 models

Size

Context

Input

DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S

11GB · 8K context window · Text · 2 months ago

DARK_PLANET_REBEL_FURY-Llama3-25b:Q3_K_S

11GB

Text

DARK_PLANET_REBEL_FURY-Llama3-25b:Q4_K_S

14GB · 8K context window · Text · 2 months ago

DARK_PLANET_REBEL_FURY-Llama3-25b:Q4_K_S

14GB

Text

DARK_PLANET_REBEL_FURY-Llama3-25b:Q5_K_M

18GB · 8K context window · Text · 2 months ago

DARK_PLANET_REBEL_FURY-Llama3-25b:Q5_K_M

18GB

Text

DARK_PLANET_REBEL_FURY-Llama3-25b:Q6_K

20GB · 8K context window · Text · 2 months ago

DARK_PLANET_REBEL_FURY-Llama3-25b:Q6_K

20GB

Text

DARK_PLANET_REBEL_FURY-Llama3-25b:IQ2_XXS

6.8GB · 8K context window · Text · 2 months ago

DARK_PLANET_REBEL_FURY-Llama3-25b:IQ2_XXS

6.8GB

Text

DARK_PLANET_REBEL_FURY-Llama3-25b:IQ3_S

11GB · 8K context window · Text · 2 months ago

DARK_PLANET_REBEL_FURY-Llama3-25b:IQ3_S

11GB

Text

DARK_PLANET_REBEL_FURY-Llama3-25b:IQ4_XS

13GB · 8K context window · Text · 2 months ago

DARK_PLANET_REBEL_FURY-Llama3-25b:IQ4_XS

13GB

Text

Readme

DARK PLANET REBEL FURY / I-MATRIX / 25B (4X8B) / I-QUANT

A more recent model from DavidAU’s “Dark Planet” line, one the creator favored themselves among their similar MoE (mixture of experts) models. This model was uploaded for the speed MoEs provide relative for their size, and as I have had good experience with the Dark Planet series. If a higher active parameter model is preferred, there is a 13-billion active parameter Mixtral model available. To stuff as many parameters in as little VRAM as possible, weighted K and I-quants will be listed.

Note that I-quants forfeit some token generation speed relative to K-quants in exchange for storage efficiency. Either of the 4-bit quantizations are recommended for 16GB GPUs. These models were taken from GGUF formats from Huggingface.

Original model (DavidAU):

GGUF weighted quantizations (mradermacher):

[No obligatory model picture. Ollama did not like it.]

**DARK PLANET REBEL FURY / I-MATRIX / 25B (4X8B) / I-QUANT**

A more recent model from DavidAU's "Dark Planet" line, one the creator favored themselves among their similar MoE (mixture of experts) models. This model was uploaded for the speed MoEs provide relative for their size, and as I have had good experience with the Dark Planet series. If a higher active parameter model is preferred, [_there is a 13-billion active parameter Mixtral model available_](https://ollama.com/LESSTHANSUPER/CLOUDY_MIXTRAL-22b). To stuff as many parameters in as little VRAM as possible, weighted K and I-quants will be listed.

[*Original model (DavidAU):*](https://huggingface.co/DavidAU/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF)

[*GGUF weighted quantizations (mradermacher):*](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-i1-GGUF)

_[No obligatory model picture. Ollama did not like it.]_

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)