finalend/
smaug-llama3-70b-abliterated-v3

94 1 year ago

Models

View all →

3 models

smaug-llama3-70b-abliterated-v3:latest

43GB · 8K context window · Text · 1 year ago

smaug-llama3-70b-abliterated-v3:q4_K_M

43GB · 8K context window · Text · 1 year ago

smaug-llama3-70b-abliterated-v3:fp16

141GB · 8K context window · Text · 1 year ago

Readme

Converted to GGUF (fp16). Quantized to Q4_K_M.

Safetensors source: https://huggingface.co/failspy/Smaug-Llama-3-70B-Instruct-abliterated-v3