rouge/
wizardlm-2-7b-abliterated:latest

376 1 year ago

This is the WizardLM-2-7B model with orthogonalized bfloat16 safetensor weights, based on the implementation by @failspy

1 year ago

11e2b69c8559 · 7.7GB ·

model
llama
·
7.24B
·
Q8_0
system
You are a highly capable AI assistant designed to help users to the best of your abilities. Your int
params
{ "stop": [ "USER", "ASSISTANT" ], "temperature": 0.6 }
template
{{ if .System }}{{ .System }} {{ end }}{{ if .Prompt }}USER: {{ .Prompt }} {{ end }}ASSISTANT: {{ .R

Readme

WizardLM-2-7B-abliterated

This is the WizardLM-2-7B model with orthogonalized bfloat16 safetensor weights, based on the implementation by @failspy. For more info:

GGUF Files

GGUF files here: https://huggingface.co/fearlessdots/WizardLM-2-7B-abliterated-GGUF