huihui_ai/
falcon3-abliterated:10b-instruct-q4_K_M

1,181 9 months ago

A family of efficient AI models under 10B parameters performant in science, math, and coding through innovative training techniques.

1b 3b 7b 10b

9 months ago

551897295ced · 6.3GB ·

model
llama
·
10.3B
·
Q4_K_M
license
Falcon 3 TII Falcon License December 2024 FalconLLM.tii.ae Introductory note This license is, in par
params
{ "stop": [ "<|system|>", "<|user|>", "<|end|>", "<|assistant|>"
template
{{- range $i, $_ := .Messages }} {{- $last := eq (len (slice $.Messages $i)) 1 -}} <|{{ .Role }}|> {

Readme

This is an uncensored version of tiiuae/falcon3 created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

References

HuggingFace