huihui_ai/
megrez-abliterated:7b-instruct-q8_0

146 10 months ago

Megrez-3B aims to provide a fast inference, compact, and powerful edge-side intelligent solution through software-hardware co-design.

tools 7b

10 months ago

345f44eb1ade · 3.1GB ·

model
llama
·
2.92B
·
Q8_0
license
LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"
template
<|start_header_id|>system<|end_header_id|> Cutting Knowledge Date: December 2023 {{ if .System }}{{

Readme

This is an uncensored version of Infinigence/Megrez-3B-Instruct created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

References

HuggingFace