Megrez-3B aims to provide a fast inference, compact, and powerful edge-side intelligent solution through software-hardware co-design.
tools
7b
96 Pulls Updated 2 months ago
Updated 2 months ago
2 months ago
ea676d90cd75 · 1.8GB
model
archllama
·
parameters2.92B
·
quantizationQ4_K_M
1.8GB
params
{
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
96B
template
<|start_header_id|>system<|end_header_id|>
Cutting Knowledge Date: December 2023
{{ if .System }}{
1.4kB
license
LLAMA 3.1 COMMUNITY LICENSE AGREEMENT
Llama 3.1 Version Release Date: July 23, 2024
“Agreement”
7.6kB
Readme
This is an uncensored version of Infinigence/Megrez-3B-Instruct created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.