he smallest model in Cohere's R series delivers top-tier speed, efficiency, and quality to build powerful AI applications on commodity GPUs and edge devices.
tools
7b
411 Pulls Updated 2 months ago
Updated 2 months ago
2 months ago
6b0939d0696e · 5.1GB
model
archcohere2
·
parameters8.03B
·
quantizationQ4_K_M
5.1GB
params
{
"stop": [
"<|START_OF_TURN_TOKEN|>",
"<|END_OF_TURN_TOKEN|>",
"<|END_R
110B
template
{{- if or .Tools .System }}<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>
{{- if .Tools }}# Safety Preamble
3.0kB
license
Creative Commons Attribution-NonCommercial 4.0 International Public
License with Acceptable Use Add
14kB
Readme
This is an uncensored version of CohereForAI/c4ai-command-r7b-12-2024 created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
Note: this model requires Ollama 0.5.5