huihui_ai/nemotron-abliterated

huihui_ai/ nemotron-abliterated:latest

510 Downloads Updated 1 year ago

Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.

tools 70b

ollama run huihui_ai/nemotron-abliterated

curl http://localhost:11434/api/chat \
  -d '{
    "model": "huihui_ai/nemotron-abliterated",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='huihui_ai/nemotron-abliterated',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'huihui_ai/nemotron-abliterated',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

0df9bafd4066 · 43GB ·

model

archllama

parameters70.6B

quantizationQ4_K_M

43GB

template

<|start_header_id|>system<|end_header_id|> {{ if .Tools }}You have access to the following functions

1.2kB

license

LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”

7.6kB

license

# Llama 3.1 Acceptable Use Policy Meta is committed to promoting safe and fair use of its tools and

4.7kB

params

{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

96B

Readme

This is an uncensored version of nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) created with abliteration (see this article to know more about it).

Special thanks to @FailSpy for the original code and technique. Please follow him if you’re interested in abliterated models.

References

HuggingFace