huihui_ai/nemotron-abliterated:70b-instruct-q8

huihui_ai/ nemotron-abliterated:70b-instruct-q8_0

510 Downloads Updated 1 year ago

Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.

tools 70b

ollama run huihui_ai/nemotron-abliterated:70b-instruct-q8_0

curl http://localhost:11434/api/chat \
  -d '{
    "model": "huihui_ai/nemotron-abliterated:70b-instruct-q8_0",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='huihui_ai/nemotron-abliterated:70b-instruct-q8_0',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'huihui_ai/nemotron-abliterated:70b-instruct-q8_0',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

a5d6b135c62b · 75GB ·

model

archllama

parameters70.6B

quantizationQ8_0

75GB

template

<|start_header_id|>system<|end_header_id|> {{ if .Tools }}You have access to the following functions

1.2kB

license

LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”

7.6kB

license

# Llama 3.1 Acceptable Use Policy Meta is committed to promoting safe and fair use of its tools and

4.7kB

params

{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

96B

Readme

This is an uncensored version of nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) created with abliteration (see this article to know more about it).

Special thanks to @FailSpy for the original code and technique. Please follow him if you’re interested in abliterated models.

References

HuggingFace