everythinglm:13b-16k-q6_K

40.7K 1 year ago

Uncensored Llama2 based model with support for a 16K context window.

13b

1 year ago

ddbd37e8995f · 11GB

model
llama
·
13B
·
Q6_K
template
{{ .System }} User: {{ .Prompt }} Assistant:
params
{ "stop": [ "User:", "Assistant:" ] }
system
You are a helpful AI assistant.
license
LLAMA 2 COMMUNITY LICENSE AGREEMENT Llama 2 Version Release Date: July 18, 2023 "Agreement" means

Readme

The Everything Language Model is a Llama 2-based model with a 16k context released by Totally Not An LLM (Kai Howard). It was trained with the EverythingLM Dataset and is uncensored.

CLI

ollama run everythinglm

Once loaded, change the context size to 16K

/set parameter num_ctx 16384

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "everythinglm",
  "prompt": "Why is the sky blue?"
  "options": {
    "num_ctx": 16384
  }
 }'

Reference

13b parameters original source: Totally Not An LLM