quantization of (https://huggingface.co/starsnatched/MemGPT-DPO-uncensored-GGUF) to q8_0, brought to ollama :)
7B
870 Pulls Updated 7 months ago
0a38aefaa35e · 67B
{
"num_ctx": 8192,
"stop": [
"<|im_end|>"
],
"temperature": 0.1
}