89 2 years ago

q4_k_m quantization only. Now using 8k context size

ollama run eas/openchat

Models

View all →

1 model

openchat:latest

4.4GB · 8K context window · Text · 2 years ago

Readme

I’ve only uploaded the -q4_k_m quantization

2023.11.06 Updated modelfile with PARAMETER num_ctx 8192

Original Model on HuggingFace

Quantized by TheBloke