eas/
openchat

89 1 year ago

q4_k_m quantization only. Now using 8k context size

Models

View all →

1 model

openchat:latest

4.4GB · 8K context window · Text · 1 year ago

Readme

I’ve only uploaded the -q4_k_m quantization

2023.11.06 Updated modelfile with PARAMETER num_ctx 8192

Original Model on HuggingFace

Quantized by TheBloke