sola97/
sus-chat:34b-q3_K_S

19 1 year ago

1 year ago

ea074c96b71c · 15GB ·

llama
·
34.4B
·
Q3_K_S
### Human: {{ .Prompt }} ### Assistant:
{ "num_ctx": 8192, "num_gpu": 61 }

Readme

SUS-Chat-34B is a bilingual dialogue model with top-notch performance in multiple languages and tasks, especially designed for complex, multi-turn dialogues.

Notably, the version uploaded is the 3-bit quantized (Q3) version, optimized for efficiency, allowing it to run on systems with at least 20GB of VRAM, ensuring broader accessibility and reduced computational requirements.