spooknik/
westlake-7b-v2

244 1 year ago

Westlake-7Bv2: Role-Play & Text Generation Specialist Model

Models

View all →

5 models

westlake-7b-v2:latest

4.4GB · 32K context window · Text · 1 year ago

westlake-7b-v2:q8

7.7GB · 32K context window · Text · 1 year ago

westlake-7b-v2:q4_k_m

4.4GB · 32K context window · Text · 1 year ago

westlake-7b-v2:q5_k_s

5.0GB · 32K context window · Text · 1 year ago

westlake-7b-v2:q6_k

5.9GB · 32K context window · Text · 1 year ago

Readme

Original Model | GGUF Quants

An excellent smaller parameter model for roleplay and text. Performs very well for its size. I strongly recommend the highest quantization you can run. See tags and download the version that suits you best.

Feel free to contact me if you have problems

Reddit: /u/spooknik | Discord: .spooknik