spooknik/
westlake-7b-v2-laser

69 1 year ago

Westlake-7Bv2 Laser: Role-Play & Text Generation Specialist Model.

Models

View all →

5 models

westlake-7b-v2-laser:latest

4.4GB · 32K context window · Text · 1 year ago

westlake-7b-v2-laser:q8

7.7GB · 32K context window · Text · 1 year ago

westlake-7b-v2-laser:q4_k_m

4.4GB · 32K context window · Text · 1 year ago

westlake-7b-v2-laser:q5_k_s

5.0GB · 32K context window · Text · 1 year ago

westlake-7b-v2-laser:q6_k

5.9GB · 32K context window · Text · 1 year ago

Readme

Original Model | GGUF Quants

A laser version of westlake-7b-v2

I strongly recommend the highest quantization you can run. See tags and download the version that suits you best.

Feel free to contact me if you have problems

Reddit: /u/spooknik | Discord: .spooknik