eas/
neuralbeagle14

200 1 year ago

quantized versions of mlabonne/NeuralBeagle14-7B

Models

View all →

4 models

neuralbeagle14:latest

4.4GB · 32K context window · Text · 1 year ago

neuralbeagle14:7b-q4_K_M

4.4GB · 32K context window · Text · 1 year ago

neuralbeagle14:7b-q6_K

5.9GB · 32K context window · Text · 1 year ago

neuralbeagle14:7b-q8_0

7.7GB · 32K context window · Text · 1 year ago

Readme

q4_K_M, q6_K and q8_0 quantized versions of mlabonne/NeuralBeagle14-7B

Supports up to 8K context. Modelfile is configured for 4K.