koesn / llama3-8b-instruct

Fixed num_ctx to 8192 and eos token. This Llama 3 8B Instruct model is ready to use for full model's 8k contexts window.

8B

288 Pulls Updated 4 months ago

5 Tags
latest
c40cd0e317f3 • 4.7GB • Updated 4 months ago
Q4_0
latest
c40cd0e317f3 • 4.7GB • Updated 4 months ago
Q4_K_M
aae5b523ef30 • 4.9GB • Updated 4 months ago
Q5_K_M
7f44284ae112 • 5.7GB • Updated 4 months ago
Q6_K
a3288dbaf70c • 6.6GB • Updated 4 months ago