koesn/
dolphin-llama3-8b

201 1 year ago

Fixed num_ctx to 8192. This Dolphin 2.9 Llama 3 8B model is ready to use for full model's 8k contexts window.

5 models

dolphin-llama3-8b:latest
1de0f93b8099 • 4.7GB • 8K context window •
Text input • 1 year ago
dolphin-llama3-8b:Q4_0
1de0f93b8099 • 4.7GB • 8K context window •
Text input • 1 year ago
dolphin-llama3-8b:Q4_K_M
33eb22d8b40d • 4.9GB • 8K context window •
Text input • 1 year ago
dolphin-llama3-8b:Q5_K_M
85371638212d • 5.7GB • 8K context window •
Text input • 1 year ago
dolphin-llama3-8b:Q6_K
5597af3f81ce • 6.6GB • 8K context window •
Text input • 1 year ago