koesn/ wizardlm2-7b

283 2 years ago

Fixed num_ctx to 32768. This WizardLM-2 7B model is ready to use for full model's 32k contexts window.

5 models

wizardlm2-7b:latest
0fa4bbf46bc7 • 4.1GB • 32K context window •
Text input • 2 years ago
wizardlm2-7b:Q4_0
0fa4bbf46bc7 • 4.1GB • 32K context window •
Text input • 2 years ago
wizardlm2-7b:Q4_K_M
cf9ad469dee1 • 4.4GB • 32K context window •
Text input • 2 years ago
wizardlm2-7b:Q5_K_M
f85585aac7b2 • 5.1GB • 32K context window •
Text input • 2 years ago
wizardlm2-7b:Q6_K
8116ffc7f078 • 5.9GB • 32K context window •
Text input • 2 years ago