Codestral model with an optimised system prompt and parameters specifically for coding.

282 5 months ago

Readme

Codestral model with an optimised system prompt and parameters specifically for coding.

This is not a fine-tune, the model is from https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-GGUF

You may need to adjust the num_batch and num_ctx to be suited for your available VRAM.