mkchaou/ calm_mistral_r64_a128_lr1e-4_e6:latest

10 3 weeks ago

This model is Mistral-small-24b-Instruct-2501 fine-tuned on ~13k Climsight data which are pairs of prompts/completions extracted from climsight pipeline. Below are all the technical specs of the fine-tuning process along with the evaluation used.

... /
params
e60b32aa00d2 · 131B
{
"num_ctx": 32768,
"stop": [
"[INST]",
"[/INST]",
"[SYSTEM_PROMPT]",
"[/SYSTEM_PROMPT]",
"</s>"
],
"temperature": 0.15,
"top_p": 0.9
}