martain7r/
finance-llama-8b:q4_k_m

709 3 months ago

Finance-Llama-8B is a fine-tuned Llama 3.1 8B model trained on 500k examples for tasks like QA, reasoning, sentiment, and NER. It supports multi-turn dialogue and is ideal for financial assistants.

... /
params
ce32a7e0ae96 · 145B
{
"num_ctx": 4096,
"num_predict": 8192,
"repeat_penalty": 1.1,
"stop": [
"User:",
"Assistant:",
"</s>"
],
"temperature": 0.7,
"top_k": 40,
"top_p": 0.9
}