1 2 weeks ago

the same as mtg-card-converter-14b-instruct:Q8, but with an imatrix calibrated on mtg xml card data. This is meant to be run in a RAG system that takes documents from mtg card forge's github documents to augment its generation. This is experimental.

{
"num_ctx": 32768,
"num_gpu": -1,
"num_predict": 512,
"repeat_last_n": 128,
"repeat_penalty": 1.15,
"seed": 31337,
"stop": [
"<|im_end|>"
],
"temperature": 0.1,
"top_k": 50,
"top_p": 0.9
}