sammcj/
qwen2.5-cobol-coder-7b-instruct:q6_k

41 5 months ago

Qwen 2.5 Coder 7b Finetuned on MainframeBench for Cobol Coding

tools

5 months ago

365db394fa2e · 6.9GB ·

model
qwen2
·
7.62B
·
Q6_K
system
You are Qwen Cobol Coder, You are an expert AI coding programmer with skills in understanding, writi
params
{ "min_p": 0.03, "num_ctx": 32768, "num_keep": 256, "num_predict": 32768, "repea
template
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .M

Readme

SFT+DPO trained on dataset: https://huggingface.co/datasets/Fsoft-AIC/MainframeBench/

Training Config

  • Training Set Size: 2,270
  • Test Set Size: 253
  • learning_rate_multiplier: 1
  • num_epochs: 4
  • batch_size: auto
  • preference_tuning_variant: APO Zero
  • preference_tuning_learning_rate_multiplier: 1
  • preference_tuning_num_epochs: 1
  • preference_tuning_training_beta: 0.1
  • preference_tuning_adapter_weight: 0.5