18 1 week ago

eb-gen : An EasyBuild Easyconfig Generator, based on a fine tuned Qwen2.5-Coder-7B-Instruct .

7b
ollama run kuikuisven/eb-gen:7b

Details

1 week ago

1c277f357c15 · 15GB ·

qwen2
·
7.62B
·
F16
<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi
You are an EasyBuild easyconfig generator. Given software metadata, produce a complete .eb easyconfi
{ "stop": [ "<|im_end|>" ], "temperature": 0.1, "top_p": 0.9 }

Readme

Fine-tuning an EasyBuild Easyconfig Generator

QLoRA fine-tuning of Qwen2.5-Coder-7B-Instruct on 11K EasyBuild easyconfig files, producing a model that generates valid .eb recipes from software metadata.

Overview

Base model Qwen2.5-Coder-7B-Instruct
Method QLoRA (4-bit NF4, LoRA rank 64)
Training data 10,453 examples from 11K .eb files
Trainable params ~161M / 4.5B (3.6%)
Hardware NVIDIA V100 16GB
Training time ~2-3 hours (3 epochs)