1,875 1 year ago

https://huggingface.co/NTQAI/Nxcode-CQ-7B-orpo

1 year ago

2784da3b3724 · 6.4GB ·

qwen2
·
7.25B
·
Q6_K
{ "stop": [ "<|im_start|>", "<|im_end|>", "</s>" ] }
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user

Readme

Introduction

Nxcode-CQ-7B-orpo is an Monolithic Preference Optimization without Reference Model fine-tune of Qwen/CodeQwen1.5-7B on 100k samples of high-quality ranking data.

Evalplus

EvalPlus pass@1
HumanEval 86.6
HumanEval+ 83.5
MBPP(v0.2.0) 82.3
MBPP+(v0.2.0) 70.4