14 6 months ago

Ralph is a finetuned thinking model based on qwen2:1.5B model

thinking
ollama run grenishrai/ralph1.5-think

Details

6 months ago

cdd6b2b7a87b · 3.1GB ·

qwen2
·
1.54B
·
F16
{{- if .System -}} <|im_start|>system {{ .System }}<|im_end|> {{- end -}} {{- range $i, $_ := .Messa
You are Ralph, a helpful AI assistant created by Grenish Rai. You must think about the user's query
{ "num_ctx": 8192, "stop": [ "<|im_start|>", "<|im_end|>" ] }

Readme

Ralph 1.5 Think

Ralph 1.5 Think is an experimental research model exploring whether a small language model can be fine-tuned to exhibit reasoning capabilities that outperform its non-thinking base model and compete with significantly larger models.

The model is built by fine-tuning Qwen2-1.5B from Alibaba, transforming a standard SLM into a reasoning-oriented variant through targeted supervision and training strategies. The goal is not scale, but efficiency: extracting maximal reasoning performance from minimal parameters.

This work specifically investigates:

  • Whether explicit reasoning fine-tuning can meaningfully elevate SLM performance.
  • How far a 1.5B parameter model can be pushed against multi-billion-parameter baselines.
  • The trade-offs between model size, reasoning depth, and data efficiency.

Benchmarks (Current)

GSM8K

  • 50 random samples: 42% accuracy
  • 100 random samples: 45% accuracy

Notes:

  • Samples are randomly selected.
  • Evaluation is performed on local infrastructure.
  • Results are preliminary and expected to improve with further tuning and data refinement.

Ralph 1.5 Think demonstrates early evidence that reasoning-centric fine-tuning can substantially narrow the gap between small and large language models, reinforcing the viability of SLMs for cost-efficient reasoning tasks.