Lightweight, state-of-the-art model for Socratic interactions (fine tuned from Phi-3-mini-4k).
41 Pulls Updated 2 months ago
Updated 2 months ago
2 months ago
4e692a71bc19 · 7.6GB
Readme
Socratic LLM
Using Large Language Models (LLMs) in education presents unique challenges. Typically, LLMs are designed to provide direct answers to questions, which can hinder students’ critical thinking and self-discovery skills. To address this, we focus on fine-tuning LLMs to facilitate Socratic interactions. Instead of giving straightforward answers, these models guide students to explore and find the answers themselves. We achieve this through Direct Preference Optimization (DPO). We test our approach with diverse datasets, including various educational materials and Socratic dialogues. Using advanced models like GPT-4o for evaluation, our results show that DPO successfully fine-tunes LLMs for Socratic dialogue, enhancing their educational value.
This repository contains the source material for the paper “Fine Tuning a Large Language Model for Socratic Interactions” (KDD, AI4EDU Workshop).
Check out training pipeline at GitHub - socratic-llm.
Original model available at HuggingFace Hub.
You can learn more about our project at Fine Tuning a Large Language Model for Socratic Interactions.