412 1 year ago

Model finetuned starting with llama 3.1 8b using a full precision LoRA he20, rank 64, alpha 16

tools
ollama run 3logic/llama-3.1-8b-instruct-phactual_fp16_he20

Applications

Claude Code
Claude Code ollama launch claude --model 3logic/llama-3.1-8b-instruct-phactual_fp16_he20
Codex App
Codex App ollama launch codex-app --model 3logic/llama-3.1-8b-instruct-phactual_fp16_he20
OpenClaw
OpenClaw ollama launch openclaw --model 3logic/llama-3.1-8b-instruct-phactual_fp16_he20
Hermes Agent
Hermes Agent ollama launch hermes --model 3logic/llama-3.1-8b-instruct-phactual_fp16_he20
Codex
Codex ollama launch codex --model 3logic/llama-3.1-8b-instruct-phactual_fp16_he20
OpenCode
OpenCode ollama launch opencode --model 3logic/llama-3.1-8b-instruct-phactual_fp16_he20

Models

View all →

Readme

Model Specifications

Base Model

  • Architecture: Llama 3.1
  • Size: 8B parameters
  • Type: Instruct model
  • Precision: FP16

Finetuning Parameters

  • Method: Full Precision LoRA
  • Epoch: 20
  • Rank: 64
  • Alpha: 16
  • Training Dataset: train_05_prompted_v2

Performance Metrics

Metric Score Base Model Score
Agentic Similarity 86 84.67
CoT Contextual Accuracy 56 / 3 54 / 5
Medical GPT Score 65 51.75

Benchmark Results

This model demonstrates superior performance compared to previous Llama 3.1 8B implementations across all measured metrics.

Loss Function:

training_loss.png