twnvy/edge-lm

twnvy/ edge-lm

21 Downloads Updated 5 months ago

A token-efficient thinking model that rivals the CoT of much larger models with only 3 billion parameters.

thinking

ollama run twnvy/edge-lm

curl http://localhost:11434/api/chat \
  -d '{
    "model": "twnvy/edge-lm",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='twnvy/edge-lm',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'twnvy/edge-lm',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Models

View all →

Name

1 model

Size / Usage

Context

Input

edge-lm:latest

2.0GB · 128K context window · Text · 5 months ago

edge-lm:latest

2.0GB

128K

Text

Readme

NOTE: This is a research preview model. Responses may not be perfect. Edge-LM is a token efficient thinking SLM that rivals the CoT and alignment of much larger models with only 3 billion parameters.

Edge-LM excels in math and data analysis. It also has a much lower hallucination rate than models of similar size, such as Llama3.2 and Phi-3.5 Mini. * Edge-LM’s score calculated based on 500 random samples due to limited compute.

Quick Start

Run Edge-LM with Ollama:

ollama run twnvy/edge-lm