exaone-deep:7.8b-q4_K

exaone-deep:7.8b-q4_K_M

577.1K Downloads Updated 1 year ago

EXAONE Deep exhibits superior capabilities in various reasoning tasks including math and coding benchmarks, ranging from 2.4B to 32B parameters developed and released by LG AI Research.

2.4b 7.8b 32b

ollama run exaone-deep:7.8b-q4_K_M

curl http://localhost:11434/api/chat \
  -d '{
    "model": "exaone-deep:7.8b-q4_K_M",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='exaone-deep:7.8b-q4_K_M',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'exaone-deep:7.8b-q4_K_M',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

106afe416a9e · 4.8GB ·

model

archexaone

parameters7.82B

quantizationQ4_K_M

4.8GB

template

{{- range $i, $_ := .Messages }} {{- $last := eq (len (slice $.Messages $i)) 1 -}} {{ if eq .Role "s

375B

license

EXAONE AI Model License Agreement 1.1 - NC This License Agreement (“Agreement”) is entered into

14kB

params

{ "repeat_penalty": 1, "stop": [ "[|endofturn|]" ], "temperature": 0.6,

77B

Readme

EXAONE Deep exhibits superior capabilities in various reasoning tasks including math and coding benchmarks, ranging from 2.4B to 32B parameters developed and released by LG AI Research.

Evaluation results show that:

EXAONE Deep 2.4B outperforms other models of comparable size
EXAONE Deep 7.8B outperforms not only open-weight models of comparable scale but also a proprietary reasoning model OpenAI o1-mini
EXAONE Deep 32B demonstrates competitive performance against leading open-weight models.

References

Hugging Face