exaone-deep:7.8b-q8

exaone-deep:7.8b-q8_0

577.9K Downloads Updated 1 year ago

EXAONE Deep exhibits superior capabilities in various reasoning tasks including math and coding benchmarks, ranging from 2.4B to 32B parameters developed and released by LG AI Research.

2.4b 7.8b 32b

ollama run exaone-deep:7.8b-q8_0

curl http://localhost:11434/api/chat \
  -d '{
    "model": "exaone-deep:7.8b-q8_0",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='exaone-deep:7.8b-q8_0',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'exaone-deep:7.8b-q8_0',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

b1c039797694 · 8.3GB ·

model

archexaone

parameters7.82B

quantizationQ8_0

8.3GB

template

{{- range $i, $_ := .Messages }} {{- $last := eq (len (slice $.Messages $i)) 1 -}} {{ if eq .Role "s

375B

license

EXAONE AI Model License Agreement 1.1 - NC This License Agreement (“Agreement”) is entered into

14kB

params

{ "repeat_penalty": 1, "stop": [ "[|endofturn|]" ], "temperature": 0.6,

77B

Readme

EXAONE Deep exhibits superior capabilities in various reasoning tasks including math and coding benchmarks, ranging from 2.4B to 32B parameters developed and released by LG AI Research.

Evaluation results show that:

EXAONE Deep 2.4B outperforms other models of comparable size
EXAONE Deep 7.8B outperforms not only open-weight models of comparable scale but also a proprietary reasoning model OpenAI o1-mini
EXAONE Deep 32B demonstrates competitive performance against leading open-weight models.

References

Hugging Face