1,925 1 year ago

Quantized variants of a German large language model (LLM).

1 year ago

ec0477bf364e · 7.7GB ·

llama
·
7.24B
·
Q8_0
{ "temperature": 0.5 }

Readme

em_german_leo_mistral

Quantized variants of a German large language model (LLM).

Example Modelfile:

FROM ./em_german_leo_mistral.Q4_K_M.gguf

PARAMETER temperature 0.5

Derived from the GGUF models at: https://huggingface.co/TheBloke/em_german_leo_mistral-GGUF

Original model from: https://github.com/jphme/EM_German