aminadaven/
dictalm2.0-instruct:q4_k_m

1,115 1 year ago

The DictaLM-2.0-Instruct Large Language Model (LLM) is an instruct fine-tuned version of the DictaLM-2.0 generative model using a variety of conversation datasets. For full details of this model please read this post: https://dicta.org.il/dicta-lm

1 year ago

61402828f800 · 4.4GB

model
llama
·
7.25B
·
Q4_K_M
params
{ "stop": [ "[INST]", "[/INST]" ] }
template
[INST] {{ .System }} {{ .Prompt }} [/INST]

Readme

Model Card for DictaLM-2.0-Instruct

The DictaLM-2.0-Instruct Large Language Model (LLM) is an instruct fine-tuned version of the DictaLM-2.0 generative model using a variety of conversation datasets.

For full details of this model please read the developer’s release blog post.

This is the instruct-tuned model designed for chat in the GGUF format. You can try the model out on a live demo here.

Currently available quantizations:

  • q2_k
  • q4_0
  • q4_k_m
  • q5_k_m
  • q6_k
  • q8_0
  • f16

You can view and access the full collection of base/instruct unquantized/quantized versions of DictaLM-2.0 here.