1,128 Downloads Updated 1 year ago
Name
7 models
dictalm2.0-instruct:q2_k
2.7GB · 32K context window · Text · 1 year ago
dictalm2.0-instruct:q4_0
4.1GB · 32K context window · Text · 1 year ago
dictalm2.0-instruct:q4_k_m
4.4GB · 32K context window · Text · 1 year ago
dictalm2.0-instruct:q5_k_m
5.1GB · 32K context window · Text · 1 year ago
dictalm2.0-instruct:q6_k
5.9GB · 32K context window · Text · 1 year ago
dictalm2.0-instruct:q8_0
7.7GB · 32K context window · Text · 1 year ago
dictalm2.0-instruct:f16
15GB · 32K context window · Text · 1 year ago
The DictaLM-2.0-Instruct Large Language Model (LLM) is an instruct fine-tuned version of the DictaLM-2.0 generative model using a variety of conversation datasets.
For full details of this model please read the developer’s release blog post.
This is the instruct-tuned model designed for chat in the GGUF format. You can try the model out on a live demo here.
Currently available quantizations:
You can view and access the full collection of base/instruct unquantized/quantized versions of DictaLM-2.0
here.