cas/
discolm-german-laser:latest

338 1 year ago

from mayflowergmbh/DiscoLM_German_7b_v1-laser

1 year ago

7ee782956d4a · 4.4GB ·

model
llama
·
7.24B
·
Q4_K_M
params
{ "num_ctx": 8192, "stop": [ "<|im_start", "<|im_end", "|im_start",
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user

Readme

Upload of quantized GGUF of DiscoLM with Layer Selective Rank Reduction (https://github.com/cognitivecomputations/laserRMT) as provided by mayflowergmbh/DiscoLM_German_7b_v1-laser for experimenting with the model