jefferyb/
granite:7b-lab-Q4_K_M

58 1 year ago

4-bit quantized version of instructlab/granite-7b-lab https://huggingface.co/instructlab/granite-7b-lab-GGUF

90ac3ac954d8 · 99B
{
"num_ctx": 2048,
"stop": [
"<|im_end|>",
"<|endoftext|>",
"</|im_end|>"
]
}