70b_instruct_8k_q4_k_m
43GB
With correct 8k context window length
70B
69 Pulls Updated 3 months ago
d8b7e8715af8 · 125B
{
"num_ctx": 8192,
"stop": [
"num_keep 24",
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
]
}