Fixed num_ctx to 8192 and eos token. This Llama 3 8B Instruct model is ready to use for full model's 8k contexts window.

8B

288 Pulls Updated 4 months ago

15392c1ab95c · 129B
{ "num_ctx": 8192, "num_keep": 24, "stop": [ "<|start_header_id|>", "<|end_header_id|>", "\"<|eot_id|>\"" ] }