turintech/ nemotron-3.5-bolt-e4b-artemis:q5_k_xl

547 1 week ago

Text-only Nemotron 3.5 Bolt E4B GGUF files, thinking off as measured. Default: q3_k_xl. TurinTech models, built with Artemis. Measured Q3_K_XL: Mean KLD 0.0414, Same top p 92.98% vs BF16 on held-out OASST1 chat; protocol rtx3060-heldout-2026-10-28.

tools thinking
... /
params
7fe90c73a489 ยท 148B
{
"num_ctx": 8192,
"stop": [
"<bos>",
"<|turn>",
"<turn|>",
"<|turn>user"
],
"temperature": 1,
"top_k": 64,
"top_p": 0.95
}