turintech/ nemotron-3.5-bolt-e4b-artemis:q3_k_xl

557 1 week ago

Text-only Nemotron 3.5 Bolt E4B GGUF files, thinking off as measured. Default: q3_k_xl. TurinTech models, built with Artemis. Measured Q3_K_XL: Mean KLD 0.0414, Same top p 92.98% vs BF16 on held-out OASST1 chat; protocol rtx3060-heldout-2026-10-28.

tools thinking
... /
template
f56e8459650d ยท 159B
{{ if .System }}<bos><|turn>system
{{ .System }}<turn|>
{{ end }}{{ if .Prompt }}<|turn>user
{{ .Prompt }}<turn|>
{{ end }}<|turn>model
{{ .Response }}<turn|>