11 2 days ago

Quark by FirstPrinciples, quantized to int8 (Q8_0): a 9B reasoning model for physics, science and math

ollama run FirstPrinciples/quark-q8

Details

2 days ago

831914c940cc · 9.8GB

qwen35
·
9.2B
·
Q8_0
{ "num_ctx": 131072, "presence_penalty": 1.5, "temperature": 1, "top_k": 20, "to

Readme

weight only int8 quantized version of Quark