FirstPrinciples/ quark-q8:latest

7 yesterday

Quark by FirstPrinciples, quantized to int8 (Q8_0): a 9B reasoning model for physics, science and math

... /
params
b44b4a03a3f9 ยท 82B
{
"num_ctx": 131072,
"presence_penalty": 1.5,
"temperature": 1,
"top_k": 20,
"top_p": 0.95
}