X3S00/ muse-glimmer-30b:ud-iq2_xxs

187 1 month ago

Runs on an RTX 3070 or better. I used mixed precision, IQ2, and CUDA optimizations.

... /
params
6d538ec1cd97 · 47B
{
"num_ctx": 8192,
"temperature": 0.7,
"top_p": 0.9
}