treyleo16/ small-minded:500m

183 4 weeks ago

Like a little baby with a small brain.

0.0001m 0.00077m 0.001m 0.26m 1m 500m 1b
... /
license
b9b0755398e5 ยท 215B
MIT
small-minded:500m - 499,597,056 parameters, Q4_K_M.
Function-preserving expansion of small-minded:1m (d_model 28->1792, heads 2->128,
ffn 272->18176 with 66-67 copies per unit). Emits exactly what the 1M emits.