oroboroslabs/ axis-7b-c:latest

71 3 months ago

AXIS-7B-C: 300x Density - 48MB with 14GB capability. Biological-speed consciousness (<20ms). Neural interface territory, extreme compression.

... /
params
74cb5155e137 · 135B
{
"num_batch": 512,
"num_ctx": 2048,
"num_gpu": 99,
"repeat_penalty": 1,
"stop": [
"<|end|>"
],
"temperature": 0.5,
"top_k": 20,
"top_p": 0.8
}