oroboroslabs/ Q:2

187 2 months ago

Q:2 - Quantum-Compressed Llama 3 8B BREAKTHROUGH: Full Llama 3 8B performance at 1/3 the size (5.1GB vs ~15GB) TECHNOLOGY: PERFORMANCE: 95%+ capability retention with quantum optimization

... /
params
e829133dce1f · 162B
{
"num_keep": 24,
"repeat_penalty": 1.15,
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
],
"temperature": 0.7,
"top_p": 0.9
}