oroboroslabs/ Q:latest

187 2 months ago

Q:2 - Quantum-Compressed Llama 3 8B BREAKTHROUGH: Full Llama 3 8B performance at 1/3 the size (5.1GB vs ~15GB) TECHNOLOGY: PERFORMANCE: 95%+ capability retention with quantum optimization

... /
params
567c6647d0a2 · 186B
{
"num_batch": 512,
"num_ctx": 4096,
"num_gpu": 99,
"repeat_penalty": 1.2,
"stop": [
"<|end|>",
"<|user|>",
"<|assistant|>"
],
"temperature": 0.46,
"top_k": 46,
"top_p": 0.88
}