37 11 months ago

quantized, smaller version of vision-1. Optimized for inference on Apple Metal.

24ea95141995 · 184B
{
"num_batch": 512,
"num_ctx": 2048,
"num_gpu": 1,
"num_thread": 8,
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
],
"temperature": 0.1,
"top_p": 0.9
}