relational/ VULCAN:latest

47 1 month ago

A light weight Model that runs on a single GPU with over 80 TPS on a RTX 5060 (8G vram), Excellent for coding purposes.

... /
params
b9eca3c27a7d · 99B
{
"num_ctx": 16384,
"num_predict": 2048,
"repeat_penalty": 1.1,
"temperature": 0.7,
"top_k": 50,
"top_p": 0.9
}