18 Downloads Updated 1 week ago
curl http://localhost:11434/v1/systemone \
-H "Content-Type: application/json" \
-d '{
"model": "jersobh/jeff-2b-decision",
"state": "Hello World",
"questions": {
"says_hello": {
"type": "noul",
"instructions": "Does the state text contain a greeting?",
"criteria": {
"true": "The state text contains a greeting.",
"false": "The state text does not contain a greeting."
}
}
}
}'
language: - en license: apache-2.0 tags: - unsloth - qlora - gguf - decision-engine - routing
Fine-tuned on top of internlm/Intern-Decision-2B using Unsloth with extended 5-epoch training and hard-negative mining. Optimized for structured schema-guided routing and intent classification.
| Benchmark / Task | Unquantized (BF16) | Quantized (Q4_K_M GGUF) |
|---|---|---|
| BANKING77 Intent Classification | 95.80% | 95.60% |
| MASSIVE Intent Classification | 87.10% | 87.00% |
| CLINC150 Intent Classification | 95.20% | 95.00% |
| Type-Decision Routing (Dolly) | 90.30% | 90.10% |
internlm/Intern-Decision-2B32, Alpha: 32)5 (Hard-negative mining enabled)Q4_K_M)ollama run jersobh/jeff-2b-decision --format json "Search the knowledge graph for customer interaction logs regarding subscription renewals. Choices: 1. SQLDatabaseQueryTool, 2. VectorSearchTool, 3. WebScraperTool, 4. ChatDirectly"