36 Downloads Updated 10 months ago
ollama run Jayasimma/creaton-ai
Creaton AI is a locally runnable, instruction-tuned variant of Microsoftβs Phi-2 language model. Fine-tuned using the LoRA method and converted to gguf format for compatibility with Ollama, it supports fast and efficient inference on consumer hardware.
microsoft/phi-2creaton-ai.gguf)creaton-ai.gguf and place it next to the ModelfileFrom the folder containing Modelfile and creaton-ai.gguf:
ollama create creaton-ai -f Modelfile
````
> If successful: `β Created model creaton-ai`
---
### 3. π¬ Run the Model
```bash
ollama run creaton-ai
Example prompt:
Instruct: Explain the purpose of the Indian Constitution.
Output:
Start Ollamaβs server:
ollama serve
Then query via curl:
curl http://localhost:11434/api/generate -d '{
"model": "creaton-ai",
"prompt": "Instruct: Describe Thirukkural 133.\nOutput:",
"stream": false
}'
Microsoft Phi-2 Yao et al. (2023). Phi-2: The surprising power of small language models β https://huggingface.co/microsoft/phi-2
LoRA: Low-Rank Adaptation of LLMs Hu et al. (2021). arXiv:2106.09685
Transformers Library Wolf et al. (2020). https://github.com/huggingface/transformers
llama.cpp / GGUF Format Georgi Gerganov (2023). https://github.com/ggerganov/llama.cpp
Ollama https://ollama.com
This model is provided for educational and research purposes only. Redistribution must comply with the license of the base model and the Ollama runtime.