mrjacktung / phogpt-4b-chat-gguf

PHOGPT-4B-CHAT: SUPERVISED FINE-TUNING VIETNAMESE CHAT MODEL _ w/8K Context size

194 Pulls Updated 5 months ago

6 months ago

13767c94a405 · 7.4GB

model
mpt
·
3.69B
params
{"stop":["<s>","</s>"]}
template
{{ .System }} ### Câu hỏi: {{ .Prompt }}\n### Trả lời:

Readme

PHOGPT-4B-CHAT: SUPERVISED FINE-TUNING VIETNAMESE CHAT MODEL

Model: vinai/PhoGPT-4B-Chat-v0.1
Type: Instruction following & Chat
Model Size: 3.7B params (~7.38GB HDD)
Context length: 8192
Vocab size: 20K
Training data size: 70K instructional prompt and response pairs & 290K conversations
Note: PROMPT_TEMPLATE = "### Câu hỏi: {instruction}\n### Trả lời:"
Example: Ollama-Mistral-with-Langchain-RAG-Agent-and-Custom-tools

Thanks to:

Mr. Tung Nguyen (Data Scientist)
- https://huggingface.co/tom1669/PhoGPT-4B-Chat
- https://www.linkedin.com/posts/tungxuan0111_error-wrong-number-of-tensors-when-serving-activity-7168256575810289665-nxz0
- PhoGPT-4B-Chat-demo.ipynb _ https://colab.research.google.com/drive/1ZjHu_ADtkVTh59WFn253gw-_zcyOSbjH

VinAIResearch:
- https://huggingface.co/vinai/PhoGPT-4B
- https://github.com/VinAIResearch/PhoGPT

Others:
- Ollama: How To Create Custom Models From HuggingFace (GGUF) _ https://www.youtube.com/watch?v=TFwYvHZV6j0
- Adding Custom Models to Ollama _ https://www.youtube.com/watch?v=0ou51l-MLCo