Model Introduction

This project is based on the latest open-source model Llama-3 released by Meta, which includes the Chinese Llama-3 base model and the Chinese Llama-3 Install instruction fine-tuning model. These models use large-scale Chinese data for incremental pre training on the basis of the original Llama-3, and fine tune with selected instruction data, further improving the ability to understand Chinese basic semantics and instructions, and achieving significant performance improvements compared to second-generation related models.

Main content

• 🚀 Open source Llama-3 Chinese base model and Llama-3 Chinese Instrument instruction model
• 🚀 Open source pre training scripts and instruction fine-tuning scripts are available, allowing users to further train or fine tune the model as needed
• 🚀 Open source alpaca_zh_51k, stem_zh_instruction, ruozhiba_gpt4_turbo instructions for fine-tuning data
• 🚀 Provided a tutorial on using personal computer CPU/GPU to quickly quantify and deploy large-scale models locally

CLI

Open the terminal and run ollama run suntray-instruct

API

Example using curl:

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "suntray-instruct",
  "prompt":"I would like to know more about bidding information"
 }'