This is the llama.cpp GGUF Quantised version of Hermes 2 Pro Llama-3 8B from Nous Research with function calling capabilities.
714 Pulls Updated 6 months ago
Updated 6 months ago
6 months ago
0d517b216f9f · 6.6GB
Readme
Hermes 2 Pro - Llama-3 8B - GGUF
Description
Hermes 2 Pro is a state-of-the-art LLM developed by Nous Research. It’s based on the Llama 3 architecture with 8 billion parameters. It offers advanced capabilities in natural language processing, creative writing, coding assistance, and more.
Prompt Format
Hermes 2 Pro uses ChatML as the prompt format, opening up a much more structured system for engaging the LLM in multi-turn chat dialogue. It uses a system prompt to establish rules and roles, and steer the interaction between the user and the model.
Function Calling
The Hermes-Function-Calling repository contains code for the model to perform function calling based on the provided schema. It allows users to query the model and retrieve information related to stock prices, company fundamentals, financial statements, and more.