smurugadass/
llm:latest

37 1 year ago

It's most powerful text prompts, completion and generation based LLM model built on top of other Opensource Models

1 year ago

660b34d64525 · 12GB

llama
·
7.24B
·
Q4_0
llama
·
6.74B
·
Q4_0
llama
·
6.74B
·
Q4_0
# Llama 2 Acceptable Use Policy Meta is committed to promoting safe and fair use of its tools and fe
{ "rope_frequency_base": 1000000, "stop": [ "[INST]", "[/INST]", "<<
# Llama Code Acceptable Use Policy Meta is committed to promoting safe and fair use of its tools and
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{ "stop": [ "[INST]", "[/INST]", "<<SYS>>", "<</SYS>>" ] }
You are a friendly assistant.
LLAMA 2 COMMUNITY LICENSE AGREEMENT Llama 2 Version Release Date: July 18, 2023 "Agreement" means th
{{ .System }}<|end_of_turn|>GPT4 Correct User: {{ .Prompt }}<|end_of_turn|>GPT4 Correct Assistant:
{ "stop": [ "<|endoftext|>", "<|end_of_turn|>" ] }
[INST] <<SYS>>{{ .System }}<</SYS>> {{ .Prompt }} [/INST]

Readme

smurugadass/llm is a large language model built on top of other open-source models, inspired by Gemma, Openchat, and Llama2.

Getting Started

Using the CLI

Open your terminal and run the following command:

ollama run smurugadass/llm

API Example

Here’s an example of how to use the Smurugadass LLM API with cURL to retrieve the count of orders from the Opensearch database for the last 4 days:

curl -X POST http://localhost:11434/api/generate -d ‘{
  “model”: “smurugadass/llm”,
  “prompt”: “Write a query to get count of last 4 days orders from Opensearch Database”
  }’

Memory Requirements

The memory requirements for large language models vary depending on their size. Here’s a general guideline:

  • 7B models generally require at least 8GB of RAM.
  • 70B models generally require at least 64GB of RAM.