llama3.2:3b-instruct-q3_K_M

35.9M 12 months ago

Meta's Llama 3.2 goes small with 1B and 3B models.

tools 1b 3b

12 months ago

fea4b4677930 · 1.7GB ·

model
llama
·
3.21B
·
Q3_K_M
template
<|start_header_id|>system<|end_header_id|> Cutting Knowledge Date: December 2023 {{ if .System }}{{
license
LLAMA 3.2 COMMUNITY LICENSE AGREEMENT Llama 3.2 Version Release Date: September 25, 2024 “Agreemen
license
**Llama 3.2** **Acceptable Use Policy** Meta is committed to promoting safe and fair use of its tool
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

Readme

The Meta Llama 3.2 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction-tuned generative models in 1B and 3B sizes (text in/text out). The Llama 3.2 instruction-tuned text only models are optimized for multilingual dialogue use cases, including agentic retrieval and summarization tasks. They outperform many of the available open source and closed chat models on common industry benchmarks.

Sizes

3B parameters (default)

The 3B model outperforms the Gemma 2 2.6B and Phi 3.5-mini models on tasks such as:

  • Following instructions
  • Summarization
  • Prompt rewriting
  • Tool use
ollama run llama3.2

1B parameters

The 1B model is competitive with other 1-3B parameter models. It’s use cases include:

  • Personal information management
  • Multilingual knowledge retrieval
  • Rewriting tasks running locally on edge
ollama run llama3.2:1b

Benchmarks

Llama 3.2 instruction-tuned benchmarks

Supported Languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai are officially supported. Llama 3.2 has been trained on a broader collection of languages than these 8 supported languages.