codellama

A large language model that can use text prompts to generate and discuss code.

411.2K Pulls Updated 3 months ago

199 Tags

3 months ago

e59b580dfce7 · 39GB

model
llama
·
69B
·
4-bit
params
{"stop":["Source:","Destination:","<step>"]}
template
{{ if .System }} Source: system {{ .System }} <step>{{ end }} Source: user {{ .Prompt }} <step> Source: assistant Destination: user

Readme

Code Llama is a model for generating and discussing code, built on top of Llama 2. It’s designed to make workflows faster and efficient for developers and make it easier for people to learn how to code. It can generate both code and natural language about code. Code Llama supports many of the most popular programming languages used today, including Python, C++, Java, PHP, Typescript (Javascript), C#, Bash and more.

Parameter counts

Parameter Count
7 billion View ollama run codellama:7b
13 billion View ollama run codellama:13b
34 billion View ollama run codellama:34b
70 billion View ollama run codellama:70b

Usage

CLI

ollama run codellama "Write me a function that outputs the fibonacci sequence"

API

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "codellama",
  "prompt": "Write me a function that outputs the fibonacci sequence"
}'

Variations
instruct Fine-tuned to generate helpful and safe answers in natural language
python A specialized variation of Code Llama further fine-tuned on 100B tokens of Python code
code Base model for code completion

Example prompts

Ask questions

ollama run codellama:7b-instruct 'You are an expert programmer that writes simple, concise code and explanations. Write a python function to generate the nth fibonacci number.'

Fill-in-the-middle (FIM) or infill

ollama run codellama:7b-code '<PRE> def compute_gcd(x, y): <SUF>return result <MID>'

Fill-in-the-middle (FIM) is a special prompt format supported by the code completion model can complete code between two already written code blocks. Code Llama expects a specific format for infilling code:

<PRE> {prefix} <SUF>{suffix} <MID>

<PRE>, <SUF> and <MID> are special tokens that guide the model.

Code review

ollama run codellama '
Where is the bug in this code?

def fib(n):
    if n <= 0:
        return n
    else:
        return fib(n-1) + fib(n-2)
'

Writing tests

ollama run codellama "write a unit test for this function: $(cat example.py)"

Code completion

ollama run codellama:7b-code '# A simple python function to remove whitespace from a string:'

More information