beltranaceves/ llama3.1

43 2 months ago

Quantized variants of llama3.1:8b-instruct-fp16 for the purpose of tesing in ContextAgentBench

tools

3 models

llama3.1:8b-instruct-q4
6b9bcc327c8e • 4.9GB • 128K context window •
Text input • 2 months ago
llama3.1:8b-instruct-q4-small
b17954bd5dbe • 4.7GB • 128K context window •
Text input • 2 months ago
llama3.1:8b-instruct-q8
4b07fb9f62ee • 8.5GB • 128K context window •
Text input • 2 months ago