yoshi_likes_e4/
llm-compiler

106 1 year ago

LLM Compiler models released by Meta AI

7b 13b

13 models

llm-compiler:latest
ea4d63e186a8 • 3.8GB • 16K context window •
Text input • 1 year ago
llm-compiler:13b_f16
48c0f1b5b23f • 26GB • 16K context window •
Text input • 1 year ago
llm-compiler:13b_ftd
53255fb7aee1 • 7.4GB • 16K context window •
Text input • 1 year ago
llm-compiler:13b_ftd_f16
e0df953447b2 • 26GB • 16K context window •
Text input • 1 year ago
llm-compiler:13b_ftd_q4_k_m
52dc6155328d • 7.9GB • 16K context window •
Text input • 1 year ago
llm-compiler:13b_ftd_q5_k_m
ae7cc0068a44 • 9.2GB • 16K context window •
Text input • 1 year ago
llm-compiler:13b_q4_k_m
97e044c70e63 • 7.9GB • 16K context window •
Text input • 1 year ago
llm-compiler:13b_q5_k_m
ae59c12a036f • 9.2GB • 16K context window •
Text input • 1 year ago
llm-compiler:7b_ftd
ad6c170a34d0 • 3.8GB • 16K context window •
Text input • 1 year ago
llm-compiler:7b_ftd_q5_k_m
95fae50c8ecb • 4.8GB • 16K context window •
Text input • 1 year ago
llm-compiler:7b_q5_k_m
148e98eda2de • 4.8GB • 16K context window •
Text input • 1 year ago
llm-compiler:7b
bf382038d7f0 • 3.8GB • 16K context window •
Text input • 1 year ago
llm-compiler:13b
d534fe578ea5 • 7.4GB • 16K context window •
Text input • 1 year ago