finalend/ athene-70b

462 2 years ago

Trained through RLHF based off Llama-3-70B-Instruct, high scores on Arena-Hard-Auto.

12 models

athene-70b:latest
b57fc3f5453e • 43GB • 8K context window •
Text input • 2 years ago
athene-70b:Q2_K
344c8d6c8a26 • 26GB • 8K context window •
Text input • 2 years ago
athene-70b:Q3_K_S
221ac6d3eeca • 31GB • 8K context window •
Text input • 2 years ago
athene-70b:Q3_K_M
90f7b7ecccaa • 34GB • 8K context window •
Text input • 2 years ago
athene-70b:Q3_K_L
57fc18f94415 • 37GB • 8K context window •
Text input • 2 years ago
athene-70b:Q4_K_S
c2168dec1804 • 40GB • 8K context window •
Text input • 2 years ago
athene-70b:Q4_K_M
b57fc3f5453e • 43GB • 8K context window •
Text input • 2 years ago
athene-70b:Q5_K_S
e48939ceccc5 • 49GB • 8K context window •
Text input • 2 years ago
athene-70b:Q5_K_M
f926eca8b8b7 • 50GB • 8K context window •
Text input • 2 years ago
athene-70b:Q6_K
66294c878baa • 58GB • 8K context window •
Text input • 2 years ago
athene-70b:Q8_0
d982209906e2 • 75GB • 8K context window •
Text input • 2 years ago
athene-70b:FP16
d65d041b3cf6 • 141GB • 8K context window •
Text input • 2 years ago