finalend/
athene-70b

453 1 year ago

Trained through RLHF based off Llama-3-70B-Instruct, high scores on Arena-Hard-Auto.

Models

View all →

12 models

athene-70b:latest

43GB · 8K context window · Text · 1 year ago

athene-70b:Q2_K

26GB · 8K context window · Text · 1 year ago

athene-70b:Q3_K_S

31GB · 8K context window · Text · 1 year ago

athene-70b:Q3_K_M

34GB · 8K context window · Text · 1 year ago

athene-70b:Q3_K_L

37GB · 8K context window · Text · 1 year ago

athene-70b:Q4_K_S

40GB · 8K context window · Text · 1 year ago

athene-70b:Q4_K_M

43GB · 8K context window · Text · 1 year ago

athene-70b:Q5_K_S

49GB · 8K context window · Text · 1 year ago

athene-70b:Q5_K_M

50GB · 8K context window · Text · 1 year ago

athene-70b:Q6_K

58GB · 8K context window · Text · 1 year ago

athene-70b:Q8_0

75GB · 8K context window · Text · 1 year ago

athene-70b:FP16

141GB · 8K context window · Text · 1 year ago

Readme

GGUF source: https://huggingface.co/bullerwins/Athene-70B-GGUF Original source: https://huggingface.co/Nexusflow/Athene-70B

Llama3-Athene-70B

We introduce Llama3-Athene-70B, an open-weights LLM trained through RLHF based off Llama-3-70B-Instruct. Athene-70B achieves a high score on Arena-Hard-Auto, a proxy benchmark for Chatbot Arena.

  • Developed by: The Nexusflow Team (Evan Frick, Peter Jin, Tianle Li*, Karthik Ganesan, Jian Zhang, Jiantao Jiao and Banghua Zhu).
  • Model type: Chat Model
  • Finetuned from model: Llama-3-70B-Instruct.

Blog: https://nexusflow.ai/blogs/athene