453 1 year ago

Trained through RLHF based off Llama-3-70B-Instruct, high scores on Arena-Hard-Auto.

1 year ago

221ac6d3eeca · 31GB ·

llama
·
70.6B
·
Q3_K_S
META LLAMA 3 COMMUNITY LICENSE AGREEMENT Meta Llama 3 Version Release Date: April 18, 2024 “Agreem
{ "num_keep": 24, "stop": [ "<|start_header_id|>", "<|end_header_id|>",
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

Readme

GGUF source: https://huggingface.co/bullerwins/Athene-70B-GGUF Original source: https://huggingface.co/Nexusflow/Athene-70B

Llama3-Athene-70B

We introduce Llama3-Athene-70B, an open-weights LLM trained through RLHF based off Llama-3-70B-Instruct. Athene-70B achieves a high score on Arena-Hard-Auto, a proxy benchmark for Chatbot Arena.

  • Developed by: The Nexusflow Team (Evan Frick, Peter Jin, Tianle Li*, Karthik Ganesan, Jian Zhang, Jiantao Jiao and Banghua Zhu).
  • Model type: Chat Model
  • Finetuned from model: Llama-3-70B-Instruct.

Blog: https://nexusflow.ai/blogs/athene