sushruth/mixtao-7bx2-moe

sushruth/

mixtao-7bx2-moe:latest

82 Downloads Updated 1 year ago

🤗 zhengr/MixTAO-7Bx2-MoE-v8.1

Updated 1 year ago

1 year ago

5ce295349de7 · 7.8GB

model

archllama

parameters12.9B

quantizationQ4_K_M

7.8GB

params

{ "num_ctx": 32768, "stop": [ "### Response:", "### Instruction:", "

75B

template

{{ if .System }}### Instruction: {{ .System }}{{ end }} {{ if .Prompt }}### Input: {{ .Prompt }}{{ e

123B

Readme

zhengr/MixTAO-7Bx2-MoE-v8.1

Credits to the user https://huggingface.co/zhengr for the model. I chose to use this for my local ollama for its leaderboard score (given below).

Original GGUF

https://huggingface.co/zhengr/MixTAO-7Bx2-MoE-v8.1-GGUF

Original model
https://huggingface.co/zhengr/MixTAO-7Bx2-MoE-v8.1

MixTAO-7Bx2-MoE is a Mixure of Experts (MoE). This model is mainly used for large model technology experiments, and increasingly perfect iterations will eventually create high-level large language models.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	77.50
AI2 Reasoning Challenge (25-Shot)	73.81
HellaSwag (10-Shot)	89.22
MMLU (5-Shot)	64.92
TruthfulQA (0-shot)	78.57
Winogrande (5-shot)	87.37
GSM8k (5-shot)	71.11

## zhengr/MixTAO-7Bx2-MoE-v8.1

Credits to the user https://huggingface.co/zhengr for the model.
I chose to use this for my local ollama for its leaderboard score (given below).

### Original GGUF
- https://huggingface.co/zhengr/MixTAO-7Bx2-MoE-v8.1-GGUF
### Original model
- https://huggingface.co/zhengr/MixTAO-7Bx2-MoE-v8.1
> MixTAO-7Bx2-MoE is a Mixure of Experts (MoE). This model is mainly used for large model technology experiments, and increasingly perfect iterations will eventually create high-level large language models.

## [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_zhengr__MixTAO-7Bx2-MoE-v8.1)
|             Metric              |Value|
|---------------------------------|----:|
|Avg.                             |77.50|
|AI2 Reasoning Challenge (25-Shot)|73.81|
|HellaSwag (10-Shot)              |89.22|
|MMLU (5-Shot)                    |64.92|
|TruthfulQA (0-shot)              |78.57|
|Winogrande (5-shot)              |87.37|
|GSM8k (5-shot)                   |71.11|

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)