koesn/
llama3-openbiollm-8b

2,012 1 year ago

State-of-the-Art Open Source Biomedical Large Language Model OpenBioLLM-8B is an advanced open source language model designed specifically for the biomedical domain.

Models

View all →

5 models

llama3-openbiollm-8b:latest

4.9GB · 8K context window · Text · 1 year ago

llama3-openbiollm-8b:q4_0

4.7GB · 8K context window · Text · 1 year ago

llama3-openbiollm-8b:q4_K_M

4.9GB · 8K context window · Text · 1 year ago

llama3-openbiollm-8b:q5_K_M

5.7GB · 8K context window · Text · 1 year ago

llama3-openbiollm-8b:q6_K

6.6GB · 8K context window · Text · 1 year ago

Readme

Llama3-OpenBioLLM-8B

Model Quants Size Bit Perplexity
llama3-openbiollm-8b:Q4_0 4.7GB 4 +0.2166 ppl
llama3-openbiollm-8b:Q4_K_M 4.9GB 4 +0.0532 ppl
llama3-openbiollm-8b:Q5_K_M 5.7GB 5 +0.0122 ppl
llama3-openbiollm-8b:Q6_K 6.6GB 6 +0.0008 ppl
Config

“max_position_embeddings” : 8192
“rope_theta” : 500000.0
“vocab_size” : 128256

Remarks
  • ‘latest’ model points to Q4_K_M