State-of-the-Art Open Source Biomedical Large Language Model OpenBioLLM-8B is an advanced open source language model designed specifically for the biomedical domain.

8B

256 Pulls Updated 4 months ago

Readme

Llama3-OpenBioLLM-8B

Model Quants Size Bit Perplexity
llama3-openbiollm-8b:Q4_0 4.7GB 4 +0.2166 ppl
llama3-openbiollm-8b:Q4_K_M 4.9GB 4 +0.0532 ppl
llama3-openbiollm-8b:Q5_K_M 5.7GB 5 +0.0122 ppl
llama3-openbiollm-8b:Q6_K 6.6GB 6 +0.0008 ppl
Config

“max_position_embeddings” : 8192
“rope_theta” : 500000.0
“vocab_size” : 128256

Remarks
  • ‘latest’ model points to Q4_K_M