koesn/llama3-openbiollm-8b:q4_K

koesn/

llama3-openbiollm-8b:q4_K_M

2,012 Downloads Updated 1 year ago

State-of-the-Art Open Source Biomedical Large Language Model OpenBioLLM-8B is an advanced open source language model designed specifically for the biomedical domain.

Updated 1 year ago

1 year ago

069ab18bd45f · 4.9GB ·

archllama

parameters8.03B

quantizationQ4_K_M

4.9GB

You are OpenBioLLM, an expert from the healthcare and biomedical domain with extensive knowledge and

189B

{ "num_keep": 24, "stop": [ "<|start_header_id|>", "<|end_header_id|>",

114B

{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

256B

Llama3-OpenBioLLM-8B

Model Quants	Size	Bit	Perplexity
llama3-openbiollm-8b:Q4_0	4.7GB	4	+0.2166 ppl
llama3-openbiollm-8b:Q4_K_M	4.9GB	4	+0.0532 ppl
llama3-openbiollm-8b:Q5_K_M	5.7GB	5	+0.0122 ppl
llama3-openbiollm-8b:Q6_K	6.6GB	6	+0.0008 ppl

“max_position_embeddings” : 8192
“rope_theta” : 500000.0
“vocab_size” : 128256