State-of-the-Art Open Source Biomedical Large Language Model OpenBioLLM-8B is an advanced open source language model designed specifically for the biomedical domain.
338 Pulls Updated 6 months ago
Updated 6 months ago
6 months ago
069ab18bd45f · 4.9GB
model
archllama
·
parameters8.03B
·
quantizationQ4_K_M
4.9GB
params
{"num_keep":24,"stop":["\u003c|start_header_id|\u003e","\u003c|end_header_id|\u003e","\"\u003c|eot_i
114B
system
You are OpenBioLLM, an expert from the healthcare and biomedical domain with extensive knowledge an
189B
template
{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .
256B
Readme
Llama3-OpenBioLLM-8B
| Model Quants | Size | Bit | Perplexity |
|---|---|---|---|
| llama3-openbiollm-8b:Q4_0 | 4.7GB | 4 | +0.2166 ppl |
| llama3-openbiollm-8b:Q4_K_M | 4.9GB | 4 | +0.0532 ppl |
| llama3-openbiollm-8b:Q5_K_M | 5.7GB | 5 | +0.0122 ppl |
| llama3-openbiollm-8b:Q6_K | 6.6GB | 6 | +0.0008 ppl |
Config
“max_position_embeddings” : 8192
“rope_theta” : 500000.0
“vocab_size” : 128256
Remarks
- ‘latest’ model points to Q4_K_M