heredos/ rwkv7:7.2b

151 3 months ago

an rwkv repo that tries to be less confusing and more up to date with the latest GGUFs

thinking 0.1b 0.4b 1.5b 2.9b 7.2b 
ollama run heredos/rwkv7:7.2b

Details

3 months ago

cd5b705e8cb9 · 4.5GB ·

model
rwkv7
·
7.2B
·
Q4_K_M
params
{ "repeat_penalty": 1.2, "stop": [ "\n\n", "\nUser", "User",
template
{{- if .System }}System: {{ .System }}{{ end }} {{- range $i, $_ := .Messages }} {{- $last := eq (le

Readme

Heredos’s RWKV repo

mollysama’s repo is split into too many confusing repos, so i’m going to try to put here all the latest models, so they can be updated easily, and more easily findable

original repo

  • 0.1b is mostly for testing purposes. (g1a)
  • 0.5b is good at generating names for your chats but not much else (g1a)
  • 1.5b can chat with you and answer some questions. it is not great at reading context/rag. It runs well on my phone, which is a huge plus (g1a3)
  • 2.9b would be my overall pick. it is decent at answering question and is able to take into account some context (not too long a context though). It also runs on phones (but not mine, mine sucks) (g1a)
  • 7.2b is just really good, but i recommend you to use it only if you have an ollama-compatible gpu, or a really beefy CPU. be mindful of your battery life if you run it on a laptop, chances are it won’t trigger your fans, but the power draw is still there. (g0a3)
  • lonely-neko (1.5b) is for those of you who are able to read and write chinese. it is fun to talk to and makes for a great quirky assistant. For some reason it does not appear on this page. maybe ollama is the one who sent her in the void she dreads so much? (base)