trollek / thoughtstream

A small language model that simulates a QuietStar like behaviour in a simplified agentic way.

3B

4 Pulls Updated 8 weeks ago

8 weeks ago

87768a4d56ab · 2.3GB

model
llama
·
3.96B
·
Q4_K_S
template
<|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant
params
{"num_ctx":8192,"num_predict":2048,"stop":["<|im_end|>","<|im_start|>"],"temperature":0.5,"top_k":40,"top_p":0.85}

Readme

ThoughtStream-4B-v0.1

This model is based on h2oai/h2o-danube3-4b-base and fine-tuned using LoRA+ and BAdam with LLama-Factory. It uses the ChatML template, without a system message, and was trained on the ThoughtfulAssistant-v01 dataset.

The idea is to abstract the thoughts away or into a thought bubble when chatting.

HF repo: trollek/ThoughtStream-4B-v0.1
Quants: mradermacher/ThoughtStream-4B-v0.1-GGUF