A small language model that simulates a QuietStar like behaviour in a simplified agentic way.

Models

Name

4 models

Size

Context

Input

thoughtstream:latest

3.3GB · 8K context window · Text · 1 year ago

thoughtstream:latest

3.3GB

Text

thoughtstream:4b-v01-q4_K_S

2.3GB · 8K context window · Text · 1 year ago

thoughtstream:4b-v01-q4_K_S

2.3GB

Text

thoughtstream:4b-v01-q5_K_S

2.7GB · 8K context window · Text · 1 year ago

thoughtstream:4b-v01-q5_K_S

2.7GB

Text

thoughtstream:4b-v01-q6_K

3.3GB · 8K context window · Text · 1 year ago

thoughtstream:4b-v01-q6_K

3.3GB

Text

This model is based on h2oai/h2o-danube3-4b-base and fine-tuned using LoRA+ and BAdam with LLama-Factory. It uses the ChatML template, without a system message, and was trained on the ThoughtfulAssistant-v01 dataset.

The idea is to abstract the thoughts away or into a thought bubble when chatting.