775 Downloads Updated 1 year ago
A family of 7B parameter models capable of processing long text documents (LWM-Text, LWM-Text-Chat) of over 1M tokens.
ollama run ifioravanti/lwm
Example:
curl -X POST http://localhost:11434/api/generate -d '{
"model": "ifioravanti/lwm",
"prompt": "Here is a story about llamas eating grass"
}'
7b models generally require at least 8GB of RAM but due to 1M context size this requires a ton of memory depending on the context passed