53  Downloads Updated  4 months ago

Using 4096 tokens for flash attention context window to work as intended. Trying a new template and system prompt to see how it reacts.