denisavetisyan/
gemma3-27b-q4_k_m-32k:latest

73 2 months ago

Customized Gemma 3 27B (Q4_K_M) with 32k context window. Optimized for 24GB VRAM GPUs (like NVIDIA GeForce RTX 4090, NVIDIA GeForce RTX 3090, AMD Radeon RX 7900 XTX on Linux).

vision
... /
template
e0a42594d802 · 358B
{{- range $i, $_ := .Messages }}
{{- $last := eq (len (slice $.Messages $i)) 1 }}
{{- if or (eq .Role "user") (eq .Role "system") }}<start_of_turn>user
{{ .Content }}<end_of_turn>
{{ if $last }}<start_of_turn>model
{{ end }}
{{- else if eq .Role "assistant" }}<start_of_turn>model
{{ .Content }}{{ if not $last }}<end_of_turn>
{{ end }}
{{- end }}
{{- end }}