15 Downloads Updated 2 days ago
ollama run turbolego/qwen3.5-0.8b-wcag-gauntlet-lora-q4_k_m
Updated 2 days ago
2 days ago
cc10ea59e975 · 529MB
This is the LoRA-adapted Qwen3.5-0.8B model used to evaluate how the LoRA changes affect performance on the AI-WCAG-Gauntlet benchmark. The benchmark assesses an AI agent’s ability to build an HTML5 showcase that meets WCAG 2.2 Level AAA requirements, including iterative validation and accessibility testing.
ollama run turbolego/qwen3.5-0.8b-wcag-gauntlet-lora-q4_k_m
Compare this model with the paired unadapted baseline, turbolego/qwen3.5-0.8b-base-q4_k_m. Both models use Q4_K_M quantization and the same Ollama prompt template.
For a fair A/B comparison, use the same benchmark instructions, tasks, tools, runtime settings, and evaluation process for both models. Keep the model as the only intentional variable, then compare the benchmark results, including the Agent Performance Score, validation and accessibility findings, HTML5 tag coverage, and iterations required.