Ornith-1.0-35B MoE (APEX-Compact 17GB): 1M context, vision, fits 32GB cards. 50/50 needles to 524K.
Custom model for coding with agents to use locally with 24gb or 2x16gb GPUs (working fine...)
Custom model for coding with agents to use locally with 32gb, 2x16gb or 5x8gb GPUs (working very well!!)
Para linux arch