Open beta Zabio is in open beta: anyone can sign up and use it in production. Models, prices and features can still change while we learn from the first customers. Tell us what breaks at hello@zabio.ai.

Model

gemma-4-26b-a4b-it

gemma-4-26b-a4b-it from Google, Fast class. List prices per million tokens, and what the public benchmarks say about it.

Class
Fast
Input, per million
$0.07
Output, per million
$0.34
Cached input
$0.00
Context window
131,072
Longest answer
16,384
Processed by
DeepInfra, Not guaranteed
Processed in
global
Prices from
28 October 2026

Calling it

Name it in the model field, or let auto choose it for you.

"model": "gemma-4-26b-a4b-it"

auto can pick this model when it suits the job and the line you chose.

What it costs

  • Input $0.07 and output $0.34 per million tokens, at the provider list price.
  • Input read from cache: $0.00 per million tokens.

Public results for this model

Zabio has not run its own tests on this model. Everything below is aggregated from public benchmarks, with the sources named.

Aggregated from public resultsRead on 16 November 2026

gemma-4-26b-a4b-it
Analysis and reasoning, Hard: 73.2 +/- 3.2 Evidence, in standard errors: -1.2 GPQA diamond: 73.2 (Close to ours)Analysis and reasoning, Hard73.2Math, Hardest: 82.2 +/- 5.8 Evidence, in standard errors: 0.4 OTIS Mock AIME 2024-2025: 82.2 (Close to ours)Math, Hardest82.2
The benchmarks behind each bar
Kind of jobBenchmarkScoreSettings
Analysis and reasoning, HardGPQA diamond73.2Close to ours
Math, HardestOTIS Mock AIME 2024-202582.2Close to ours
Price against score in each kind of job (2)

Price per 1,000 tasks, USD. Score, %. Greyed out: a cheaper model already scores as well. Ringed: the best, balanced and cheap choice.

Analysis and reasoning, Hard
0255075100$0.1$1$10$100 gpt-oss-20b: 53.2 +/- 2.5, $0.19 gemma-3-4b-it: 23.2 +/- 1.9, $0.19 gpt-oss-120b@deepinfra: 75.8 +/- 2.7, $0.23 gemma-3-12b-it: 39.5 +/- 2.5, $0.24 phi-4: 56.1 +/- 2.6, $0.27 deepseek-v4-flash-0731@deepinfra: 91.0 +/- 1.8, $0.28 gemma-3-27b-it: 47.7 +/- 2.7, $0.30 qwen3.5-9b@deepinfra: 79.0 +/- 2.4, $0.34 qwen3-32b: 65.7 +/- 2.8, $0.41 qwen3.5-9b@parasail: 79.0 +/- 2.4, $0.43 gemma-4-26b-a4b-it: 73.2 +/- 3.2, $0.45 qwen3-14b: 63.8 +/- 2.9, $0.46 gpt-5-nano: 57.6 +/- 3.5, $0.46 deepseek-v4.1-flash-1017@deepinfra: 87.0 +/- 3.1, $0.46 llama-4-scout-17b-16e-instruct: 51.8 +/- 3.2, $0.47 llama-3.3-70b-instruct-turbo@deepinfra: 47.4 +/- 2.9, $0.49 deepseek-v4-flash-0731: 91.0 +/- 1.8, $0.53 deepseek-v4-flash-0731@parasail: 91.0 +/- 1.8, $0.53 qwen3.5-flash-2026-02-23: 82.3 +/- 2.7, $0.56 gpt-4.1-nano: 48.9 +/- 2.5, $0.56 qwen3.5-9b: 79.0 +/- 2.4, $0.57 gpt-6-luna: 73.6 +/- 3.7, $0.65 claude-haiku-5-5: 85.5 +/- 2.8, $0.65 deepseek-flash@deepinfra: 89.8 +/- 1.7, $0.66 qwen3-30b-a3b: 61.7 +/- 3.0, $0.69 glm-5.3-flash: 80.6 +/- 3.3, $0.75 glm-5.3-flash@deepinfra: 80.6 +/- 3.3, $0.75 gemma-4-31b-it: 61.7 +/- 3.6, $0.76 minimax-m3.1-flash: 79.8 +/- 4.7, $0.84 minimax-m3.1-flash@parasail: 79.8 +/- 4.7, $0.84 gpt-oss-120b: 75.8 +/- 2.7, $0.84 gpt-4o-mini: 37.7 +/- 2.4, $0.84 llama-3.3-70b-instruct-turbo@parasail: 47.4 +/- 2.9, $0.89 qwen3.6-35b-a3b@parasail: 83.8 +/- 2.6, $1.01 qwen3.6-35b-a3b@deepinfra: 83.8 +/- 2.6, $1.06 qwen3-30b-a3b-instruct-2507: 55.6 +/- 2.9, $1.12 qwen3.5-35b-a3b@deepinfra: 83.5 +/- 2.2, $1.18 qwen3.5-35b-a3b@parasail: 83.5 +/- 2.2, $1.20 mimo-v2.6-pro: 82.2 +/- 4.1, $1.48 gpt-5.6-luna: 63.6 +/- 3.4, $1.48 gpt-5.4-nano: 55.6 +/- 3.5, $1.53 minimax-m3@deepinfra: 90.9 +/- 2.1, $1.55 deepseek-v4.1-flash-1017: 87.0 +/- 3.1, $1.68 deepseek-v4.1-flash-1017@parasail: 87.0 +/- 3.1, $1.68 deepseek-flash: 89.8 +/- 1.7, $1.68 deepseek-flash@alibaba-intl: 89.8 +/- 1.7, $1.68 deepseek-flash@parasail: 89.8 +/- 1.7, $1.68 deepseek-flash@together: 89.8 +/- 1.7, $1.68 minimax-m3: 90.9 +/- 2.1, $1.68 minimax-m3@parasail: 90.9 +/- 2.1, $1.68 qwen3.7-plus: 87.9 +/- 2.3, $1.79 qwen3.7-plus@alibaba-us: 87.9 +/- 2.3, $1.79 qwen3.6-flash: 83.3 +/- 2.7, $1.85 qwen3.6-flash@alibaba-us: 83.3 +/- 2.7, $1.85 gemini-3.1-flash-lite: 74.2 +/- 3.1, $1.85 qwen-plus-2025-01-25: 48.1 +/- 2.7, $1.88 inkling-small: 88.5 +/- 1.9, $1.98 qwen3.8-27b@deepinfra: 70.7 +/- 5.4, $1.99 deepseek-v4-flash-0731@alibaba-intl: 91.0 +/- 1.8, $2.07 gpt-4.1-mini: 65.9 +/- 2.7, $2.24 qwen3.5-35b-a3b: 83.5 +/- 2.2, $2.30 gpt-5-mini: 71.7 +/- 3.2, $2.30 gpt-3.5-turbo: 27.2 +/- 2.0, $2.35 glm-4.7: 83.3 +/- 2.4, $2.38 qwen3.8-27b@parasail: 70.7 +/- 5.4, $2.46 deepseek-flash-fast@parasail: 89.8 +/- 1.7, $2.52 minimax-m3-fast@parasail: 90.9 +/- 2.1, $2.52 qwen3-235b-a22b-thinking-2507: 80.1 +/- 2.6, $2.53 qwen3-30b-a3b-thinking-2507: 70.1 +/- 2.8, $2.56 glm-5.2@deepinfra: 71.2 +/- 3.2, $2.75 qwen3.6-35b-a3b: 83.8 +/- 2.6, $2.78 gemini-3.5-flash-lite: 75.8 +/- 3.1, $2.85 deepseek-r1-0528: 76.3 +/- 2.4, $2.94 llama-3.3-70b-instruct-turbo: 47.4 +/- 2.9, $3.02 mistral-large-4-0: 84.5 +/- 3.0, $3.29 glm-5.3@deepinfra: 90.9 +/- 1.6, $3.38 qwen3.6-27b@deepinfra: 85.9 +/- 2.5, $3.52 qwen3.5-397b-a17b@deepinfra: 85.9 +/- 2.5, $3.60 qwen3.6-plus: 88.4 +/- 2.3, $3.70 gemini-3-flash-preview: 83.2 +/- 1.9, $3.70 qwen3.8-27b: 70.7 +/- 5.4, $3.70 qwen3.5-397b-a17b@parasail: 85.9 +/- 2.5, $4.24 qwen3.6-27b: 85.9 +/- 2.5, $4.44 qwen3.5-397b-a17b: 85.9 +/- 2.5, $4.44 kimi-k2.6: 90.8 +/- 1.7, $4.65 gemini-3.8-flash: 88.0 +/- 3.0, $4.88 gemini-3.7-flash: 94.8 +/- 1.4, $4.88 gemini-3.5-flash: 88.9 +/- 2.2, $4.88 gemini-3.6-flash: 85.9 +/- 2.5, $4.88 deepseek-v4-pro-0813@deepinfra: 91.7 +/- 1.5, $4.94 deepseek-v4-pro@deepinfra: 73.2 +/- 3.2, $4.94 kimi-k2.7-code: 87.9 +/- 2.3, $5.50 gpt-5.4-mini: 64.1 +/- 3.4, $5.55 inkling: 75.6 +/- 3.7, $5.65 o4-mini: 75.3 +/- 3.1, $6.16 o3-mini: 68.2 +/- 3.3, $6.16 deepseek-v4-pro-0813: 91.7 +/- 1.5, $6.20 deepseek-v4-pro: 73.2 +/- 3.2, $6.20 deepseek-v4-pro@parasail: 73.2 +/- 3.2, $6.20 deepseek-v4-pro@together: 73.2 +/- 3.2, $6.20 gpt-6.1-terra: 87.4 +/- 3.0, $6.50 claude-haiku-4-5: 60.5 +/- 2.8, $6.50 glm-5.3: 90.9 +/- 1.6, $6.76 glm-5.3@alibaba-intl: 90.9 +/- 1.6, $6.76 glm-5.3@parasail: 90.9 +/- 1.6, $6.76 glm-5.1: 89.9 +/- 2.2, $6.76 glm-5.2: 71.2 +/- 3.2, $6.76 glm-5.2@alibaba-intl: 71.2 +/- 3.2, $6.76 glm-5.2@alibaba-us: 71.2 +/- 3.2, $6.76 deepseek-v4-pro-fast@parasail: 73.2 +/- 3.2, $9.31 qwen3.8-max-0902: 84.4 +/- 3.3, $9.40 qwen3.6-max-preview: 87.4 +/- 2.4, $9.62 gemini-4-hydrogen: 87.7 +/- 3.8, $9.75 glm-5.3-fast@parasail: 90.9 +/- 1.6, $10.14 grok-4.6: 91.1 +/- 2.4, $10.34 grok-4.7: 88.3 +/- 2.4, $10.34 o3: 79.8 +/- 2.9, $11.20 gpt-4.1: 66.9 +/- 2.8, $11.20 gpt-5: 71.7 +/- 3.2, $11.50 gpt-5.1: 66.7 +/- 3.4, $11.50 qwen3.7-max: 90.9 +/- 2.1, $11.75 qwen3.7-max@alibaba-us: 90.9 +/- 2.1, $11.75 kimi-k3.1-pro@deepinfra: 86.6 +/- 4.2, $12.35 gemini-4-argon: 92.8 +/- 2.5, $13.00 gemini-4-carbon: 93.2 +/- 2.0, $13.00 gpt-6.1-sol: 92.7 +/- 2.3, $13.00 claude-sonnet-5-5: 91.7 +/- 2.4, $13.00 gpt-6-sol: 94.3 +/- 1.5, $13.00 kimi-k3.1-pro: 86.6 +/- 4.2, $13.00 kimi-k3.1-pro@together: 86.6 +/- 4.2, $13.00 claude-sonnet-5: 80.3 +/- 2.8, $13.00 gpt-4o: 47.9 +/- 2.6, $14.00 gemini-3.1-pro-preview: 94.1 +/- 1.7, $14.80 gpt-5.6-terra: 81.9 +/- 2.9, $14.80 gpt-5.2: 73.2 +/- 3.2, $16.10 gpt-5.4: 74.8 +/- 3.1, $18.50 kimi-k3@deepinfra: 85.1 +/- 2.9, $18.53 kimi-k3: 85.1 +/- 2.9, $19.50 kimi-k3@moonshot: 85.1 +/- 2.9, $19.50 claude-sonnet-4-6: 78.8 +/- 2.9, $19.50 claude-sonnet-4-5: 73.7 +/- 3.1, $19.50 claude-opus-5-5: 90.6 +/- 2.4, $26.00 gpt-5.6-sol: 82.8 +/- 2.7, $26.00 claude-opus-5: 92.9 +/- 1.8, $32.50 claude-opus-4-6: 88.4 +/- 2.3, $32.50 claude-opus-4-7: 86.4 +/- 2.5, $32.50 claude-opus-4-8: 85.4 +/- 2.5, $32.50 claude-opus-4-5: 80.7 +/- 2.4, $32.50 gpt-5.5: 77.3 +/- 3.0, $37.00 gpt-4-turbo: 46.6 +/- 2.7, $47.00 claude-fable-5-2: 92.4 +/- 1.9, $52.00 gpt-6-astra: 93.0 +/- 2.2, $65.00 claude-fable-5-1: 90.1 +/- 3.5, $65.00 claude-fable-5: 78.8 +/- 2.9, $65.00 o1: 50.3 +/- 2.8, $84.00 gpt-4: 35.7 +/- 2.4, $114 gemma-4-26b-a4b-itgemini-3.8-flash Cheapgemini-4-argon Best, Balanced
Math, Hardest
0255075100$1$10$100 gpt-oss-20b: 40.3 +/- 6.3, $0.30 gemma-3-4b-it: 7.5 +/- 2.8, $0.30 gpt-oss-120b@deepinfra: 88.9 +/- 4.5, $0.37 gemma-3-12b-it: 16.7 +/- 4.2, $0.38 phi-4: 13.8 +/- 3.7, $0.42 deepseek-v4-flash-0731@deepinfra: 76.0 +/- 1.8, $0.45 gemma-3-27b-it: 22.5 +/- 5.3, $0.48 qwen3.5-9b@deepinfra: 42.8 +/- 6.5, $0.53 qwen3-32b: 66.9 +/- 6.0, $0.66 qwen3.5-9b@parasail: 42.8 +/- 6.5, $0.68 gemma-4-26b-a4b-it: 82.2 +/- 5.8, $0.72 qwen3-14b: 66.4 +/- 6.2, $0.72 deepseek-v4.1-flash-1017@deepinfra: 85.3 +/- 1.4, $0.74 gpt-5-nano: 21.1 +/- 2.8, $0.75 llama-4-scout-17b-16e-instruct: 3.9 +/- 2.9, $0.75 llama-3.3-70b-instruct-turbo@deepinfra: 5.1 +/- 2.4, $0.78 deepseek-v4-flash-0731: 76.0 +/- 1.8, $0.84 deepseek-v4-flash-0731@parasail: 76.0 +/- 1.8, $0.84 qwen3.5-9b: 42.8 +/- 6.5, $0.89 qwen3.5-flash-2026-02-23: 33.4 +/- 2.0, $0.90 gpt-4.1-nano: 15.0 +/- 3.0, $0.90 gpt-6-luna: 88.9 +/- 1.3, $1.05 claude-haiku-5-5: 86.2 +/- 1.4, $1.05 deepseek-flash@deepinfra: 82.9 +/- 1.4, $1.05 qwen3-30b-a3b: 62.8 +/- 6.2, $1.11 glm-5.3-flash: 74.8 +/- 1.8, $1.20 glm-5.3-flash@deepinfra: 74.8 +/- 1.8, $1.20 gemma-4-31b-it: 73.3 +/- 6.7, $1.20 gpt-oss-120b: 88.9 +/- 4.5, $1.35 gpt-4o-mini: 3.8 +/- 1.4, $1.35 llama-3.3-70b-instruct-turbo@parasail: 5.1 +/- 2.4, $1.41 qwen3.6-35b-a3b@parasail: 53.5 +/- 2.8, $1.65 qwen3.6-35b-a3b@deepinfra: 53.5 +/- 2.8, $1.73 qwen3-30b-a3b-instruct-2507: 62.2 +/- 6.5, $1.80 qwen3.5-35b-a3b@deepinfra: 54.4 +/- 6.2, $1.92 qwen3.5-35b-a3b@parasail: 54.4 +/- 6.2, $1.95 gpt-5.6-luna: 57.3 +/- 4.4, $2.40 gpt-5.4-nano: 25.7 +/- 2.9, $2.48 minimax-m3@deepinfra: 71.1 +/- 6.8, $2.49 deepseek-v4.1-flash-1017: 85.3 +/- 1.4, $2.70 deepseek-v4.1-flash-1017@parasail: 85.3 +/- 1.4, $2.70 deepseek-flash: 82.9 +/- 1.4, $2.70 deepseek-flash@alibaba-intl: 82.9 +/- 1.4, $2.70 deepseek-flash@parasail: 82.9 +/- 1.4, $2.70 deepseek-flash@together: 82.9 +/- 1.4, $2.70 minimax-m3: 71.1 +/- 6.8, $2.70 minimax-m3@parasail: 71.1 +/- 6.8, $2.70 qwen3.7-plus: 63.9 +/- 2.4, $2.88 qwen3.7-plus@alibaba-us: 63.9 +/- 2.4, $2.88 qwen3.6-flash: 37.3 +/- 2.1, $3.00 qwen3.6-flash@alibaba-us: 37.3 +/- 2.1, $3.00 gemini-3.1-flash-lite: 33.5 +/- 3.9, $3.00 qwen-plus-2025-01-25: 17.8 +/- 4.4, $3.00 qwen-plus: 1.7 +/- 0.8, $3.00 inkling-small: 68.2 +/- 2.5, $3.15 deepseek-v4-flash-0731@alibaba-intl: 76.0 +/- 1.8, $3.30 gpt-4.1-mini: 18.6 +/- 2.2, $3.60 qwen3.5-35b-a3b: 54.4 +/- 6.2, $3.75 gpt-5-mini: 34.1 +/- 2.9, $3.75 gpt-3.5-turbo: 1.1 +/- 2.7, $3.75 glm-4.7: 42.9 +/- 2.4, $3.83 deepseek-flash-fast@parasail: 82.9 +/- 1.4, $4.05 minimax-m3-fast@parasail: 71.1 +/- 6.8, $4.05 qwen3-235b-a22b-thinking-2507: 47.6 +/- 2.7, $4.14 qwen3-30b-a3b-thinking-2507: 70.3 +/- 6.0, $4.20 glm-5.2@deepinfra: 41.4 +/- 4.2, $4.39 qwen3.6-35b-a3b: 53.5 +/- 2.8, $4.50 glm-4.6: 3.8 +/- 1.1, $4.50 gemini-3.5-flash-lite: 44.6 +/- 4.2, $4.65 llama-3.3-70b-instruct-turbo: 5.1 +/- 2.4, $4.68 deepseek-r1-0528: 66.4 +/- 4.9, $4.73 mistral-large-4-0: 78.5 +/- 1.5, $5.25 glm-5.3@deepinfra: 79.9 +/- 2.2, $5.44 qwen3.6-27b@deepinfra: 62.6 +/- 2.6, $5.76 qwen3.5-397b-a17b@deepinfra: 60.1 +/- 2.7, $5.85 gemini-3-flash-preview: 59.9 +/- 1.8, $6.00 qwen3.6-plus: 52.6 +/- 1.8, $6.00 qwen3.5-397b-a17b@parasail: 60.1 +/- 2.7, $6.90 qwen3.6-27b: 62.6 +/- 2.6, $7.20 qwen3.5-397b-a17b: 60.1 +/- 2.7, $7.20 kimi-k2.6: 64.1 +/- 1.6, $7.50 deepseek-v4-pro-0813@deepinfra: 81.6 +/- 1.5, $7.80 deepseek-v4-pro@deepinfra: 46.1 +/- 4.6, $7.80 gemini-3.8-flash: 83.7 +/- 1.5, $7.88 gemini-3.7-flash: 84.4 +/- 1.6, $7.88 gemini-3.5-flash: 65.3 +/- 2.2, $7.88 gemini-3.6-flash: 71.7 +/- 3.4, $7.88 kimi-k2.7-code: 74.8 +/- 2.1, $8.85 gpt-5.4-mini: 23.6 +/- 2.7, $9.00 inkling: 61.1 +/- 2.4, $9.08 deepseek-v4-pro-0813: 81.6 +/- 1.5, $9.90 deepseek-v4-pro: 46.1 +/- 4.6, $9.90 deepseek-v4-pro@parasail: 46.1 +/- 4.6, $9.90 deepseek-v4-pro@together: 46.1 +/- 4.6, $9.90 o4-mini: 28.2 +/- 2.7, $9.90 o3-mini: 20.7 +/- 2.7, $9.90 gpt-6.1-terra: 95.4 +/- 2.6, $10.50 claude-haiku-4-5: 20.0 +/- 3.2, $10.50 glm-5.3: 79.9 +/- 2.2, $10.80 glm-5.3@alibaba-intl: 79.9 +/- 2.2, $10.80 glm-5.3@parasail: 79.9 +/- 2.2, $10.80 glm-5.1: 54.5 +/- 1.8, $10.80 glm-5.2: 41.4 +/- 4.2, $10.80 glm-5.2@alibaba-intl: 41.4 +/- 4.2, $10.80 glm-5.2@alibaba-us: 41.4 +/- 4.2, $10.80 deepseek-v4-pro-fast@parasail: 46.1 +/- 4.6, $14.85 qwen3.8-max-0902: 82.8 +/- 2.9, $15.00 qwen3.6-max-preview: 57.1 +/- 2.5, $15.60 glm-5.3-fast@parasail: 79.9 +/- 2.2, $16.20 grok-4.6: 82.6 +/- 1.4, $16.50 grok-4.7: 75.5 +/- 1.6, $16.50 o3: 29.7 +/- 2.7, $18.00 gpt-4.1: 16.6 +/- 2.2, $18.00 qwen3.7-max: 80.1 +/- 2.1, $18.75 qwen3.7-max@alibaba-us: 80.1 +/- 2.1, $18.75 gpt-5: 39.2 +/- 3.0, $18.75 gpt-5.1: 19.9 +/- 3.7, $18.75 gpt-6.1-sol: 96.8 +/- 2.6, $21.00 gemini-4-carbon: 95.3 +/- 2.7, $21.00 gpt-6-sol: 94.9 +/- 2.7, $21.00 claude-sonnet-5-5: 94.4 +/- 2.7, $21.00 gemini-4-argon: 93.0 +/- 2.7, $21.00 claude-sonnet-5: 72.8 +/- 3.3, $21.00 gpt-4o: 2.3 +/- 0.8, $22.50 gemini-3.1-pro-preview: 64.1 +/- 1.7, $24.00 gpt-5.6-terra: 66.8 +/- 4.5, $24.00 gpt-5.2: 51.8 +/- 3.1, $26.25 kimi-k3@deepinfra: 70.4 +/- 4.0, $29.93 gpt-5.4: 60.9 +/- 3.3, $30.00 kimi-k3: 70.4 +/- 4.0, $31.50 kimi-k3@moonshot: 70.4 +/- 4.0, $31.50 claude-sonnet-4-6: 51.8 +/- 3.7, $31.50 claude-sonnet-4-5: 22.8 +/- 2.8, $31.50 claude-opus-5-5: 95.6 +/- 2.6, $42.00 gpt-5.6-sol: 77.2 +/- 4.2, $42.00 claude-opus-5: 92.8 +/- 1.6, $52.50 claude-opus-4-8: 72.3 +/- 2.5, $52.50 claude-opus-4-7: 66.9 +/- 2.2, $52.50 claude-opus-4-6: 61.8 +/- 1.9, $52.50 claude-opus-4-5: 34.4 +/- 2.6, $52.50 gpt-5.5: 69.1 +/- 4.5, $60.00 gpt-4-turbo: 3.7 +/- 1.2, $75.00 claude-fable-5-2: 97.4 +/- 0.7, $84.00 gpt-6-astra: 96.8 +/- 2.6, $105 claude-fable-5-1: 95.1 +/- 2.7, $105 claude-fable-5: 92.9 +/- 1.5, $105 o1: 17.6 +/- 2.8, $135 gpt-4: 1.1 +/- 0.5, $180 gpt-oss-120b@deepinfra Cheapgemma-4-26b-a4b-itdeepseek-v4.1-flash-1017@deepinfra Balancedgpt-6.1-sol Best

Sources

  • Epoch AIEpoch AI, Capabilities and Benchmarking, epoch.ai/benchmarks, retrieved 2026-11-16License: CC BY 4.0Read on 16 November 2026

What these numbers are

  • These numbers come from the sources named on each row, not from Zabio's own tests. Zabio's tests are shown separately and never combined with them into one figure.
  • Sources test models at their own settings. A settings mismatch against how Zabio calls the model is marked on the row and lowers its weight.
  • Scores are compared only inside one benchmark. Task scores combine benchmarks by evidence in standard errors, so a task score is a summary, not a benchmark result.
  • A model missing from every source is listed as such rather than left out.

Results from our own tests have their own section.

Models with no public results yet

These models are in the catalog, and no source we read publishes a result for them.

  • mistral-small-2603
  • codestral-2508
  • chat-latest
  • ministral-3b-2512
  • ministral-8b-2512
  • ministral-14b-2512
  • qwen3.8-2.4t-a95b
  • muse-glimmer-30b
  • qwen3.8-omni-flash
  • qwen3.8-flash
  • qwen3.8-2.4t-a95b@alibaba-intl
  • qwen3.5-plus-2026-04-20
  • qwen3.5-plus-2026-02-15
  • kimi-k3.1-pro-highspeed
  • ling-3.0-flash
  • ling-3.0-flash-vl
  • ling-3.1-flash
  • llama-guard-4-12b
  • muse-glimmer-30b@deepinfra
  • mistral-small-3.2-24b-instruct-2506
  • qwen3-vl-30b-a3b-instruct
  • gpt-audio-1.5
  • gpt-audio
  • gpt-audio-mini
  • ripple-65b-preview
  • glm-5.3-prime

Where to next

How routing picks between these models

Model and company names are trademarks of their owners. Zabio uses these models through their vendors' APIs and is not affiliated with the vendors.