Open beta Zabio is in open beta: anyone can sign up and use it in production. Models, prices and features can still change while we learn from the first customers. Tell us what breaks at hello@zabio.ai.

Model

qwen3.6-flash

qwen3.6-flash from Qwen, Fast class. List prices per million tokens, and what the public benchmarks say about it.

Class
Fast
Input, per million
$0.25
Output, per million
$1.50
Cached input
$0.05
Context window
1,000,000
Longest answer
65,536
Processed by
Alibaba Cloud (International), Outside mainland China
Processed in
global
Prices from
5 October 2026

Calling it

Name it in the model field, or let auto choose it for you.

"model": "qwen3.6-flash"

Supports: images, tools

What it costs

  • Input $0.25 and output $1.50 per million tokens, at the provider list price.
  • Input read from cache: $0.05 per million tokens.
  • qwen3.6-flash: prompts over 256,001 tokens cost $1.00 in and $4.00 out per 1M tokens.

Public results for this model

Zabio has not run its own tests on this model. Everything below is aggregated from public benchmarks, with the sources named.

Aggregated from public resultsRead on 16 November 2026

qwen3.6-flash
Conversation, Medium: 15.9 +/- 1.2 Evidence, in standard errors: -2.5 SimpleQA Verified: 15.9 (Same settings as ours)Conversation, Medium15.9Analysis and reasoning, Medium: 35.2 +/- 3.4 Evidence, in standard errors: -2.1 SimpleBench: 35.2 (Same settings as ours)Analysis and reasoning, Medium35.2Analysis and reasoning, Hard: 83.3 +/- 2.7 Evidence, in standard errors: 0.1 GPQA diamond: 83.3 (Same settings as ours)Analysis and reasoning, Hard83.3Math, Hardest: 37.3 +/- 2.1 Evidence, in standard errors: -0.6 FrontierMath-2025-02-28-Private: 10.3 (Same settings as ours) FrontierMath-Tiers-1-3-v2-Private: 17.2 (Same settings as ours) OTIS Mock AIME 2024-2025: 84.4 (Same settings as ours)Math, Hardest37.3
The benchmarks behind each bar
Kind of jobBenchmarkScoreSettings
Conversation, MediumSimpleQA Verified15.9Same settings as ours
Analysis and reasoning, MediumSimpleBench35.2Same settings as ours
Analysis and reasoning, HardGPQA diamond83.3Same settings as ours
Math, HardestFrontierMath-2025-02-28-Private10.3Same settings as ours
Math, HardestFrontierMath-Tiers-1-3-v2-Private17.2Same settings as ours
Math, HardestOTIS Mock AIME 2024-202584.4Same settings as ours
Price against score in each kind of job (4)

Price per 1,000 tasks, USD. Score, %. Greyed out: a cheaper model already scores as well. Ringed: the best, balanced and cheap choice.

Conversation, Medium
0255075100$0.1$1$10 deepseek-v4-flash-0731@deepinfra: 33.6 +/- 1.5, $0.17 gpt-5-nano: 11.7 +/- 1.0, $0.24 deepseek-v4.1-flash-1017@deepinfra: 42.5 +/- 1.6, $0.27 qwen3.5-flash-2026-02-23: 20.3 +/- 1.3, $0.32 gpt-4.1-nano: 6.0 +/- 0.8, $0.32 deepseek-v4-flash-0731: 33.6 +/- 1.5, $0.34 deepseek-v4-flash-0731@parasail: 33.6 +/- 1.5, $0.34 gpt-6-luna: 41.4 +/- 1.6, $0.36 claude-haiku-5-5: 23.8 +/- 1.4, $0.36 deepseek-flash@deepinfra: 42.9 +/- 1.6, $0.39 gemma-4-31b-it: 10.4 +/- 1.0, $0.48 gpt-4o-mini: 8.3 +/- 0.9, $0.48 gpt-5.6-luna: 41.0 +/- 1.6, $0.80 gpt-5.4-nano: 11.7 +/- 1.0, $0.82 deepseek-flash: 42.9 +/- 1.6, $0.96 deepseek-flash@alibaba-intl: 42.9 +/- 1.6, $0.96 deepseek-flash@parasail: 42.9 +/- 1.6, $0.96 deepseek-flash@together: 42.9 +/- 1.6, $0.96 deepseek-v4.1-flash-1017: 42.5 +/- 1.6, $0.96 deepseek-v4.1-flash-1017@parasail: 42.5 +/- 1.6, $0.96 qwen3.6-flash: 15.9 +/- 1.2, $1.00 qwen3.6-flash@alibaba-us: 15.9 +/- 1.2, $1.00 inkling-small: 19.1 +/- 1.2, $1.20 gpt-5-mini: 21.6 +/- 1.3, $1.20 deepseek-v4-flash-0731@alibaba-intl: 33.6 +/- 1.5, $1.23 gpt-4.1-mini: 12.7 +/- 1.1, $1.28 qwen3-235b-a22b-thinking-2507: 40.4 +/- 1.6, $1.29 glm-4.7: 32.2 +/- 1.5, $1.34 deepseek-flash-fast@parasail: 42.9 +/- 1.6, $1.44 glm-5.2@deepinfra: 34.2 +/- 1.5, $1.62 glm-5.3@deepinfra: 41.0 +/- 1.6, $1.90 mistral-large-4-0: 20.0 +/- 1.3, $1.96 gemini-3-flash-preview: 66.8 +/- 1.5, $2.00 qwen3.6-plus: 44.1 +/- 1.6, $2.00 kimi-k2.6: 34.9 +/- 1.5, $2.60 gemini-3.8-flash: 69.7 +/- 1.5, $2.70 gemini-3.7-flash: 69.2 +/- 1.5, $2.70 gemini-3.6-flash: 66.2 +/- 1.5, $2.70 gemini-3.5-flash: 66.2 +/- 1.5, $2.70 gpt-5.4-mini: 29.4 +/- 1.4, $3.00 deepseek-v4-pro-0813@deepinfra: 52.9 +/- 1.6, $3.12 deepseek-v4-pro@deepinfra: 47.0 +/- 1.6, $3.12 kimi-k2.7-code: 36.5 +/- 1.5, $3.12 inkling: 40.3 +/- 1.6, $3.22 o4-mini: 19.6 +/- 1.3, $3.52 o3-mini: 15.3 +/- 1.1, $3.52 gpt-6.1-terra: 57.3 +/- 1.6, $3.60 claude-haiku-4-5: 13.2 +/- 1.1, $3.60 deepseek-v4-pro-0813: 52.9 +/- 1.6, $3.70 deepseek-v4-pro: 47.0 +/- 1.6, $3.70 deepseek-v4-pro@parasail: 47.0 +/- 1.6, $3.70 deepseek-v4-pro@together: 47.0 +/- 1.6, $3.70 glm-5.3: 41.0 +/- 1.6, $4.00 glm-5.3@alibaba-intl: 41.0 +/- 1.6, $4.00 glm-5.3@parasail: 41.0 +/- 1.6, $4.00 glm-5.1: 34.0 +/- 1.5, $4.00 glm-5.2: 34.2 +/- 1.5, $4.00 glm-5.2@alibaba-intl: 34.2 +/- 1.5, $4.00 glm-5.2@alibaba-us: 34.2 +/- 1.5, $4.00 qwen3.6-max-preview: 52.0 +/- 1.6, $5.20 deepseek-v4-pro-fast@parasail: 47.0 +/- 1.6, $5.54 qwen3.8-max-0902: 47.3 +/- 1.6, $5.60 glm-5.3-fast@parasail: 41.0 +/- 1.6, $6.00 gpt-5.1: 48.0 +/- 1.6, $6.00 gpt-5: 50.1 +/- 1.6, $6.00 grok-4.6: 49.3 +/- 1.6, $6.16 grok-4.7: 56.0 +/- 1.6, $6.16 o3: 49.4 +/- 1.6, $6.40 gpt-4.1: 31.1 +/- 1.5, $6.40 qwen3.7-max: 55.8 +/- 1.6, $7.00 qwen3.7-max@alibaba-us: 55.8 +/- 1.6, $7.00 gemini-4-carbon: 77.7 +/- 1.3, $7.20 gemini-4-argon: 76.0 +/- 1.4, $7.20 gpt-6.1-sol: 73.9 +/- 1.4, $7.20 gpt-6-sol: 60.7 +/- 1.6, $7.20 claude-sonnet-5-5: 46.5 +/- 1.6, $7.20 claude-sonnet-5: 33.7 +/- 1.5, $7.20 gemini-3.1-pro-preview: 73.5 +/- 1.4, $8.00 gpt-5.6-terra: 43.2 +/- 1.6, $8.00 gpt-4o: 26.0 +/- 1.4, $8.00 gpt-5.2: 32.8 +/- 1.5, $8.40 gpt-5.4: 45.1 +/- 1.6, $10.00 kimi-k3@deepinfra: 50.6 +/- 1.6, $10.26 kimi-k3: 50.6 +/- 1.6, $10.80 kimi-k3@moonshot: 50.6 +/- 1.6, $10.80 claude-sonnet-4-6: 32.8 +/- 1.5, $10.80 claude-sonnet-4-5: 23.7 +/- 1.4, $10.80 claude-opus-5-5: 72.2 +/- 1.4, $14.40 gpt-5.6-sol: 69.7 +/- 1.5, $14.40 claude-opus-4-7: 51.7 +/- 1.6, $18.00 claude-opus-4-8: 53.0 +/- 1.6, $18.00 claude-opus-5: 59.9 +/- 1.6, $18.00 claude-opus-4-6: 47.0 +/- 1.6, $18.00 claude-opus-4-5: 45.7 +/- 1.6, $18.00 gpt-5.5: 63.0 +/- 1.5, $20.00 claude-fable-5-2: 94.0 +/- 0.8, $28.80 claude-fable-5: 70.7 +/- 1.4, $36.00 gpt-6-astra: 75.6 +/- 1.4, $36.00 claude-fable-5-1: 70.8 +/- 1.4, $36.00 o1: 41.1 +/- 1.6, $48.00 qwen3.6-flashgemini-4-carbon Best, Balanced, Cheap
Analysis and reasoning, Medium
0255075100$0.1$1$10 gpt-oss-120b@deepinfra: 22.1 +/- 2.9, $0.10 deepseek-v4-flash-0731@deepinfra: 61.1 +/- 3.5, $0.12 deepseek-v4-flash@deepinfra: 46.3 +/- 3.5, $0.14 llama-3.3-70b-instruct-turbo@deepinfra: 19.9 +/- 2.8, $0.21 deepseek-v4-flash-0731: 61.1 +/- 3.5, $0.22 deepseek-v4-flash-0731@parasail: 61.1 +/- 3.5, $0.22 deepseek-v4-flash@parasail: 46.3 +/- 3.5, $0.22 deepseek-flash@deepinfra: 66.7 +/- 3.3, $0.28 deepseek-v4-flash: 46.3 +/- 3.5, $0.32 gpt-oss-120b: 22.1 +/- 2.9, $0.36 gpt-4o-mini: 10.7 +/- 2.2, $0.36 llama-3.3-70b-instruct-turbo@parasail: 19.9 +/- 2.8, $0.38 gpt-5.6-luna: 46.8 +/- 3.5, $0.64 minimax-m3@deepinfra: 45.8 +/- 3.5, $0.66 deepseek-flash: 66.7 +/- 3.3, $0.72 deepseek-flash@alibaba-intl: 66.7 +/- 3.3, $0.72 deepseek-flash@parasail: 66.7 +/- 3.3, $0.72 deepseek-flash@together: 66.7 +/- 3.3, $0.72 minimax-m3: 45.8 +/- 3.5, $0.72 minimax-m3@parasail: 45.8 +/- 3.5, $0.72 qwen3.6-flash: 35.2 +/- 3.4, $0.80 qwen3.6-flash@alibaba-us: 35.2 +/- 3.4, $0.80 qwen3.8-27b@deepinfra: 60.2 +/- 3.5, $0.87 deepseek-v4-flash-0731@alibaba-intl: 61.1 +/- 3.5, $0.88 mistral-large-2512: 20.4 +/- 2.9, $1.00 glm-4.7: 47.7 +/- 3.5, $1.02 qwen3.8-27b@parasail: 60.2 +/- 3.5, $1.07 deepseek-flash-fast@parasail: 66.7 +/- 3.3, $1.08 minimax-m3-fast@parasail: 45.8 +/- 3.5, $1.08 glm-5.2@deepinfra: 58.8 +/- 3.5, $1.17 llama-3.3-70b-instruct-turbo: 19.9 +/- 2.8, $1.25 deepseek-r1-0528: 40.8 +/- 3.5, $1.26 glm-5.3@deepinfra: 66.2 +/- 3.3, $1.45 gemini-3-flash-preview: 61.1 +/- 3.5, $1.60 qwen3.8-27b: 60.2 +/- 3.5, $1.60 gemini-3.8-flash: 82.4 +/- 2.7, $2.10 gemini-3.5-flash: 76.7 +/- 3.0, $2.10 kimi-k2.7-code: 57.9 +/- 3.5, $2.36 inkling: 50.0 +/- 3.5, $2.42 o4-mini: 38.7 +/- 3.4, $2.64 o3-mini: 22.8 +/- 3.0, $2.64 gpt-6.1-terra: 72.2 +/- 3.2, $2.80 glm-5.3: 66.2 +/- 3.3, $2.88 glm-5.3@alibaba-intl: 66.2 +/- 3.3, $2.88 glm-5.3@parasail: 66.2 +/- 3.3, $2.88 glm-5.2: 58.8 +/- 3.5, $2.88 glm-5.2@alibaba-intl: 58.8 +/- 3.5, $2.88 glm-5.2@alibaba-us: 58.8 +/- 3.5, $2.88 glm-5.1: 55.1 +/- 3.5, $2.88 qwen3.6-max-preview: 63.0 +/- 3.4, $4.16 glm-5.3-fast@parasail: 66.2 +/- 3.3, $4.32 grok-4.6: 75.9 +/- 3.0, $4.40 o3: 53.1 +/- 3.5, $4.80 gpt-4.1: 27.0 +/- 3.1, $4.80 qwen3.7-max: 70.4 +/- 3.2, $5.00 qwen3.7-max@alibaba-us: 70.4 +/- 3.2, $5.00 gpt-5: 56.7 +/- 3.5, $5.00 gpt-5.1: 53.2 +/- 3.5, $5.00 gemini-4-carbon: 92.6 +/- 1.9, $5.60 gemini-4-argon: 91.7 +/- 2.0, $5.60 gpt-6.1-sol: 82.9 +/- 2.7, $5.60 claude-sonnet-5-5: 75.9 +/- 3.0, $5.60 gpt-6-sol: 73.1 +/- 3.1, $5.60 claude-sonnet-5: 60.6 +/- 3.5, $5.60 gpt-4o: 17.8 +/- 2.7, $6.00 gemini-3.1-pro-preview: 79.6 +/- 2.9, $6.40 gpt-5.6-terra: 48.9 +/- 3.5, $6.40 gpt-5.2: 45.8 +/- 3.5, $7.00 kimi-k3@deepinfra: 60.7 +/- 3.5, $7.98 kimi-k3: 60.7 +/- 3.5, $8.40 kimi-k3@moonshot: 60.7 +/- 3.5, $8.40 claude-sonnet-4-5: 54.3 +/- 3.5, $8.40 claude-opus-5-5: 88.4 +/- 2.3, $11.20 gpt-5.6-sol: 71.7 +/- 3.2, $11.20 claude-opus-5: 80.6 +/- 2.8, $14.00 claude-opus-4-6: 67.6 +/- 3.3, $14.00 claude-opus-4-8: 64.8 +/- 3.4, $14.00 claude-opus-4-5: 62.0 +/- 3.4, $14.00 claude-opus-4-7: 61.7 +/- 3.4, $14.00 gpt-5.5: 69.0 +/- 3.3, $16.00 gpt-4-turbo: 25.1 +/- 3.1, $20.00 claude-fable-5-2: 94.9 +/- 1.6, $22.40 claude-fable-5-1: 86.6 +/- 2.4, $28.00 gpt-6-astra: 86.5 +/- 2.4, $28.00 claude-fable-5: 81.9 +/- 2.7, $28.00 o1: 41.7 +/- 3.5, $36.00 qwen3.6-flashgemini-4-carbon Best, Balanced, Cheap
Analysis and reasoning, Hard
0255075100$0.1$1$10$100 gpt-oss-20b: 53.2 +/- 2.5, $0.19 gemma-3-4b-it: 23.2 +/- 1.9, $0.19 gpt-oss-120b@deepinfra: 75.8 +/- 2.7, $0.23 gemma-3-12b-it: 39.5 +/- 2.5, $0.24 phi-4: 56.1 +/- 2.6, $0.27 deepseek-v4-flash-0731@deepinfra: 91.0 +/- 1.8, $0.28 gemma-3-27b-it: 47.7 +/- 2.7, $0.30 qwen3.5-9b@deepinfra: 79.0 +/- 2.4, $0.34 qwen3-32b: 65.7 +/- 2.8, $0.41 qwen3.5-9b@parasail: 79.0 +/- 2.4, $0.43 gemma-4-26b-a4b-it: 73.2 +/- 3.2, $0.45 qwen3-14b: 63.8 +/- 2.9, $0.46 gpt-5-nano: 57.6 +/- 3.5, $0.46 deepseek-v4.1-flash-1017@deepinfra: 87.0 +/- 3.1, $0.46 llama-4-scout-17b-16e-instruct: 51.8 +/- 3.2, $0.47 llama-3.3-70b-instruct-turbo@deepinfra: 47.4 +/- 2.9, $0.49 deepseek-v4-flash-0731: 91.0 +/- 1.8, $0.53 deepseek-v4-flash-0731@parasail: 91.0 +/- 1.8, $0.53 qwen3.5-flash-2026-02-23: 82.3 +/- 2.7, $0.56 gpt-4.1-nano: 48.9 +/- 2.5, $0.56 qwen3.5-9b: 79.0 +/- 2.4, $0.57 gpt-6-luna: 73.6 +/- 3.7, $0.65 claude-haiku-5-5: 85.5 +/- 2.8, $0.65 deepseek-flash@deepinfra: 89.8 +/- 1.7, $0.66 qwen3-30b-a3b: 61.7 +/- 3.0, $0.69 glm-5.3-flash: 80.6 +/- 3.3, $0.75 glm-5.3-flash@deepinfra: 80.6 +/- 3.3, $0.75 gemma-4-31b-it: 61.7 +/- 3.6, $0.76 minimax-m3.1-flash: 79.8 +/- 4.7, $0.84 minimax-m3.1-flash@parasail: 79.8 +/- 4.7, $0.84 gpt-oss-120b: 75.8 +/- 2.7, $0.84 gpt-4o-mini: 37.7 +/- 2.4, $0.84 llama-3.3-70b-instruct-turbo@parasail: 47.4 +/- 2.9, $0.89 qwen3.6-35b-a3b@parasail: 83.8 +/- 2.6, $1.01 qwen3.6-35b-a3b@deepinfra: 83.8 +/- 2.6, $1.06 qwen3-30b-a3b-instruct-2507: 55.6 +/- 2.9, $1.12 qwen3.5-35b-a3b@deepinfra: 83.5 +/- 2.2, $1.18 qwen3.5-35b-a3b@parasail: 83.5 +/- 2.2, $1.20 mimo-v2.6-pro: 82.2 +/- 4.1, $1.48 gpt-5.6-luna: 63.6 +/- 3.4, $1.48 gpt-5.4-nano: 55.6 +/- 3.5, $1.53 minimax-m3@deepinfra: 90.9 +/- 2.1, $1.55 deepseek-v4.1-flash-1017: 87.0 +/- 3.1, $1.68 deepseek-v4.1-flash-1017@parasail: 87.0 +/- 3.1, $1.68 deepseek-flash: 89.8 +/- 1.7, $1.68 deepseek-flash@alibaba-intl: 89.8 +/- 1.7, $1.68 deepseek-flash@parasail: 89.8 +/- 1.7, $1.68 deepseek-flash@together: 89.8 +/- 1.7, $1.68 minimax-m3: 90.9 +/- 2.1, $1.68 minimax-m3@parasail: 90.9 +/- 2.1, $1.68 qwen3.7-plus: 87.9 +/- 2.3, $1.79 qwen3.7-plus@alibaba-us: 87.9 +/- 2.3, $1.79 qwen3.6-flash: 83.3 +/- 2.7, $1.85 qwen3.6-flash@alibaba-us: 83.3 +/- 2.7, $1.85 gemini-3.1-flash-lite: 74.2 +/- 3.1, $1.85 qwen-plus-2025-01-25: 48.1 +/- 2.7, $1.88 inkling-small: 88.5 +/- 1.9, $1.98 qwen3.8-27b@deepinfra: 70.7 +/- 5.4, $1.99 deepseek-v4-flash-0731@alibaba-intl: 91.0 +/- 1.8, $2.07 gpt-4.1-mini: 65.9 +/- 2.7, $2.24 qwen3.5-35b-a3b: 83.5 +/- 2.2, $2.30 gpt-5-mini: 71.7 +/- 3.2, $2.30 gpt-3.5-turbo: 27.2 +/- 2.0, $2.35 glm-4.7: 83.3 +/- 2.4, $2.38 qwen3.8-27b@parasail: 70.7 +/- 5.4, $2.46 deepseek-flash-fast@parasail: 89.8 +/- 1.7, $2.52 minimax-m3-fast@parasail: 90.9 +/- 2.1, $2.52 qwen3-235b-a22b-thinking-2507: 80.1 +/- 2.6, $2.53 qwen3-30b-a3b-thinking-2507: 70.1 +/- 2.8, $2.56 glm-5.2@deepinfra: 71.2 +/- 3.2, $2.75 qwen3.6-35b-a3b: 83.8 +/- 2.6, $2.78 gemini-3.5-flash-lite: 75.8 +/- 3.1, $2.85 deepseek-r1-0528: 76.3 +/- 2.4, $2.94 llama-3.3-70b-instruct-turbo: 47.4 +/- 2.9, $3.02 mistral-large-4-0: 84.5 +/- 3.0, $3.29 glm-5.3@deepinfra: 90.9 +/- 1.6, $3.38 qwen3.6-27b@deepinfra: 85.9 +/- 2.5, $3.52 qwen3.5-397b-a17b@deepinfra: 85.9 +/- 2.5, $3.60 qwen3.6-plus: 88.4 +/- 2.3, $3.70 gemini-3-flash-preview: 83.2 +/- 1.9, $3.70 qwen3.8-27b: 70.7 +/- 5.4, $3.70 qwen3.5-397b-a17b@parasail: 85.9 +/- 2.5, $4.24 qwen3.6-27b: 85.9 +/- 2.5, $4.44 qwen3.5-397b-a17b: 85.9 +/- 2.5, $4.44 kimi-k2.6: 90.8 +/- 1.7, $4.65 gemini-3.8-flash: 88.0 +/- 3.0, $4.88 gemini-3.7-flash: 94.8 +/- 1.4, $4.88 gemini-3.5-flash: 88.9 +/- 2.2, $4.88 gemini-3.6-flash: 85.9 +/- 2.5, $4.88 deepseek-v4-pro-0813@deepinfra: 91.7 +/- 1.5, $4.94 deepseek-v4-pro@deepinfra: 73.2 +/- 3.2, $4.94 kimi-k2.7-code: 87.9 +/- 2.3, $5.50 gpt-5.4-mini: 64.1 +/- 3.4, $5.55 inkling: 75.6 +/- 3.7, $5.65 o4-mini: 75.3 +/- 3.1, $6.16 o3-mini: 68.2 +/- 3.3, $6.16 deepseek-v4-pro-0813: 91.7 +/- 1.5, $6.20 deepseek-v4-pro: 73.2 +/- 3.2, $6.20 deepseek-v4-pro@parasail: 73.2 +/- 3.2, $6.20 deepseek-v4-pro@together: 73.2 +/- 3.2, $6.20 gpt-6.1-terra: 87.4 +/- 3.0, $6.50 claude-haiku-4-5: 60.5 +/- 2.8, $6.50 glm-5.3: 90.9 +/- 1.6, $6.76 glm-5.3@alibaba-intl: 90.9 +/- 1.6, $6.76 glm-5.3@parasail: 90.9 +/- 1.6, $6.76 glm-5.1: 89.9 +/- 2.2, $6.76 glm-5.2: 71.2 +/- 3.2, $6.76 glm-5.2@alibaba-intl: 71.2 +/- 3.2, $6.76 glm-5.2@alibaba-us: 71.2 +/- 3.2, $6.76 deepseek-v4-pro-fast@parasail: 73.2 +/- 3.2, $9.31 qwen3.8-max-0902: 84.4 +/- 3.3, $9.40 qwen3.6-max-preview: 87.4 +/- 2.4, $9.62 gemini-4-hydrogen: 87.7 +/- 3.8, $9.75 glm-5.3-fast@parasail: 90.9 +/- 1.6, $10.14 grok-4.6: 91.1 +/- 2.4, $10.34 grok-4.7: 88.3 +/- 2.4, $10.34 o3: 79.8 +/- 2.9, $11.20 gpt-4.1: 66.9 +/- 2.8, $11.20 gpt-5: 71.7 +/- 3.2, $11.50 gpt-5.1: 66.7 +/- 3.4, $11.50 qwen3.7-max: 90.9 +/- 2.1, $11.75 qwen3.7-max@alibaba-us: 90.9 +/- 2.1, $11.75 kimi-k3.1-pro@deepinfra: 86.6 +/- 4.2, $12.35 gemini-4-argon: 92.8 +/- 2.5, $13.00 gemini-4-carbon: 93.2 +/- 2.0, $13.00 gpt-6.1-sol: 92.7 +/- 2.3, $13.00 claude-sonnet-5-5: 91.7 +/- 2.4, $13.00 gpt-6-sol: 94.3 +/- 1.5, $13.00 kimi-k3.1-pro: 86.6 +/- 4.2, $13.00 kimi-k3.1-pro@together: 86.6 +/- 4.2, $13.00 claude-sonnet-5: 80.3 +/- 2.8, $13.00 gpt-4o: 47.9 +/- 2.6, $14.00 gemini-3.1-pro-preview: 94.1 +/- 1.7, $14.80 gpt-5.6-terra: 81.9 +/- 2.9, $14.80 gpt-5.2: 73.2 +/- 3.2, $16.10 gpt-5.4: 74.8 +/- 3.1, $18.50 kimi-k3@deepinfra: 85.1 +/- 2.9, $18.53 kimi-k3: 85.1 +/- 2.9, $19.50 kimi-k3@moonshot: 85.1 +/- 2.9, $19.50 claude-sonnet-4-6: 78.8 +/- 2.9, $19.50 claude-sonnet-4-5: 73.7 +/- 3.1, $19.50 claude-opus-5-5: 90.6 +/- 2.4, $26.00 gpt-5.6-sol: 82.8 +/- 2.7, $26.00 claude-opus-5: 92.9 +/- 1.8, $32.50 claude-opus-4-6: 88.4 +/- 2.3, $32.50 claude-opus-4-7: 86.4 +/- 2.5, $32.50 claude-opus-4-8: 85.4 +/- 2.5, $32.50 claude-opus-4-5: 80.7 +/- 2.4, $32.50 gpt-5.5: 77.3 +/- 3.0, $37.00 gpt-4-turbo: 46.6 +/- 2.7, $47.00 claude-fable-5-2: 92.4 +/- 1.9, $52.00 gpt-6-astra: 93.0 +/- 2.2, $65.00 claude-fable-5-1: 90.1 +/- 3.5, $65.00 claude-fable-5: 78.8 +/- 2.9, $65.00 o1: 50.3 +/- 2.8, $84.00 gpt-4: 35.7 +/- 2.4, $114 qwen3.6-flashgemini-3.8-flash Cheapgemini-4-argon Best, Balanced
Math, Hardest
0255075100$1$10$100 gpt-oss-20b: 40.3 +/- 6.3, $0.30 gemma-3-4b-it: 7.5 +/- 2.8, $0.30 gpt-oss-120b@deepinfra: 88.9 +/- 4.5, $0.37 gemma-3-12b-it: 16.7 +/- 4.2, $0.38 phi-4: 13.8 +/- 3.7, $0.42 deepseek-v4-flash-0731@deepinfra: 76.0 +/- 1.8, $0.45 gemma-3-27b-it: 22.5 +/- 5.3, $0.48 qwen3.5-9b@deepinfra: 42.8 +/- 6.5, $0.53 qwen3-32b: 66.9 +/- 6.0, $0.66 qwen3.5-9b@parasail: 42.8 +/- 6.5, $0.68 gemma-4-26b-a4b-it: 82.2 +/- 5.8, $0.72 qwen3-14b: 66.4 +/- 6.2, $0.72 deepseek-v4.1-flash-1017@deepinfra: 85.3 +/- 1.4, $0.74 gpt-5-nano: 21.1 +/- 2.8, $0.75 llama-4-scout-17b-16e-instruct: 3.9 +/- 2.9, $0.75 llama-3.3-70b-instruct-turbo@deepinfra: 5.1 +/- 2.4, $0.78 deepseek-v4-flash-0731: 76.0 +/- 1.8, $0.84 deepseek-v4-flash-0731@parasail: 76.0 +/- 1.8, $0.84 qwen3.5-9b: 42.8 +/- 6.5, $0.89 qwen3.5-flash-2026-02-23: 33.4 +/- 2.0, $0.90 gpt-4.1-nano: 15.0 +/- 3.0, $0.90 gpt-6-luna: 88.9 +/- 1.3, $1.05 claude-haiku-5-5: 86.2 +/- 1.4, $1.05 deepseek-flash@deepinfra: 82.9 +/- 1.4, $1.05 qwen3-30b-a3b: 62.8 +/- 6.2, $1.11 glm-5.3-flash: 74.8 +/- 1.8, $1.20 glm-5.3-flash@deepinfra: 74.8 +/- 1.8, $1.20 gemma-4-31b-it: 73.3 +/- 6.7, $1.20 gpt-oss-120b: 88.9 +/- 4.5, $1.35 gpt-4o-mini: 3.8 +/- 1.4, $1.35 llama-3.3-70b-instruct-turbo@parasail: 5.1 +/- 2.4, $1.41 qwen3.6-35b-a3b@parasail: 53.5 +/- 2.8, $1.65 qwen3.6-35b-a3b@deepinfra: 53.5 +/- 2.8, $1.73 qwen3-30b-a3b-instruct-2507: 62.2 +/- 6.5, $1.80 qwen3.5-35b-a3b@deepinfra: 54.4 +/- 6.2, $1.92 qwen3.5-35b-a3b@parasail: 54.4 +/- 6.2, $1.95 gpt-5.6-luna: 57.3 +/- 4.4, $2.40 gpt-5.4-nano: 25.7 +/- 2.9, $2.48 minimax-m3@deepinfra: 71.1 +/- 6.8, $2.49 deepseek-v4.1-flash-1017: 85.3 +/- 1.4, $2.70 deepseek-v4.1-flash-1017@parasail: 85.3 +/- 1.4, $2.70 deepseek-flash: 82.9 +/- 1.4, $2.70 deepseek-flash@alibaba-intl: 82.9 +/- 1.4, $2.70 deepseek-flash@parasail: 82.9 +/- 1.4, $2.70 deepseek-flash@together: 82.9 +/- 1.4, $2.70 minimax-m3: 71.1 +/- 6.8, $2.70 minimax-m3@parasail: 71.1 +/- 6.8, $2.70 qwen3.7-plus: 63.9 +/- 2.4, $2.88 qwen3.7-plus@alibaba-us: 63.9 +/- 2.4, $2.88 qwen3.6-flash: 37.3 +/- 2.1, $3.00 qwen3.6-flash@alibaba-us: 37.3 +/- 2.1, $3.00 gemini-3.1-flash-lite: 33.5 +/- 3.9, $3.00 qwen-plus-2025-01-25: 17.8 +/- 4.4, $3.00 qwen-plus: 1.7 +/- 0.8, $3.00 inkling-small: 68.2 +/- 2.5, $3.15 deepseek-v4-flash-0731@alibaba-intl: 76.0 +/- 1.8, $3.30 gpt-4.1-mini: 18.6 +/- 2.2, $3.60 qwen3.5-35b-a3b: 54.4 +/- 6.2, $3.75 gpt-5-mini: 34.1 +/- 2.9, $3.75 gpt-3.5-turbo: 1.1 +/- 2.7, $3.75 glm-4.7: 42.9 +/- 2.4, $3.83 deepseek-flash-fast@parasail: 82.9 +/- 1.4, $4.05 minimax-m3-fast@parasail: 71.1 +/- 6.8, $4.05 qwen3-235b-a22b-thinking-2507: 47.6 +/- 2.7, $4.14 qwen3-30b-a3b-thinking-2507: 70.3 +/- 6.0, $4.20 glm-5.2@deepinfra: 41.4 +/- 4.2, $4.39 qwen3.6-35b-a3b: 53.5 +/- 2.8, $4.50 glm-4.6: 3.8 +/- 1.1, $4.50 gemini-3.5-flash-lite: 44.6 +/- 4.2, $4.65 llama-3.3-70b-instruct-turbo: 5.1 +/- 2.4, $4.68 deepseek-r1-0528: 66.4 +/- 4.9, $4.73 mistral-large-4-0: 78.5 +/- 1.5, $5.25 glm-5.3@deepinfra: 79.9 +/- 2.2, $5.44 qwen3.6-27b@deepinfra: 62.6 +/- 2.6, $5.76 qwen3.5-397b-a17b@deepinfra: 60.1 +/- 2.7, $5.85 gemini-3-flash-preview: 59.9 +/- 1.8, $6.00 qwen3.6-plus: 52.6 +/- 1.8, $6.00 qwen3.5-397b-a17b@parasail: 60.1 +/- 2.7, $6.90 qwen3.6-27b: 62.6 +/- 2.6, $7.20 qwen3.5-397b-a17b: 60.1 +/- 2.7, $7.20 kimi-k2.6: 64.1 +/- 1.6, $7.50 deepseek-v4-pro-0813@deepinfra: 81.6 +/- 1.5, $7.80 deepseek-v4-pro@deepinfra: 46.1 +/- 4.6, $7.80 gemini-3.8-flash: 83.7 +/- 1.5, $7.88 gemini-3.7-flash: 84.4 +/- 1.6, $7.88 gemini-3.5-flash: 65.3 +/- 2.2, $7.88 gemini-3.6-flash: 71.7 +/- 3.4, $7.88 kimi-k2.7-code: 74.8 +/- 2.1, $8.85 gpt-5.4-mini: 23.6 +/- 2.7, $9.00 inkling: 61.1 +/- 2.4, $9.08 deepseek-v4-pro-0813: 81.6 +/- 1.5, $9.90 deepseek-v4-pro: 46.1 +/- 4.6, $9.90 deepseek-v4-pro@parasail: 46.1 +/- 4.6, $9.90 deepseek-v4-pro@together: 46.1 +/- 4.6, $9.90 o4-mini: 28.2 +/- 2.7, $9.90 o3-mini: 20.7 +/- 2.7, $9.90 gpt-6.1-terra: 95.4 +/- 2.6, $10.50 claude-haiku-4-5: 20.0 +/- 3.2, $10.50 glm-5.3: 79.9 +/- 2.2, $10.80 glm-5.3@alibaba-intl: 79.9 +/- 2.2, $10.80 glm-5.3@parasail: 79.9 +/- 2.2, $10.80 glm-5.1: 54.5 +/- 1.8, $10.80 glm-5.2: 41.4 +/- 4.2, $10.80 glm-5.2@alibaba-intl: 41.4 +/- 4.2, $10.80 glm-5.2@alibaba-us: 41.4 +/- 4.2, $10.80 deepseek-v4-pro-fast@parasail: 46.1 +/- 4.6, $14.85 qwen3.8-max-0902: 82.8 +/- 2.9, $15.00 qwen3.6-max-preview: 57.1 +/- 2.5, $15.60 glm-5.3-fast@parasail: 79.9 +/- 2.2, $16.20 grok-4.6: 82.6 +/- 1.4, $16.50 grok-4.7: 75.5 +/- 1.6, $16.50 o3: 29.7 +/- 2.7, $18.00 gpt-4.1: 16.6 +/- 2.2, $18.00 qwen3.7-max: 80.1 +/- 2.1, $18.75 qwen3.7-max@alibaba-us: 80.1 +/- 2.1, $18.75 gpt-5: 39.2 +/- 3.0, $18.75 gpt-5.1: 19.9 +/- 3.7, $18.75 gpt-6.1-sol: 96.8 +/- 2.6, $21.00 gemini-4-carbon: 95.3 +/- 2.7, $21.00 gpt-6-sol: 94.9 +/- 2.7, $21.00 claude-sonnet-5-5: 94.4 +/- 2.7, $21.00 gemini-4-argon: 93.0 +/- 2.7, $21.00 claude-sonnet-5: 72.8 +/- 3.3, $21.00 gpt-4o: 2.3 +/- 0.8, $22.50 gemini-3.1-pro-preview: 64.1 +/- 1.7, $24.00 gpt-5.6-terra: 66.8 +/- 4.5, $24.00 gpt-5.2: 51.8 +/- 3.1, $26.25 kimi-k3@deepinfra: 70.4 +/- 4.0, $29.93 gpt-5.4: 60.9 +/- 3.3, $30.00 kimi-k3: 70.4 +/- 4.0, $31.50 kimi-k3@moonshot: 70.4 +/- 4.0, $31.50 claude-sonnet-4-6: 51.8 +/- 3.7, $31.50 claude-sonnet-4-5: 22.8 +/- 2.8, $31.50 claude-opus-5-5: 95.6 +/- 2.6, $42.00 gpt-5.6-sol: 77.2 +/- 4.2, $42.00 claude-opus-5: 92.8 +/- 1.6, $52.50 claude-opus-4-8: 72.3 +/- 2.5, $52.50 claude-opus-4-7: 66.9 +/- 2.2, $52.50 claude-opus-4-6: 61.8 +/- 1.9, $52.50 claude-opus-4-5: 34.4 +/- 2.6, $52.50 gpt-5.5: 69.1 +/- 4.5, $60.00 gpt-4-turbo: 3.7 +/- 1.2, $75.00 claude-fable-5-2: 97.4 +/- 0.7, $84.00 gpt-6-astra: 96.8 +/- 2.6, $105 claude-fable-5-1: 95.1 +/- 2.7, $105 claude-fable-5: 92.9 +/- 1.5, $105 o1: 17.6 +/- 2.8, $135 gpt-4: 1.1 +/- 0.5, $180 gpt-oss-120b@deepinfra Cheapdeepseek-v4.1-flash-1017@deepinfra Balancedqwen3.6-flashgpt-6.1-sol Best

Sources

  • Epoch AIEpoch AI, Capabilities and Benchmarking, epoch.ai/benchmarks, retrieved 2026-11-16License: CC BY 4.0Read on 16 November 2026

What these numbers are

  • These numbers come from the sources named on each row, not from Zabio's own tests. Zabio's tests are shown separately and never combined with them into one figure.
  • Sources test models at their own settings. A settings mismatch against how Zabio calls the model is marked on the row and lowers its weight.
  • Scores are compared only inside one benchmark. Task scores combine benchmarks by evidence in standard errors, so a task score is a summary, not a benchmark result.
  • A model missing from every source is listed as such rather than left out.

Results from our own tests have their own section.

Models with no public results yet

These models are in the catalog, and no source we read publishes a result for them.

  • mistral-small-2603
  • codestral-2508
  • chat-latest
  • ministral-3b-2512
  • ministral-8b-2512
  • ministral-14b-2512
  • qwen3.8-2.4t-a95b
  • muse-glimmer-30b
  • qwen3.8-omni-flash
  • qwen3.8-flash
  • qwen3.8-2.4t-a95b@alibaba-intl
  • qwen3.5-plus-2026-04-20
  • qwen3.5-plus-2026-02-15
  • kimi-k3.1-pro-highspeed
  • ling-3.0-flash
  • ling-3.0-flash-vl
  • ling-3.1-flash
  • llama-guard-4-12b
  • muse-glimmer-30b@deepinfra
  • mistral-small-3.2-24b-instruct-2506
  • qwen3-vl-30b-a3b-instruct
  • gpt-audio-1.5
  • gpt-audio
  • gpt-audio-mini
  • ripple-65b-preview
  • glm-5.3-prime

Where to next

How routing picks between these models

Model and company names are trademarks of their owners. Zabio uses these models through their vendors' APIs and is not affiliated with the vendors.