- Rank
- #26
- Total Output Tokens
- 38,453
- Response Time (avg)
- 6.24s
- Total Cost
- $0.183
Gemini 3.7 Flash (low) vs Qwen3.6 35B A3B (medium)
Gemini 3.7 Flash (low) leads on average score with 9.4 vs 6.5. Gemini 3.7 Flash (low) has the lower benchmark cost at $0.183 vs $0.834. Gemini 3.7 Flash (low) is faster at 6.24s vs 59.92s, with pass rates of 95.7% vs 58.0%.
Compared models
- Rank
- #232
- Total Output Tokens
- 769,570
- Response Time (avg)
- 59.92s
- Total Cost
- $0.834
Recommended model
Gemini 3.7 Flash (low)
It has the best score here (9.4), while costing about 4.6x less than Qwen3.6 35B A3B (medium).
Detailed comparison
| Metric | Gemini 3.7 Flash Gemini 3.7 Flash low | Qwen3.6 35B A3B Qwen3.6 35B A3B medium |
|---|---|---|
| Score | 9.4 | 6.5 |
| Rank | #26 | #232 |
| Reliability | 10.0 | 10.0 |
| Consistency | 9.3 | 9.0 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 95.7% | 58.0% |
| Flaky tests | 2 | 3 |
| Total Runs | 69 | 69 |
| Cost per result | 0.868 | 6.732 |
| Total Cost | $0.183 | $0.834 |
| Input Price | $0.750 / 1M | $0.150 / 1M |
| Output Price | $3.750 / 1M | $1.000 / 1M |
| Cache Read Price | $0.075 / 1M | $0.050 / 1M |
| Cache Write Price | $0.042 / 1M | N/A |
| Total Input Tokens | 188,519 | 282,192 |
| Output Tokens | 7,694 | 75,306 |
| Reasoning Tokens | 30,759 | 700,868 |
| Response Time (avg) | 6.24s | 59.92s |
| Response Time (max) | 58.75s | 817.57s |
| Response Time (total) | 143.56s | 1258.32s |
| Parameters | ~500B total (~20B active) | 35B total (3B active) |
| Availability | Closed | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#26 Gemini 3.7 Flash
low- Cost
- $0.010
- Time
- 23.5s
- Tokens
- 5,210 tok
#232 Qwen3.6 35B A3B
medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
- Cost
- $0.000
- Time
- 300.0s
- Tokens
- 0 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 58.75s | 98,197 | 1,400 | 0 | |
| Qwen3.6 35B A3B | 6.1 | 3.1 | 66.7% | 1 | 88.48s | 197,044 | 13,570 | 19,312 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 1.54s | 492 | 99 | 1,398 | |
| Qwen3.6 35B A3B | 10.0 | 10.0 | 100.0% | 0 | 6.02s | 672 | 1,154 | 12,385 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 7.6 | 7.2 | 77.8% | 1 | 6.20s | 8,118 | 461 | 11,508 | |
| Qwen3.6 35B A3B | 7.7 | 10.0 | 66.7% | 0 | 50.55s | 5,051 | 7,929 | 37,223 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 13.00s | 66,250 | 4,873 | 8,108 | |
| Qwen3.6 35B A3B | 3.0 | 10.0 | 0.0% | 0 | 817.57s | 68,754 | 42,187 | 548,547 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.15s | 7,548 | 278 | 1,093 | |
| Qwen3.6 35B A3B | 10.0 | 10.0 | 100.0% | 0 | 12.99s | 7,776 | 2,591 | 9,968 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 8.2 | 7.2 | 88.9% | 1 | 3.09s | 642 | 12 | 3,029 | |
| Qwen3.6 35B A3B | 2.9 | 4.4 | 22.2% | 2 | 25.39s | 780 | 6,110 | 41,906 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.76s | 486 | 81 | 1,043 | |
| Qwen3.6 35B A3B | 4.4 | 9.9 | 0.0% | 0 | 8.66s | 516 | 129 | 4,569 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.47s | 615 | 72 | 1,778 | |
| Qwen3.6 35B A3B | 10.0 | 10.0 | 100.0% | 0 | 7.50s | 699 | 219 | 7,404 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 1.92s | 558 | 166 | 1,580 | |
| Qwen3.6 35B A3B | 8.0 | 10.0 | 66.7% | 0 | 5.95s | 696 | 655 | 9,228 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 4.10s | 5,457 | 241 | 160 | |
| Qwen3.6 35B A3B | 3.0 | 10.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.92s | 156 | 11 | 1,062 | |
| Qwen3.6 35B A3B | 3.0 | 10.0 | 0.0% | 0 | 32.90s | 204 | 762 | 10,326 |
Quick Compare
Switch Comparison Pair
Minimax M3.1 FlashhighFree AvailablevsQwen3.6 35B A3BmediumClaude Opus 5highvsGemini 3.7 FlashlowMercury 2.5 PreviewhighvsQwen3.6 35B A3BmediumClaude Opus 5mediumvsGemini 3.7 FlashlowMercury 2.5highvsQwen3.6 35B A3BmediumQwen3.6 35B A3BmediumvsBeam 1.0 501B A23BxhighQwen3.6 35B A3BmediumvsGLM 5.3lowClaude Opus 5.5highvsGemini 3.7 FlashlowQwen3.6 35B A3BmediumvsGLM 5.1noneKAT-Coder-Pro V2.5lowvsQwen3.6 35B A3BmediumKAT-Coder-Pro V2.5highvsQwen3.6 35B A3BmediumQwen3.6 35B A3BmediumvsStep 3.7 Flashhigh