← Global
reasoning
reasoning ranking
index v0.1.0 · run cmsfulul · 2026-08-05 08:51 UTC| # | Model | Provider | Score (95% CI) | Consist. | Calib. | Contam. Δ | p50 | $/1k | |
|---|---|---|---|---|---|---|---|---|---|
| 1 |  Anthropic: Claude Fable 5 | anthropic | 731 [578–884] | 1.00 | 0.99 | 0.000 | 3.4s | $6.34 | |
| 2 |  DeepSeek: DeepSeek V4 Flash 0731 | deepseek | 730 [576–883] | 0.98 | 1.00 | 0.000 | 520ms | $0.035 | |
| 3 | Anthropic: Claude Sonnet 4.6 | anthropic | 687 [541–833] | 0.98 | 0.99 | 0.038 | 1.1s | $1.77 | |
| 4 |  Amazon: Nova Premier 1.0 | amazon | 684 [538–830] | 0.98 | 0.97 | 0.038 | 320ms | $2.07 | |
| 5 | Anthropic: Claude Sonnet 5 | anthropic | 682 [537–828] | 0.98 | 0.96 | 0.038 | 2.1s | $1.44 |
- #1Anthropic: Claude Fable 5anthropic731 [578–884]consist 1.00calib 0.99Δ 0.0003.4s$6.34/1k
- 730 [576–883]consist 0.98calib 1.00Δ 0.000520ms$0.035/1k
- #3Anthropic: Claude Sonnet 4.6anthropic687 [541–833]consist 0.98calib 0.99Δ 0.0381.1s$1.77/1k
- 684 [538–830]consist 0.98calib 0.97Δ 0.038320ms$2.07/1k
- #5Anthropic: Claude Sonnet 5anthropic682 [537–828]consist 0.98calib 0.96Δ 0.0382.1s$1.44/1k