← Global
code
code ranking
index v0.1.0 · run cmsfulul · 2026-08-05 08:51 UTC| # | Model | Provider | Score (95% CI) | Consist. | Calib. | Contam. Δ | p50 | $/1k | |
|---|---|---|---|---|---|---|---|---|---|
| 1 |  DeepSeek: DeepSeek V4 Flash 0731 | deepseek | 801 [644–959] | 1.00 | 1.00 | 0.000 | 570ms | $0.063 | |
| 2 |  Anthropic: Claude Sonnet 4.6 | anthropic | 800 [642–957] | 1.00 | 0.99 | 0.000 | 1.2s | $6.63 | |
| 3 | Anthropic: Claude Sonnet 5 | anthropic | 799 [642–956] | 1.00 | 0.99 | 0.000 | 2.7s | $3.13 | |
| 4 | DeepSeek: DeepSeek V4 Pro | deepseek | 751 [599–903] | 1.00 | 0.97 | 0.038 | 1.6s | $0.406 | |
| 5 |  Amazon: Nova Premier 1.0 | amazon | 570 [439–701] | 0.92 | 0.87 | 0.154 | 368ms | $6.54 | |
| 6 | Anthropic: Claude Fable 5 | anthropic | 509 [470–548] | 1.00 | 0.99 | 0.000 | 3.8s | $10.83 |
- 801 [644–959]consist 1.00calib 1.00Δ 0.000570ms$0.063/1k
- #2Anthropic: Claude Sonnet 4.6anthropic800 [642–957]consist 1.00calib 0.99Δ 0.0001.2s$6.63/1k
- #3Anthropic: Claude Sonnet 5anthropic799 [642–956]consist 1.00calib 0.99Δ 0.0002.7s$3.13/1k
- #4DeepSeek: DeepSeek V4 Prodeepseek751 [599–903]consist 1.00calib 0.97Δ 0.0381.6s$0.406/1k
- 570 [439–701]consist 0.92calib 0.87Δ 0.154368ms$6.54/1k
- #6Anthropic: Claude Fable 5anthropic509 [470–548]consist 1.00calib 0.99Δ 0.0003.8s$10.83/1k