← Global
vision ocr
vision ocr ranking
index v0.2.0 · run cmsg3a05 · 2026-08-05 12:54 UTC| # | Model | Provider | Score (95% CI) | Consist. | Calib. | Contam. Δ | p50 | $/1k | |
|---|---|---|---|---|---|---|---|---|---|
| 1 | ByteDance Seed: Seed-2.0-Lite | bytedance-seed | 752 [581–923] | 1.00 | 1.00 | 0.000 | 2.0s | $0.563 | |
| 2 |  Google: Gemini 3.5 Flash | 752 [581–923] | 1.00 | 1.00 | 0.000 | 2.6s | $5.81 | ||
| 3 | Google: Gemini 3.1 Pro Preview | 752 [581–923] | 1.00 | 1.00 | 0.000 | 3.4s | $7.68 | ||
| 4 | Nex AGI: Nex-N2-Mini | nex-agi | 752 [581–923] | 1.00 | 1.00 | 0.000 | 1.5s | $0.028 | |
| 5 | ByteDance Seed: Seed-2.0-Mini | bytedance-seed | 752 [581–923] | 1.00 | 1.00 | 0.000 | 1.3s | $0.180 | |
| 6 | Google: Gemma 4 31B | 752 [581–923] | 1.00 | 1.00 | 0.000 | 914ms | $0.062 | ||
| 7 | Google: Gemini 3.5 Flash Lite | 752 [581–923] | 1.00 | 1.00 | 0.000 | 1.1s | $0.594 | ||
| 8 | Google: Gemini 3.1 Flash Lite | 752 [581–923] | 1.00 | 1.00 | 0.000 | 1.3s | $0.417 | ||
| 9 | Perceptron: Perceptron Mk1 | perceptron | 752 [581–923] | 1.00 | 1.00 | 0.000 | 450ms | $0.162 | |
| 10 |  Meta: Llama 4 Maverick | meta-llama | 752 [581–923] | 1.00 | 1.00 | 0.000 | 456ms | $0.364 | |
| 11 |  OpenAI: GPT-5.5 | openai | 751 [579–922] | 1.00 | 0.99 | 0.000 | 460ms | $7.53 | |
| 12 |  Anthropic: Claude Opus 4.8 (Fast) | anthropic | 750 [579–922] | 1.00 | 0.98 | 0.000 | 1.5s | $10.99 | |
| 13 | Anthropic: Claude Sonnet 4.6 | anthropic | 750 [579–921] | 1.00 | 0.98 | 0.000 | 2.0s | $3.20 | |
| 14 | Anthropic: Claude Opus 4.7 | anthropic | 749 [578–920] | 1.00 | 0.97 | 0.000 | 2.2s | $5.37 | |
| 15 | Anthropic: Claude Opus 4.6 | anthropic | 749 [578–921] | 1.00 | 0.97 | 0.000 | 2.4s | $5.26 | |
| 16 | Claude Opus 5 (Fast) | anthropic | 748 [577–919] | 1.00 | 0.96 | 0.000 | 2.3s | $11.56 | |
| 17 | Claude Opus 5 | anthropic | 748 [577–919] | 1.00 | 0.96 | 0.000 | 4.4s | $5.66 | |
| 18 | Anthropic: Claude Sonnet 5 | anthropic | 748 [577–919] | 1.00 | 0.96 | 0.000 | 2.2s | $2.13 | |
| 19 | OpenAI: GPT-5.6 Luna Pro | openai | 746 [575–918] | 0.97 | 0.99 | 0.000 | 450ms | $0.641 | |
| 20 |  MoonshotAI: Kimi K3 | moonshotai | 729 [565–893] | 0.98 | 0.94 | 0.000 | 4.2s | $5.89 | |
| 21 | Google: Gemini 3.6 Flash | 708 [544–873] | 1.00 | 1.00 | 0.038 | 2.5s | $6.00 | ||
| 22 | Anthropic: Claude Opus 4.8 | anthropic | 705 [541–869] | 1.00 | 0.97 | 0.038 | 1.8s | $5.54 | |
| 23 |  Mistral: Ministral 3 8B 2512 | mistralai | 705 [541–869] | 1.00 | 0.97 | 0.038 | 670ms | $0.140 | |
| 24 | MoonshotAI: Kimi K2.6 | moonshotai | 703 [538–869] | 1.00 | 0.97 | 0.040 | 2.4s | $1.92 | |
| 25 | Google: Gemma 4 26B A4B | 703 [538–867] | 0.98 | 0.97 | 0.038 | 938ms | $0.057 | ||
| 26 | ByteDance: UI-TARS 7B | bytedance | 703 [538–867] | 0.98 | 0.97 | 0.038 | 640ms | $0.092 | |
| 27 | Google: Gemini 3.1 Flash Lite Preview | 701 [535–866] | 0.98 | 0.97 | 0.040 | 1.1s | $0.409 | ||
| 28 | OpenAI: GPT-5.6 Sol | openai | 657 [500–814] | 1.00 | 0.94 | 0.077 | 490ms | $5.33 | |
| 29 | OpenAI: GPT-5.6 Sol Pro | openai | 657 [500–814] | 1.00 | 0.94 | 0.077 | 459ms | $23.98 | |
| 30 | Mistral: Mistral Large 3 2512 | mistralai | 656 [499–813] | 0.98 | 0.96 | 0.077 | 2.4s | $0.483 | |
| 31 | OpenAI: GPT-5.6 Terra Pro | openai | 656 [518–795] | 0.97 | 0.88 | 0.000 | 399ms | $5.74 | |
| 32 | Perplexity: Sonar | perplexity | 655 [498–812] | 0.98 | 0.95 | 0.077 | 908ms | $0.899 | |
| 33 | Meta: Llama 4 Scout | meta-llama | 654 [497–811] | 0.98 | 0.93 | 0.077 | 374ms | $0.160 | |
| 34 | OpenAI: GPT-5.4 | openai | 654 [497–811] | 0.97 | 0.96 | 0.077 | 465ms | $2.30 | |
| 35 | Nex AGI: Nex-N2-Pro | nex-agi | 654 [497–811] | 0.98 | 0.94 | 0.077 | 1.8s | $0.300 | |
| 36 |  MiniMax: MiniMax M3 | minimax | 648 [491–805] | 0.95 | 0.93 | 0.077 | 2.1s | $0.434 | |
| 37 | OpenAI: GPT-5.4 Mini | openai | 612 [488–736] | 0.93 | 0.86 | 0.000 | 530ms | $0.696 | |
| 38 |  Amazon: Nova Premier 1.0 | amazon | 606 [457–756] | 1.00 | 0.90 | 0.115 | 1.1s | $4.23 | |
| 39 | Mistral: Mistral Medium 3.5 | mistralai | 604 [454–753] | 0.98 | 0.90 | 0.115 | 861ms | $1.53 | |
| 40 | MoonshotAI: Kimi K2.5 | moonshotai | 604 [455–754] | 0.98 | 0.91 | 0.115 | 2.4s | $2.09 | |
| 41 | Anthropic: Claude Fable 5 | anthropic | 559 [471–648] | 1.00 | 0.98 | 0.000 | 4.0s | $11.30 | |
| 42 | OpenAI: GPT-5.6 Terra | openai | 554 [455–653] | 0.95 | 0.79 | 0.000 | 551ms | $1.37 | |
| 43 | Amazon: Nova Lite 1.0 | amazon | 543 [404–681] | 0.97 | 0.90 | 0.154 | 882ms | $0.080 | |
| 44 | Mistral: Ministral 3 14B 2512 | mistralai | 540 [401–678] | 0.97 | 0.87 | 0.154 | 670ms | $0.186 | |
| 45 | OpenAI: GPT-5.6 Luna | openai | 472 [348–596] | 0.97 | 0.84 | 0.192 | 486ms | $0.141 | |
| 46 | Amazon: Nova 2 Lite | amazon | 466 [342–590] | 0.93 | 0.83 | 0.192 | 948ms | $0.142 | |
| 47 | MoonshotAI: Kimi K2.7 Code | moonshotai | 379 [291–468] | 0.81 | 0.97 | 0.308 | 752ms | $2.98 | |
| 48 | OpenAI: GPT-5.4 Nano | openai | 323 [299–348] | 0.65 | 0.47 | 0.000 | 613ms | $0.184 | |
| 49 | Mistral: Mistral Small 4 | mistralai | 250 [209–291] | 0.93 | 0.47 | 0.327 | 989ms | $0.150 |
- #1ByteDance Seed: Seed-2.0-Litebytedance-seed752 [581–923]consist 1.00calib 1.00Δ 0.0002.0s$0.563/1k
- 752 [581–923]consist 1.00calib 1.00Δ 0.0002.6s$5.81/1k
- 752 [581–923]consist 1.00calib 1.00Δ 0.0003.4s$7.68/1k
- #4Nex AGI: Nex-N2-Mininex-agi752 [581–923]consist 1.00calib 1.00Δ 0.0001.5s$0.028/1k
- #5ByteDance Seed: Seed-2.0-Minibytedance-seed752 [581–923]consist 1.00calib 1.00Δ 0.0001.3s$0.180/1k
- #6Google: Gemma 4 31Bgoogle752 [581–923]consist 1.00calib 1.00Δ 0.000914ms$0.062/1k
- 752 [581–923]consist 1.00calib 1.00Δ 0.0001.1s$0.594/1k
- 752 [581–923]consist 1.00calib 1.00Δ 0.0001.3s$0.417/1k
- #9Perceptron: Perceptron Mk1perceptron752 [581–923]consist 1.00calib 1.00Δ 0.000450ms$0.162/1k
- #10Meta: Llama 4 Maverickmeta-llama752 [581–923]consist 1.00calib 1.00Δ 0.000456ms$0.364/1k
- #11OpenAI: GPT-5.5openai751 [579–922]consist 1.00calib 0.99Δ 0.000460ms$7.53/1k
- #12Anthropic: Claude Opus 4.8 (Fast)anthropic750 [579–922]consist 1.00calib 0.98Δ 0.0001.5s$10.99/1k
- #13Anthropic: Claude Sonnet 4.6anthropic750 [579–921]consist 1.00calib 0.98Δ 0.0002.0s$3.20/1k
- #14Anthropic: Claude Opus 4.7anthropic749 [578–920]consist 1.00calib 0.97Δ 0.0002.2s$5.37/1k
- #15Anthropic: Claude Opus 4.6anthropic749 [578–921]consist 1.00calib 0.97Δ 0.0002.4s$5.26/1k
- #16Claude Opus 5 (Fast)anthropic748 [577–919]consist 1.00calib 0.96Δ 0.0002.3s$11.56/1k
- #17Claude Opus 5anthropic748 [577–919]consist 1.00calib 0.96Δ 0.0004.4s$5.66/1k
- #18Anthropic: Claude Sonnet 5anthropic748 [577–919]consist 1.00calib 0.96Δ 0.0002.2s$2.13/1k
- 746 [575–918]consist 0.97calib 0.99Δ 0.000450ms$0.641/1k
- #20MoonshotAI: Kimi K3moonshotai729 [565–893]consist 0.98calib 0.94Δ 0.0004.2s$5.89/1k
- 708 [544–873]consist 1.00calib 1.00Δ 0.0382.5s$6.00/1k
- #22Anthropic: Claude Opus 4.8anthropic705 [541–869]consist 1.00calib 0.97Δ 0.0381.8s$5.54/1k
- #23Mistral: Ministral 3 8B 2512mistralai705 [541–869]consist 1.00calib 0.97Δ 0.038670ms$0.140/1k
- #24MoonshotAI: Kimi K2.6moonshotai703 [538–869]consist 1.00calib 0.97Δ 0.0402.4s$1.92/1k
- #25Google: Gemma 4 26B A4B google703 [538–867]consist 0.98calib 0.97Δ 0.038938ms$0.057/1k
- #26ByteDance: UI-TARS 7B bytedance703 [538–867]consist 0.98calib 0.97Δ 0.038640ms$0.092/1k
- 701 [535–866]consist 0.98calib 0.97Δ 0.0401.1s$0.409/1k
- #28OpenAI: GPT-5.6 Solopenai657 [500–814]consist 1.00calib 0.94Δ 0.077490ms$5.33/1k
- 657 [500–814]consist 1.00calib 0.94Δ 0.077459ms$23.98/1k
- #30Mistral: Mistral Large 3 2512mistralai656 [499–813]consist 0.98calib 0.96Δ 0.0772.4s$0.483/1k
- 656 [518–795]consist 0.97calib 0.88Δ 0.000399ms$5.74/1k
- #32Perplexity: Sonarperplexity655 [498–812]consist 0.98calib 0.95Δ 0.077908ms$0.899/1k
- #33Meta: Llama 4 Scoutmeta-llama654 [497–811]consist 0.98calib 0.93Δ 0.077374ms$0.160/1k
- #34OpenAI: GPT-5.4openai654 [497–811]consist 0.97calib 0.96Δ 0.077465ms$2.30/1k
- #35Nex AGI: Nex-N2-Pronex-agi654 [497–811]consist 0.98calib 0.94Δ 0.0771.8s$0.300/1k
- #36MiniMax: MiniMax M3minimax648 [491–805]consist 0.95calib 0.93Δ 0.0772.1s$0.434/1k
- #37OpenAI: GPT-5.4 Miniopenai612 [488–736]consist 0.93calib 0.86Δ 0.000530ms$0.696/1k
- 606 [457–756]consist 1.00calib 0.90Δ 0.1151.1s$4.23/1k
- #39Mistral: Mistral Medium 3.5mistralai604 [454–753]consist 0.98calib 0.90Δ 0.115861ms$1.53/1k
- #40MoonshotAI: Kimi K2.5moonshotai604 [455–754]consist 0.98calib 0.91Δ 0.1152.4s$2.09/1k
- #41Anthropic: Claude Fable 5anthropic559 [471–648]consist 1.00calib 0.98Δ 0.0004.0s$11.30/1k
- #42OpenAI: GPT-5.6 Terraopenai554 [455–653]consist 0.95calib 0.79Δ 0.000551ms$1.37/1k
- #43Amazon: Nova Lite 1.0amazon543 [404–681]consist 0.97calib 0.90Δ 0.154882ms$0.080/1k
- #44Mistral: Ministral 3 14B 2512mistralai540 [401–678]consist 0.97calib 0.87Δ 0.154670ms$0.186/1k
- #45OpenAI: GPT-5.6 Lunaopenai472 [348–596]consist 0.97calib 0.84Δ 0.192486ms$0.141/1k
- #46Amazon: Nova 2 Liteamazon466 [342–590]consist 0.93calib 0.83Δ 0.192948ms$0.142/1k
- #47MoonshotAI: Kimi K2.7 Codemoonshotai379 [291–468]consist 0.81calib 0.97Δ 0.308752ms$2.98/1k
- #48OpenAI: GPT-5.4 Nanoopenai323 [299–348]consist 0.65calib 0.47Δ 0.000613ms$0.184/1k
- #49Mistral: Mistral Small 4mistralai250 [209–291]consist 0.93calib 0.47Δ 0.327989ms$0.150/1k