AI Vision Index

ModelMistral · API

Mistral Large 4

Mistral Large 4 scores 52.7 out of 100 overall, which puts it in a tie for rank 10–18 of 36 models on the AI Vision Index. It is strongest at Spotting changes and errors (67) and weakest at Space, 3D and motion (38). It beats the average of all 36 models in three of the six categories. It was tested on a smaller sample than most models, so its margin of error is wider and its single-test scores are rough.

Overall score52.795% interval 46.7–61.7
Rank10–18of 36 models (tied)
Cost per 1,000 answers$9.59
Seconds per answer52.2 s
Thinking effortdefault
Maker Mistral
WeightsOpen weights
AccessAPI
Tested
Score in each category, out of 100
Reading48
Counting40
Space, 3D and motion38
Spotting changes and errors67
Diagrams67
Not being fooled57

The bar is the score; the light band is the 95% interval. The overall score is the average of the six.

Score on each test, out of 100
Reading
Reading a clock40
Reading a meter60
Eye chart20
Reading a label80
Reading a chart50
Test strips60
Adding up coins60
Traffic light from a car10
Counting
Counting objects100
Counting stacked goods0
Counting on a conveyor20
Space, 3D and motion
Which is nearer60
Which way it faces29
Same or mirror image0
Will it topple10
Match the render47
Which bay can I park in?100
Follow the hidden object17
Spotting changes and errors
Spot the change80
Shelf against plan60
Rendering glitch28
Check the invoice100
Diagrams
Follow the cable60
Follow the pipe60
Missing dimension80
Not being fooled
Absent objects100
Saying "I can't tell"100
Optical illusions10
Real or AI-made20

Scores are corrected for guessing: 0 is no better than a guess, 100 is always right. All models on every test

Neighbours on the leaderboard

Compare with any model Full leaderboard

Badge for your site

Mistral Large 4: ranked #10–18 of 36 on the AI Vision Index

HTML

<a href="https://aivisionindex.com/models/mistral-large-4/"><img src="https://aivisionindex.com/badge/mistral-large-4.svg" alt="Mistral Large 4: ranked #10–18 of 36 on the AI Vision Index"></a>

Markdown

[![Mistral Large 4: ranked #10–18 of 36 on the AI Vision Index](https://aivisionindex.com/badge/mistral-large-4.svg)](https://aivisionindex.com/models/mistral-large-4/)

Results are CC BY 4.0, so you are free to reuse them if you credit the AI Vision Index. All results (JSON)

Get new results by email

We send a short email when we add models or publish a report, and nothing else.