AI Vision Index

ModelStepFun · API

Step-5 (preview)

Step-5 (preview) scores 40.7 out of 100 overall, which puts it in a tie for rank 19–29 of 36 models on the AI Vision Index. It is strongest at Not being fooled (57) and weakest at Counting (20). It beats the average of all 36 models in none of the six categories. It was tested on a smaller sample than most models, so its margin of error is wider and its single-test scores are rough.

Overall score40.795% interval 33.2–50.3
Rank19–29of 36 models (tied)
Cost per 1,000 answers$12.50
Seconds per answer65.2 s
Thinking effortdefault
Maker StepFun
WeightsOpen weights
AccessAPI
Tested
Score in each category, out of 100
Reading42
Counting20
Space, 3D and motion32
Spotting changes and errors46
Diagrams47
Not being fooled57

The bar is the score; the light band is the 95% interval. The overall score is the average of the six.

Score on each test, out of 100
Reading
Reading a clock40
Reading a meter40
Eye chart0
Reading a label60
Reading a chart75
Test strips60
Adding up coins20
Traffic light from a car40
Counting
Counting objects20
Counting stacked goods40
Counting on a conveyor0
Space, 3D and motion
Which is nearer60
Which way it faces29
Same or mirror image0
Will it topple10
Match the render0
Which bay can I park in?78
Follow the hidden object50
Spotting changes and errors
Spot the change40
Shelf against plan60
Rendering glitch28
Check the invoice57
Diagrams
Follow the cable40
Follow the pipe40
Missing dimension60
Not being fooled
Absent objects100
Saying "I can't tell"67
Optical illusions40
Real or AI-made20

Scores are corrected for guessing: 0 is no better than a guess, 100 is always right. All models on every test

Neighbours on the leaderboard

Compare with any model Full leaderboard

Badge for your site

Step-5 (preview): ranked #19–29 of 36 on the AI Vision Index

HTML

<a href="https://aivisionindex.com/models/step-5-preview/"><img src="https://aivisionindex.com/badge/step-5-preview.svg" alt="Step-5 (preview): ranked #19–29 of 36 on the AI Vision Index"></a>

Markdown

[![Step-5 (preview): ranked #19–29 of 36 on the AI Vision Index](https://aivisionindex.com/badge/step-5-preview.svg)](https://aivisionindex.com/models/step-5-preview/)

Results are CC BY 4.0, so you are free to reuse them if you credit the AI Vision Index. All results (JSON)

Get new results by email

We send a short email when we add models or publish a report, and nothing else.