Which AI is best at shopping? What Visa's benchmark found
On November 5, 2026, Visa published the Visa Agentic Commerce Benchmark. Visa's press release gives pass rates and does not name the models. Fortune published a ranking the same day and named four agents. A figure from Fortune is Fortune's. A figure from Visa is Visa's.
This tests choosing the right product through conversation, not checkout itself. The results describe the specific model versions tested. They are not a score for every other version of the same assistant.
Which AI is best at shopping?
Visa's press release did not name the models. Fortune reported that a Google Gemini agent and a Meta agent tied for the top score at 82%. A Claude agent was third at 76%. An OpenAI agent was sixth at 64%. Those names and percentages are Fortune's, because Visa's release did not name models.
Visa's best pass rate was 82.2%, and its worst was 28.9%, with no model name on either number. Fortune's 82% and Visa's 82.2% come from different write-ups. This page does not treat them as one named winner.
Source: Fortune, November 5, 2026 · Visa press release, November 5, 2026
What did Visa's benchmark measure?
Visa tested 22 models from 12 labs. The models took 15 shopping challenges, such as a TV, a laptop, or a personal care appliance. They passed 57.2% of runs overall. The best passed 82.2%, and the worst passed 28.9%.
The top five question-askers passed 70.2% of runs. The bottom five passed 44.4%. The five most expensive models passed 67.1%. The five cheapest passed 50.2%. All three attempts passed 34.2% of the time, so passing once was more common than passing every try.
Did a failed run still end in a purchase?
Visa said 54% of failed runs still ended in a purchase. That share counts only the runs that missed the challenge. It is separate from the 57.2% of runs that passed. A run can fail the test and still end with an order.
Does a high score mean the agent can check out?
No. This tests choosing the right product through conversation, not checkout itself. The results describe the specific model versions tested. A high score here is not a score for paying, and it is not a score for a model version left out of the test. Visa said it plans to extend the tests to checkout, payment, and order placement. Anyone can try the test on Visa Payments Frontier.