News & analysis
Shopify Audit: AI Agents Can Checkout, Can't Decide Alone
An audit of 122 Shopify storefronts found checkout creation succeeded with a median response time of about 1.1 seconds, but every one of 74 test checkouts still required human approval before completion.
By Roomer Editorial · · 3 min read
What did the audit actually test?
The audit ran live, non-completing checkouts on Shopify stores to see whether an AI shopping agent could resolve a purchase, not just find or cite a product. The test: create a checkout for an in-stock item, read it back, cancel it, then cancel it again, without sending payment details.
Checkout creation succeeded on every store given a real item ID, with a median response time of about 1.1 seconds. The only failures traced back to stale data the researchers had collected weeks earlier — five items had sold out, two IDs no longer existed. Stores rejected both cleanly, with machine-readable errors instead of silent failures.
Why do policies still block agents?
The gap isn't visibility. Most stores publish the facts an agent needs — like return policies — as prose on a policy page. The problem is the step between publishing and using: an agent can't pull a return window into a decision if it only exists as a sentence on a page built for a human to read.
Product-page markup compounds this. Across 68 stores checked, buy buttons were solid — a native, labeled `<button>` 92% of the time. The trouble sits around the button: roughly two-thirds of size selectors carried no label, meaning an agent couldn't reliably tell a size dropdown from a color dropdown. Fixing that markup once serves a screen-reader user, a keyboard user, and a browser agent at the same time.
How ready are Shopify's checkout tools?
Shopify switched on WebMCP tools for every Liquid storefront on August 5 — merchants didn't build this, the platform shipped it. Shopify reports its catalog now covers billions of products from millions of merchants, and that orders placed through AI-powered search climbed close to 13-fold during the first quarter of 2026 versus the prior year.
On September 28, Shopify extended WebMCP into checkout itself, letting browser-based agents read and update a live checkout with no merchant configuration required. A follow-up test on September 30 opened checkouts across a sample of stores and found all four tools registered: `get_checkout`, `update_checkout`, `complete_checkout`, `navigate_to_storefront`. A read-only call returned full checkout detail — line items, tax totals, fulfillment method, and coded flags for missing fields.
Every one of the 74 checkouts tested came back `requires_escalation`, flagged `requires_buyer_input`. Shopify's default rules require a human to authorize the purchase before it completes. The agent builds the cart. A person commits the money.
What's still missing from an agent's view?
Being able to read a checkout isn't the same as being able to decide on one. In the browser checkout, refund terms still reach the agent only as a link to a policy page — not as a value it can act on. No tool exists to cancel or modify an order after completion.
One checkout in the sample contained a line item the shopper hadn't chosen: a $2.98 "Free Returns Coverage" fee added by the store. The agent could see the charge. Nothing in the checkout data marked it as optional or explained how to remove it.
Roomer Editorial's take
This is a Shopify story, but the pattern is the one every travel creator with a bookable page needs to notice. A blog post that spells out your cancellation terms in prose is readable by a person and invisible to anything trying to act on it. The rule has to live where the booking action lives, not somewhere else on the page.
Roomer Editorial's view: creators who book through rails — Vio, Stay22, GetYourGuide, Viator, Klook — are structurally ahead here, because the cancellation terms, pricing, and availability on those bookable pages come from the inventory itself, not from a caption you wrote and then forgot about. That's not a guarantee your page is "agent-ready." It's a reason your odds are better than a static write-up with a link buried in it.
The exception: don't treat any of this as a reason to chase agent compatibility over your own audience. Shopify's data shows orders from AI-powered search are growing fast, but the audience still has to arrive at your page in the first place. Build for the person watching your video first. The booking mechanics underneath can do their job once they get there.
One thing to do this week: check whether your own cancellation and pricing terms live on the same page as the booking action, or buried in a separate policy post.
Source: Search Engine Journal
