ARC: open benchmark of whether AI agents can buy

Reviewed 1h ago.

• tools: 15 tools scanned
• metadata: scanned

No findings.

Tools (15)

• ask_arc

  Read the public ARC Index with no login. Given a brand, a product or store URL, or a category (running shoes, leggings, footwear), return whether agents can reach checkout, the score, rivals Grok named when a real read exists, evidence receipts, and both buy lanes. buy.agent_catalog is a live HTTP check. buy.browser is the browser cart. agents_can_buy is true when the catalog returned a checkout link or a browser shopper added the product to the cart (ARC stops before payment; it is not a completed purchase). The catalog check does not change the score and is not a browser session or any third-party agent product; browser cart results come from ARC browser shoppers A–E. Does not start a scan and does not spend a model call. A Grok fact check is a real model call via API, not the consumer Grok app. Rivals are omitted when that read does not exist. grok_read.status is pending when the answer was cut off and is waiting for a re-check. That is not a fact Grok didn't know.

• can_agent_checkout

  Can an AI agent buy from this store or check out on this Shopify store? Free real HTTP check of any public homepage or product URL: agent catalog, product, checkout link, UCP profile, Checkout WebMCP (Shopify-only checkoutWebmcp: status, nullable detected, tools, reason; buyer approval required), Shopify WebMCP storefront adapter (used by browser agents; detected in the HTML, not a browser session), blocks, and the fix. No login, model call, payment, or browser scan. Cached per host for 24 hours. A returned link means reach checkout, not a completed purchase.

• find_agent_ready_stores

  Find stores where an AI agent can complete checkout for running shoes, beauty, clothing, home goods, or another product need. Reads ARC's directory of real HTTP agent-catalog checks. Returns only stores checked within thirty days whose catalog found a product and returned a checkout link. No purchase completed; availability of your specific item is not guaranteed. Includes checkoutWebmcp (Shopify-only status, nullable detected, tools, reason; buyer approval required) and a webmcp boolean for Shopify storefront adapter detection, not a live browser-agent session. No login, browser scan or model call.

• agent_commerce_adoption

  Read ARC's agent commerce adoption counts, category and commerce platform rates from saved HTTP checks, including Checkout WebMCP among measured Shopify checkouts, with unknown and not checked separate; buyer approval required. Curated sample, not all e-commerce. No store requests or model calls.

• product_data_check

  Free latest saved product data and return/shipping policy check from the store's pages and structured data. Reads history only; no store fetch or model call. A missing result is not a zero.

• google_checkout_readiness

  Read saved public Google agentic checkout readiness checks for a store. Free; no new scan or paid calls. Merchant Center feed eligibility cannot be checked from outside. Not Google approval or certification.

• get_agent_facts

  Read free ARC agent facts for a store or product with no login. Returns TypeSafe Jev typed decisions (use-case mention, price clarity, agent-friendly description, cart-blocker suspicion, readiness score) from an HTTP scrape. Not a browser session and not any third-party agent product; ARC's browser cart tests (ARC browser shoppers A–E) are separate. JSON: GET /api/agent-facts?host=

• list_category_agent_facts

  List free ARC agent facts by category (beauty, footwear, apparel, …) with no login. Ranked by newest real Jev scores. JSON: GET /api/agent-facts?category=beauty

• dataset_info

  Latest open ARC dataset snapshot (start with store_answers: one plain answer per store on whether AI agents can find products and get a checkout link): immutable versioned download URLs plus latest/ aliases (CSV and Parquet), row counts, method version and licence (CC-BY-4.0, attribution ARC, arcreport.ai). Reads only.

• protocol_matrix

  Read ARC's neutral Protocol Matrix: for UCP, ACP, PAP, WebMCP, MCP and agent payment protocols, how many checked stores declare, validate, answer and transact, with evidence labels (Measured / Inferred / Not measured). Saved checks only; no store requests or model calls. CC-BY-4.0.

• agent_leaderboard

  Read ARC's open agent leaderboard: cart success over the fixed ARC-100 v1 test set for each agent path ARC measures (ARC browser shoppers A-E, the UCP path, the storefront MCP path), with n, dates, evidence labels and Wilson 95% intervals, plus unverified outside submissions. Saved results only; no store requests or model calls. CC-BY-4.0.

• submit_leaderboard_run

  Submit your agent's run against ARC-100 v1 to ARC's open leaderboard. Free. The run is listed as 'unverified' until ARC re-runs a sample. Format: arc-leaderboard-submission/v1 (see /leaderboard/spec). Runs must stop before payment. Limit 5 per network per day. Same as POST /api/leaderboard/submit.

• submit_store

  Add stores to ARC's free, open agent-commerce directory (CC-BY dataset). Pass url for one store or hosts for up to 50. Each new host is validated (live HTTPS, not parked, not redirecting to another brand); accepted hosts are queued for ARC's plain-HTTP rails checks (UCP, WebMCP, MCP, policies, product data) and appear in the dataset with source=submitted. No model calls, no login. Rate limited per caller.

• store_card

  Read a public store card and saved brand claim. No outbound fetch or model calls. Brand statements are from the brand and not measured by ARC; claims never change scores.

• validate_ucp_profile

  Validate a Universal Commerce Protocol (UCP) business profile against the published UCP JSON Schema (current release) and spec rules: authority binding, https endpoints, orphaned extensions and, for a URL, hosting headers (no redirects, Cache-Control public max-age>=60). Pass url (store host, homepage or profile URL; /.well-known/ucp is added for a homepage) or profile (the JSON). Returns errors, warnings and info, each with a path and the spec section. Free, no login, no model call. Validation is not certification. JSON: GET /api/ucp/validate?url=