Agent Readiness Compare

Data and downloads

In short

Download the Scanner Concordance, edition 2026-11-04, as CSV or JSON: sixty domains by six scanners, with the reason for every empty cell. The crawl adoption table covers 13,071 domains read on 2026-11-04. Reuse is free with the cite line below.

Files

Downloads, edition 2026-11-04
FileFormatContents
concordance-2026-11-04.csvtext/csvOne row per domain: category, stratum, and for each of six scanners the score, band, reason and fetch time, plus the spread.
concordance-2026-11-04.jsonapplication/jsonThe same rows as JSON with each cell's source URL, scan date and per-cell details.
crawl-adoption-2026-11-04.csvtext/csvThe adoption table from the shared crawl: metric, count, base, percent, rows read and slice date.
rubric-2026-11-04.csvtext/csvThe seven rubric criteria for the six scanners, with scores, totals and rank.
rubric-2026-11-04.jsonapplication/jsonThe rubric as JSON: the seven criteria and, for each scanner, the score, evidence, source URL and read date per criterion, with total and rank.
scanner-ranking-2026-11-05.csvtext/csvThe ten-criterion ranking: one row per scanner with the points on each of the ten criteria, the total of 100 and the rank.
scanner-rubric-cells-2026-11-05.csvtext/csvEvery scored cell of the ten-criterion rubric: scanner, criterion, part, points, cap, what the source says and its URL.
scanner-rubric-2026-11-05.jsonapplication/jsonThe ten-criterion rubric as JSON: criteria, each scanner's cells with basis and source, totals, rank, best-for lines and the log of the 5 November re-read and the version 1.2 citation rule.
standards-2026-11-04.jsonapplication/jsonThe sixteen standards of the Standards Map as JSON: maintainer, layer, what each is and does not do, which scanners check it, the AgentReady identifiers and the source.

Cite this

Cite line
Agent Readiness Compare. "Scanner Concordance, edition 2026-11-04." 4 November 2026. https://agentreadinesscompare.com/concordance/2026-11-04/

The data is licensed CC BY 4.0 and may be reused with this line. Scores belong to the scanners that produced them; the sample, the spread and the correlation figures are this site's.

Columns

Concordance CSV columns
ColumnMeaning
domainThe domain looked up.
categoryOra leaderboard category, or the business sector for Tranco rows.
stratumora-leaderboard or tranco-business.
<scanner>_score0 to 100 on that scanner's own scale; empty when it gave none. Cloudflare's score is the share of counted checks passed.
<scanner>_bandThe scanner's own grade, level or label.
<scanner>_reasonWhy the cell is empty.
<scanner>_fetched_atUTC time the cell was read.
spreadHighest minus lowest score among Ora, Cloudflare, agent-ready.dev and Mintlify, when at least three scored the domain.

Crawl adoption table

Rows read: 13,071 domains, of which 10,886 answered. Source: the Tranco top 10,000 (list 746WX) plus the Ora leaderboard universe, fetched on 2026-11-04 with a plain-fetch client and no JavaScript; sliced on 2026-11-04. Ora scores read in the same crawl: 119 domains, mean 47.2, median 46.

Adoption across 13,071 crawled domains, read 2026-11-04
SignalCountBaseShareBase is
Serves a robots.txt8,62410,88679.2%domains that answered
Declares Content Signals in robots.txt6418,6247.4%domains with a robots.txt
Names GPTBot and disallows it9938,62411.5%domains with a robots.txt
Names ClaudeBot and disallows it9138,62410.6%domains with a robots.txt
Serves /llms.txt2,61210,59824.6%domains where llms.txt was fetched
Serves /llms-full.txt67310,5986.4%domains where llms.txt was fetched
Home page links to llms.txt2638,8223%domains whose home page returned HTML
Home page carries JSON-LD4,7438,82253.8%domains whose home page returned HTML
Home page has an h1 in the initial HTML6,5368,82274.1%domains whose home page returned HTML
Home page is an empty JavaScript shell3078,8223.5%domains whose home page returned HTML
Home page links a markdown alternate2208,8222.5%domains whose home page returned HTML
Answers Accept: text/markdown with markdown7978,8229%domains whose home page returned HTML
Publishes /openapi.json or /openapi.yaml12310,8861.1%domains where discovery files were fetched
Publishes /.well-known/mcp.json10310,8860.9%domains where discovery files were fetched
Publishes /.well-known/agent-card.json6210,8860.6%domains where discovery files were fetched
Publishes /.well-known/ai-catalog.json11110,8861%domains where discovery files were fetched
Publishes /.well-known/agent-skills/index.json18910,8861.7%domains where discovery files were fetched
Publishes /.well-known/ucp.json6210,8860.6%domains where discovery files were fetched

Sources

  1. Tranco list. https://tranco-list.eu/, read 2026-11-04.

Last reviewed 2026-11-05