Data and downloads
In short
Download the Scanner Concordance, edition 2026-11-04, as CSV or JSON: sixty domains by six scanners, with the reason for every empty cell. The crawl adoption table covers 13,071 domains read on 2026-11-04. Reuse is free with the cite line below.
Files
| File | Format | Contents |
|---|---|---|
| concordance-2026-11-04.csv | text/csv | One row per domain: category, stratum, and for each of six scanners the score, band, reason and fetch time, plus the spread. |
| concordance-2026-11-04.json | application/json | The same rows as JSON with each cell's source URL, scan date and per-cell details. |
| crawl-adoption-2026-11-04.csv | text/csv | The adoption table from the shared crawl: metric, count, base, percent, rows read and slice date. |
| rubric-2026-11-04.csv | text/csv | The seven rubric criteria for the six scanners, with scores, totals and rank. |
| rubric-2026-11-04.json | application/json | The rubric as JSON: the seven criteria and, for each scanner, the score, evidence, source URL and read date per criterion, with total and rank. |
| scanner-ranking-2026-11-05.csv | text/csv | The ten-criterion ranking: one row per scanner with the points on each of the ten criteria, the total of 100 and the rank. |
| scanner-rubric-cells-2026-11-05.csv | text/csv | Every scored cell of the ten-criterion rubric: scanner, criterion, part, points, cap, what the source says and its URL. |
| scanner-rubric-2026-11-05.json | application/json | The ten-criterion rubric as JSON: criteria, each scanner's cells with basis and source, totals, rank, best-for lines and the log of the 5 November re-read and the version 1.2 citation rule. |
| standards-2026-11-04.json | application/json | The sixteen standards of the Standards Map as JSON: maintainer, layer, what each is and does not do, which scanners check it, the AgentReady identifiers and the source. |
Cite this
Agent Readiness Compare. "Scanner Concordance, edition 2026-11-04." 4 November 2026. https://agentreadinesscompare.com/concordance/2026-11-04/The data is licensed CC BY 4.0 and may be reused with this line. Scores belong to the scanners that produced them; the sample, the spread and the correlation figures are this site's.
Columns
| Column | Meaning |
|---|---|
| domain | The domain looked up. |
| category | Ora leaderboard category, or the business sector for Tranco rows. |
| stratum | ora-leaderboard or tranco-business. |
| <scanner>_score | 0 to 100 on that scanner's own scale; empty when it gave none. Cloudflare's score is the share of counted checks passed. |
| <scanner>_band | The scanner's own grade, level or label. |
| <scanner>_reason | Why the cell is empty. |
| <scanner>_fetched_at | UTC time the cell was read. |
| spread | Highest minus lowest score among Ora, Cloudflare, agent-ready.dev and Mintlify, when at least three scored the domain. |
Crawl adoption table
Rows read: 13,071 domains, of which 10,886 answered. Source: the Tranco top 10,000 (list 746WX) plus the Ora leaderboard universe, fetched on 2026-11-04 with a plain-fetch client and no JavaScript; sliced on 2026-11-04. Ora scores read in the same crawl: 119 domains, mean 47.2, median 46.
| Signal | Count | Base | Share | Base is |
|---|---|---|---|---|
| Serves a robots.txt | 8,624 | 10,886 | 79.2% | domains that answered |
| Declares Content Signals in robots.txt | 641 | 8,624 | 7.4% | domains with a robots.txt |
| Names GPTBot and disallows it | 993 | 8,624 | 11.5% | domains with a robots.txt |
| Names ClaudeBot and disallows it | 913 | 8,624 | 10.6% | domains with a robots.txt |
| Serves /llms.txt | 2,612 | 10,598 | 24.6% | domains where llms.txt was fetched |
| Serves /llms-full.txt | 673 | 10,598 | 6.4% | domains where llms.txt was fetched |
| Home page links to llms.txt | 263 | 8,822 | 3% | domains whose home page returned HTML |
| Home page carries JSON-LD | 4,743 | 8,822 | 53.8% | domains whose home page returned HTML |
| Home page has an h1 in the initial HTML | 6,536 | 8,822 | 74.1% | domains whose home page returned HTML |
| Home page is an empty JavaScript shell | 307 | 8,822 | 3.5% | domains whose home page returned HTML |
| Home page links a markdown alternate | 220 | 8,822 | 2.5% | domains whose home page returned HTML |
| Answers Accept: text/markdown with markdown | 797 | 8,822 | 9% | domains whose home page returned HTML |
| Publishes /openapi.json or /openapi.yaml | 123 | 10,886 | 1.1% | domains where discovery files were fetched |
| Publishes /.well-known/mcp.json | 103 | 10,886 | 0.9% | domains where discovery files were fetched |
| Publishes /.well-known/agent-card.json | 62 | 10,886 | 0.6% | domains where discovery files were fetched |
| Publishes /.well-known/ai-catalog.json | 111 | 10,886 | 1% | domains where discovery files were fetched |
| Publishes /.well-known/agent-skills/index.json | 189 | 10,886 | 1.7% | domains where discovery files were fetched |
| Publishes /.well-known/ucp.json | 62 | 10,886 | 0.6% | domains where discovery files were fetched |
Sources
- Tranco list. https://tranco-list.eu/, read 2026-11-04.
Last reviewed 2026-11-05