Agent Readiness Compare

Agent readiness statistics

How many sites have agent readiness signals, in four samples, and why the numbers differ.

In short

Adoption of agent readiness signals is low and depends on the sample: markdown negotiation reaches 9 percent of 8,822 domains in this site's crawl and 3.9 percent in Cloudflare Radar's scan of 200,000. Content Signals sit at 7.4 percent in the crawl and 4 percent in Radar.

The same signals in two samples

The same signals in two samplesShare of sites with a robots.txt, with Content Signals and answering markdown negotiation, in this site's crawl and in Cloudflare Radar's scan. The table below holds the figures.robots.txt: shared crawlrobots.txt: shared crawl: 79.2%79.2%robots.txt: Cloudflare Radarrobots.txt: Cloudflare Radar: 78%78%Markdown negotiation: shared crawlMarkdown negotiation: shared crawl: 9%9%Markdown negotiation: Cloudflare RadarMarkdown negotiation: Cloudflare Radar: 3.9%3.9%Content Signals: shared crawlContent Signals: shared crawl: 7.4%7.4%Content Signals: Cloudflare RadarContent Signals: Cloudflare Radar: 4%4%
Figure 1. Three signals measured twice. The crawl is this site's own; Radar is Cloudflare's. The table below has the figures and the denominators.
Adoption figures with the sample each rests on
SignalShared crawl, 4 Nov 2026Cloudflare Radar, April 2026
Serves a robots.txt79.2% of 10,886 domains that answered78% of the filtered top 200,000 1
Declares Content Signals7.4% of 8,624 domains with a robots.txt4% of sites
Answers Accept: text/markdown with markdown9% of 8,822 home pages3.9% of sites
MCP server card or API catalog0.9% serve /.well-known/mcp.json (103 of 10,886)fewer than 15 sites together in the dataset

The shared crawl read 13,071 domains on 4 November 2026 with a plain-fetch client: the Tranco top 10,000 plus Ora's leaderboard universe, sites that someone scanned with Ora. Radar scanned the 200,000 most visited domains after dropping categories where agent readiness is unimportant 1. The data page has every row of the crawl.

Protocol adoption in agent-ready.dev's corpus

Sites advertising each agent protocol, of 2,581 distinct sites scanned on agent-ready.dev between 2026-04-18 and 2026-11-05 (vendor-reported)
Protocol surfaceSitesShare
API catalog (RFC 9727)33013%
MCP server card28011%
Agent Skills discovery27010%
A2A agent card25910%
Web Bot Auth directory1827%
agent-permissions.json1656%
UCP profile1656%
agents.json1646%

Source: agent-ready.dev's State of Agent Readability page 2. It is a sample of sites whose owners chose to scan, so rates run ahead of the web at large.

Scores in Ora's corpus

Ora's stats on 5 November 2026 give an average score of 44 over 132,085 ranked companies, with 784 at A or better, a share of 0.6 percent 3. The breakdown by category is on the industry page.

What the crawl says about llms.txt

24.6% of 10,598 domains served /llms.txt in the crawl, far above the share that serve a markdown alternate on the home page (2.5%). A file that exists is not the same as a file an agent reads: Ora's lab found that 86 percent of llms.txt fetches in its traced runs arrived through a link, not a guessed path (vendor claim, 19 October 2026).

Sources

  1. blog.cloudflare.com/agent-readiness. https://blog.cloudflare.com/agent-readiness/, read 2026-11-05.
  2. agent-ready.dev/state-of-agent-readability. https://agent-ready.dev/state-of-agent-readability, read 2026-11-05.
  3. ora.ai/api/stats. https://ora.ai/api/stats, read 2026-11-05.

Last reviewed 2026-11-05