Agent Readiness Compare

Scanners that test with real agents

Which scanners send a real agent at your site, and which only read files and headers.

In short

4 of the 10 scanners put a real agent on a site, and only Ora does it on demand with no account or key. StartupHub runs six agent frameworks on a free account, Scope runs coding agents on request, and is-agentic.com shows runs recorded by Ora.

Who runs a real agent

Which scanners send a real agent at a site, how, and the points the rubric gives
ScannerPointsWhat it doesSource
Ora15 of 15Journey runs a real agent on a curated task through POST /api/journey/runs with no key; custom tasks need a partner keyora.ai/llms.txt
StartupHub Agent Readiness12 of 15Live Agent Run, three runs a month on a free accountstartuphub.ai/agent-readiness
is-agentic.com6 of 15shows observed agent journeys from Orais-agentic.com/methodology
agent-ready.dev0 of 15does not send an agent to complete a taskagent-ready.dev/methodology
Cloudflare isitagentready.com0 of 15fetches files, headers and DNS records; runs no agentisitagentready.com/llms-full.txt
Mintlify Agent Score0 of 15nonenone
Lighthouse Agentic Browsing0 of 15deterministic audits, no agent rundeveloper.chrome.com/docs/lighthouse/agentic-browsing/scoring
SEOJuice Agent Ready0 of 15reads files, headers and markupseojuice.com/tools/agent-ready
Microsoft Scope12 of 15runs coding agents on repeatable tasks; access is requestedgithub.com/microsoft/scope
SiteSpeakAI scanner0 of 15nonenone

A scanner that fetches files, headers and DNS records can tell whether a signal is present. It cannot tell whether an agent that arrives finds the page useful, which is what a run on a task shows.

Ora Journey

  • Journey points a real agent at a domain with an intent such as "find pricing" and records every step, stall and outcome.9
  • POST /api/journey/runs runs a curated task anonymously; free-text tasks and POST /api/journey/domains/{host} need a partner key.10
  • Each domain is capped at 100 journey runs per rolling 24 hours and cannot run two at once.10

Journey is the part of Ora the rubric rewards most under real agents: 15 of 15, because a curated task runs on demand with no key. The Journey guide says what a run shows and what it cannot.

StartupHub's Live Agent Run

StartupHub starts six agent frameworks on its own hardware and asks each the same seven questions about a site, eight when a way to pay is found. The page reports 1,307 runs on 217 sites since 1 October 2026, measured 22 October 2026; these are vendor-reported figures 2.

The six frameworks as the scanner page prints them: answers, runs, fetches and seconds, vendor-reported on 22 October 2026
FrameworkMakerAnswersRunsFetchesSeconds
Claude CodeAnthropic4.72235.345
Codex CLIOpenAI4.82236.132
OpenCodeOpen source4.82235.420
CursorCursor5.22099.063
Gemini CLIGoogle6.1257.3163
Plain model with a fetch toolControl2.94041.32

What Ora's lab found about agent behaviour

These are Ora's own research findings, labelled as vendor claims with their dates; this site has not replicated them.

  • Ora's lab found (19 Oct 2026) that of 19 configurations of one docs site, only hiding the answer in JavaScript (0 of 5 for plain fetch) and returning 403 to agent user agents (0 of 5 for both clients) stopped retrieval, over 190 probes.11 vendor claim, dated 2026-10-19
  • Ora's lab found (19 Oct 2026) that agents reached docs pages in 83 percent of traced runs, the homepage in 69 percent, .well-known paths in 23 percent, openapi.json in 21 percent and sitemap.xml in 4 percent.11 vendor claim, dated 2026-10-19

Scanners that read signals only

agent-ready.dev, Cloudflare, Mintlify, Lighthouse, SEOJuice and SiteSpeakAI score 0 on this criterion. Each states what it does instead: for example agent-ready.dev says it does not send an agent to complete a task, and Lighthouse runs deterministic audits. That is a design choice, not a flaw.

Sources

  1. ora.ai/llms.txt. https://ora.ai/llms.txt, read 2026-11-05.
  2. startuphub.ai/agent-readiness. https://www.startuphub.ai/agent-readiness, read 2026-11-05.
  3. is-agentic.com/methodology. https://is-agentic.com/methodology, read 2026-11-05.
  4. agent-ready.dev/methodology. https://agent-ready.dev/methodology, read 2026-11-05.
  5. isitagentready.com/llms-full.txt. https://isitagentready.com/llms-full.txt, read 2026-11-05.
  6. developer.chrome.com/docs/lighthouse/agentic-browsing/scoring. https://developer.chrome.com/docs/lighthouse/agentic-browsing/scoring, read 2026-11-05.
  7. seojuice.com/tools/agent-ready. https://seojuice.com/tools/agent-ready/, read 2026-11-05.
  8. github.com/microsoft/scope. https://github.com/microsoft/scope, read 2026-11-05.
  9. Ora home page. https://ora.ai/, read 2026-11-04.
  10. Ora complete public documentation (llms-full.txt). https://ora.ai/llms-full.txt, read 2026-11-04.
  11. Introducing AgentReady.org (Ora blog, 2026-10-19). https://ora.ai/blog/agentready-launch, read 2026-11-04.

Last reviewed 2026-11-05