One verdict per page. No signal salad.

robots.txt, meta robots, X-Robots-Tag, canonical — four signals that contradict each other. Robotsread fetches the page and its robots.txt, reconciles the signals, and states one clear answer.

Check a URL See plans →

What it reads

  • robots.txt Fetches the origin’s robots.txt separately, evaluates * group rules with longest-match semantics including Allow-override.
  • Meta robots Extracts <meta name="robots"> from the page HTML and checks for noindex.
  • X-Robots-Tag Reads the HTTP response header for a noindex directive.
  • Canonical Extracts <link rel="canonical"> and flags cross-origin targets that may cause a search engine to index the other origin.

How it works

1

Paste a URL

Enter the full URL of the page you want to check — any public page on any domain.

2

Fetch & reconcile

We fetch the page and its origin’s robots.txt independently. A failing page does not invalidate the robots.txt rule.

3

One verdict

A colour-coded answer: blocked (with the exact rule), indexable, or unknown (with the reason). No dashboard of signals to cross-reference.

What this tool does not do

Deliberate boundaries

  • Does not crawl the site or follow links — fetches only the URL you enter and that origin’s robots.txt.
  • Does not speak for any search engine’s actual ranking behaviour. The verdict reports what the rules say, not what Google will do.
  • Does not send alerts, emails, or scheduled re-checks. No data is stored server-side.
  • A host behind Cloudflare cannot be reached from this checker. The verdict will show “unknown” with the platform limitation clearly stated.