Check a URL
Paste the full URL of the page you want to inspect. Only that page and its origin’s robots.txt will be fetched.
Platform limitation: Sites hosted behind Cloudflare cannot be reached from this checker. If a domain is behind Cloudflare, the verdict will show “unknown” and explain that this is a limitation of the checker, not a finding about the page.
example.com (no scheme) is not accepted — include the full https://.