All fix guides

Search visibility (E-robots)

robots.txt reachable

What this check means

This guide helps you act on one scan finding. It is not legal advice or a compliance verdict.

What to fix

Make /robots.txt reachable with a normal HTTP response.

Step-by-step fix

  1. Request https://your-domain/robots.txt in a private window.
  2. If blocked, allow /robots.txt in the WAF / Cloudflare / security plugin.
  3. Ensure the file is not redirected into a soft 404 HTML page.
  4. Keep Disallow rules intentional — reachability is the fix for this check.

Confirm it is fixed

Re-scan and confirm E-robots reports robots.txt reachable.

Rescan this check on your site

Scan the same URL again, then compare this check with your previous report.

Run a free leak scan