robots.txt (security)
The robots.txt file tells search engines which pages they can visit. This check ensures it doesn't accidentally block the entire site and do…
Analyse my site for free
← All checks
How it works
How TheSiteFuse checks "robots.txt (security)"
The robots.txt file tells search engines which pages they can visit. This check ensures it doesn't accidentally block the entire site and doesn't reveal sensitive paths to malicious actors.
Why it matters
Real-world impact of "robots.txt (security)"
A misconfigured robots.txt can prevent indexing of your entire site (SEO disaster) or point attackers to sensitive areas. It's a simple file with significant consequences.
Does your site pass this check?
Run the free full audit (120 checks) and instantly discover what needs fixing.