Robots.txt Validator
Paste your robots.txt to parse every rule, spot syntax errors and unknown directives, verify sitemaps, and check paths for major crawlers — with a file health score, all in your browser.
Robots.txt Validator
Paste the full contents of your robots.txt file. Comments, empty lines and unknown directives are all handled gracefully.
Your robots.txt analysis appears here
Paste your robots.txt content above — rules are parsed instantly with per-rule diagnostics, a health score and recommendations.
How It Works
Three simple steps to verify your robots.txt file.
Paste your file
Copy the contents of your robots.txt into the text area.
Review the diagnostics
Every line is parsed and checked for syntax errors, unknown directives and path issues.
Fix & export
Follow the health score and recommendations, then export your report as TXT, JSON or print.
FAQ
Common questions about robots.txt validation.
How does the robots.txt validator work?
Paste your robots.txt content and the tool parses the rules, checks for syntax errors, and shows which paths are allowed or blocked for different bots.
What errors does it detect?
It detects invalid directives, missing user-agent blocks, syntax errors, unknown directives, and common configuration mistakes like paths without a leading slash.
Are wildcards allowed in robots.txt?
Yes. Google fully supports the "*" and "$" wildcards in paths, but Bing supports them only partially and many smaller crawlers ignore them. The tool flags them as compatibility warnings, not errors.
Is my robots.txt data stored?
No. All processing happens in your browser. Your data never leaves your device.