A focused, repeatable check
Use the result as one input in a wider technical review. Confirm important findings against the rendered page, server configuration, and the official documentation for the system you are testing.
Technical SEO utility
Robots.txt Rule Tester
Test a URL path against pasted robots.txt user-agent groups using a clearly documented local rule evaluator.
Blocked
Winning rule: disallow: /search
Local practical evaluator for Allow/Disallow, * and $. Validate unusual crawler-specific group behavior with the crawler’s own testing tools.
No invented performance data
The tool reports only what it can calculate from your input or retrieve through its stated request. It does not create search volume, ranking, traffic, or success forecasts.
Continue your workflow
