Free • Instant • No signup

Test your robots.txt
against any crawler

Simulate exactly what Googlebot, GPTBot, Perplexity, Claude and other bots are allowed to crawl on your site.

Load an example
Why test with real bots?

See what Google and AI actually get to crawl

Spot hidden blocks

Find out if your best content is accidentally disallowed for Googlebot or image bots.

Control AI access

Explicitly test GPTBot, Google-Extended, ClaudeBot and Perplexity to decide your GEO strategy.

Save crawl budget

Make sure search engines spend time on the pages you want indexed, not junk.

Start ranking on autopilot

The same system behind these free tools — now running your entire content engine.