Free tool
Which AI bots can enter your site?
Paste a domain. See what your robots.txt blocks across training, search and user-fetch bots from OpenAI, Anthropic, Perplexity and Google.
Your setup
Robots.txt is a request, not enforcement. Per vendor docs, user-initiated fetchers (ChatGPT-User, Perplexity-User, Google-Agent) may ignore it, and Google-Extended is a control token with no user agent string of its own. CDN and WAF rules also decide who gets in.