Group selection
Specific user-agent matches take precedence over the wildcard group, with longest matching path rules evaluated per RFC 9309.
Free tool · no fetch · no input storage
Check AI crawler rules without triggering a crawl.
Paste a robots.txt file to evaluate tracked OpenAI, Anthropic, Google, Apple, Perplexity, and Common Crawl tokens, plus Content Signals, sitemaps, and RSL discovery records.
Private by design
Input is parsed in the request and is not written to D1, R2, logs, cookies, or analytics by application code.
What the checker looks for
The evaluator uses the same versioned parser as the append-only archive.
AI crawler registry
11 tokens are included only when a first-party operator source and review date are recorded.
Adjacent signals
Content Signals, HTTPS sitemaps, and RSL License: records stay separate from allow and disallow rules.