OAI-AdsBot
Ad landing-page validation. OpenAI's fetcher for validating the safety and relevance of landing pages that advertisers submit for ChatGPT ads.
AI crawler directory / OAI-AdsBot
OpenAI's fetcher for validating the safety and relevance of landing pages that advertisers submit for ChatGPT ads.
This summary is tied to a first-party operator page reviewed on Sep 20, 2026. It should be rechecked when the registry version changes.
OpenAI documents these tokens for different purposes. A rule for one does not automatically control the others.
Ad landing-page validation. OpenAI's fetcher for validating the safety and relevance of landing pages that advertisers submit for ChatGPT ads.
Model training. OpenAI's automatic crawler for content that may be used to improve and train generative AI foundation models.
AI search. OpenAI's automatic search crawler, used to surface and link websites in ChatGPT search results.
User-requested fetch. OpenAI's user-initiated fetcher for certain ChatGPT, Custom GPT, and GPT Action requests.
This example states a crawl preference for the named token. It does not authenticate requests, enforce blocking, or automatically control another token from the same operator.
User-agent: OAI-AdsBot
Disallow: /Check the official operator source before publishing a policy. User-requested fetchers and non-fetcher control tokens can have different behavior from automatic crawlers.
These states are calculated from each domain's latest available robots.txt record using the versioned CrawlLedger parser. They are observations of published text, not proof of crawler behavior.
| Domain | Parsed state | Matched group | Last observed |
|---|---|---|---|
| anthropic.com | unverified | No matching group observed | |
| apnews.com | unverified | No matching group observed | |
| apple.com | unverified | No matching group observed | |
| cloudflare.com | unverified | No matching group observed | |
| commoncrawl.org | unverified | No matching group observed | |
| google.com | unverified | No matching group observed | |
| medium.com | unverified | No matching group observed | |
| openai.com | unverified | No matching group observed | |
| oreilly.com | unverified | No matching group observed | |
| perplexity.ai | unverified | No matching group observed | |
| quora.com | unverified | No matching group observed | |
| reddit.com | unverified | No matching group observed | |
| rslcollective.org | unverified | No matching group observed | |
| rslstandard.org | unverified | No matching group observed | |
| stackoverflow.com | unverified | No matching group observed | |
| theguardian.com | unverified | No matching group observed | |
| usatoday.com | unverified | No matching group observed | |
| voxmedia.com | unverified | No matching group observed | |
| yahoo.com | unverified | No matching group observed | |
| ziffdavis.com | unverified | No matching group observed |
“Allowed” means a selected group was observed without a blocking rule for the tested policy shape. “Partial” means at least one non-empty disallow path was observed. “No matching group” is silence, not an affirmative grant. None of these states authenticate the requester or establish legal permission.