OpenAI crawler controls for ChatGPT search

OpenAI documents separate user agents for search, for model training and for actions a user starts. This page states what each is documented to do. Read on 2026-10-15.

Last updated 2026-10-15

Short answer

OpenAI says each setting is independent. A site can allow OAI-SearchBot to appear in ChatGPT search while disallowing GPTBot to indicate its content should not be used for training. OpenAI says ChatGPT-User is for user-initiated actions and that robots.txt rules may not apply to it.

What the crawler page says

  • OAI-SearchBot is used to surface websites in ChatGPT search features. Sites opted out of it will not be shown in ChatGPT search answers, though they can still appear as navigational links.
  • GPTBot is used to crawl content that may be used in training generative AI foundation models. Disallowing it indicates content should not be used for training.
  • ChatGPT-User is used for certain user actions in ChatGPT and Custom GPTs. It is not used to crawl automatically and is not used to decide whether content appears in Search. For Search opt-outs OpenAI says to use OAI-SearchBot.
  • OpenAI says it can take about 24 hours after a robots.txt update for its systems to adjust for search results.
  • OpenAI recommends allowing OAI-SearchBot in robots.txt and allowing requests from its published IP ranges.

Overview of OpenAI crawlers (OpenAI)

What the ChatGPT search help page says

  • Logged-out free users also have access to ChatGPT search.
  • Responses that use search may include inline citations, and a Sources panel can list cited sources and other relevant links.
  • Ranking in ChatGPT search is based on a number of factors. OpenAI says there is no way to guarantee top placement, and that to be included a site should allow OAI-SearchBot and make sure its host or CDN allows OpenAI's published IP addresses.

ChatGPT search (OpenAI Help Center)

Conditions and unknowns

  • Allowing a bot is described as a requirement for inclusion, not as a reason a site will be shown.
  • Your host or CDN can block a crawler even when robots.txt allows it. Check both.
  • The help page does not say how a site is chosen for a given answer, so we do not either.

Last read 2026-10-15. Re-check if OpenAI updates either page.