OAI-SearchBot

OAI-SearchBot crawls the web for ChatGPT search. If it hasn't crawled a page, that page is unlikely to show up or be cited there.

Updated

What happens if you block OAI-SearchBot

Your site stops showing up in ChatGPT search. If you want to be cited in ChatGPT, this is the OpenAI bot to keep allowed.

# Allow OAI-SearchBot
User-agent: OAI-SearchBot
Allow: /

# Block OAI-SearchBot
User-agent: OAI-SearchBot
Disallow: /

Add one of these to your robots.txt. If your site is connected to Citerank Deploy, it can add the lines for you and take them out again later.

Other OpenAI bots

OpenAI also uses ChatGPT-User (answering user questions) and GPTBot (model training). Each one has its own line in robots.txt, so you can allow some and block others.

Checking that it's really OAI-SearchBot

OpenAI publishes the IP addresses OAI-SearchBot uses (list). If a request says it's OAI-SearchBot but comes from another address, it isn't OpenAI. Citerank's AI Traffic report checks every visit against this list.

Frequently asked questions

What is OAI-SearchBot?

OAI-SearchBot crawls the web for ChatGPT search. If it hasn't crawled a page, that page is unlikely to show up or be cited there.

Should I block OAI-SearchBot?

Your site stops showing up in ChatGPT search. If you want to be cited in ChatGPT, this is the OpenAI bot to keep allowed. If you want to show up in ChatGPT, Claude or Perplexity answers, keep their search and user-question bots allowed. Training bots are a separate decision.

How do I block OAI-SearchBot?

Add User-agent: OAI-SearchBot and Disallow: / to your robots.txt. If you need to be certain, a firewall rule will also stop anything that ignores robots.txt.

How can I see when OAI-SearchBot visits my site?

Connect the Citerank WordPress plugin or Cloudflare Worker and open AI Traffic. It shows each visit from OAI-SearchBot, which pages it looked at, and when it last came by.

See which AI bots visit your site

AI Traffic shows every visit from ChatGPT, Claude, Perplexity and the rest, and the people who click through from their answers.

Open AI Traffic