GPTBot

GPTBot collects pages OpenAI may use to train its models. It doesn't fetch pages to answer anyone's question.

Updated

What happens if you block GPTBot

Your pages are left out of future OpenAI training. It doesn't affect ChatGPT search, which uses OAI-SearchBot.

# Allow GPTBot
User-agent: GPTBot
Allow: /

# Block GPTBot
User-agent: GPTBot
Disallow: /

Add one of these to your robots.txt. If your site is connected to Citerank Deploy, it can add the lines for you and take them out again later.

Other OpenAI bots

OpenAI also uses ChatGPT-User (answering user questions) and OAI-SearchBot (search results). Each one has its own line in robots.txt, so you can allow some and block others.

Checking that it's really GPTBot

OpenAI publishes the IP addresses GPTBot uses (list). If a request says it's GPTBot but comes from another address, it isn't OpenAI. Citerank's AI Traffic report checks every visit against this list.

Frequently asked questions

What is GPTBot?

GPTBot collects pages OpenAI may use to train its models. It doesn't fetch pages to answer anyone's question.

Should I block GPTBot?

Your pages are left out of future OpenAI training. It doesn't affect ChatGPT search, which uses OAI-SearchBot. If you want to show up in ChatGPT, Claude or Perplexity answers, keep their search and user-question bots allowed. Training bots are a separate decision.

How do I block GPTBot?

Add User-agent: GPTBot and Disallow: / to your robots.txt. If you need to be certain, a firewall rule will also stop anything that ignores robots.txt.

How can I see when GPTBot visits my site?

Connect the Citerank WordPress plugin or Cloudflare Worker and open AI Traffic. It shows each visit from GPTBot, which pages it looked at, and when it last came by.

See which AI bots visit your site

AI Traffic shows every visit from ChatGPT, Claude, Perplexity and the rest, and the people who click through from their answers.

Open AI Traffic