ClaudeBot

ClaudeBot collects pages Anthropic may use to train its models.

Updated

What happens if you block ClaudeBot

Your pages are left out of future Anthropic training. Claude can still open them when someone asks a question, through Claude-User.

# Allow ClaudeBot
User-agent: ClaudeBot
Allow: /

# Block ClaudeBot
User-agent: ClaudeBot
Disallow: /

Add one of these to your robots.txt. If your site is connected to Citerank Deploy, it can add the lines for you and take them out again later.

Other Anthropic bots

Anthropic also uses Claude-User (answering user questions) and Claude-SearchBot (search results). Each one has its own line in robots.txt, so you can allow some and block others.

Checking that it's really ClaudeBot

Anthropic doesn't publish a list of IP addresses for ClaudeBot, so there's no reliable way to confirm a request really came from them.

Frequently asked questions

What is ClaudeBot?

ClaudeBot collects pages Anthropic may use to train its models.

Should I block ClaudeBot?

Your pages are left out of future Anthropic training. Claude can still open them when someone asks a question, through Claude-User. If you want to show up in ChatGPT, Claude or Perplexity answers, keep their search and user-question bots allowed. Training bots are a separate decision.

How do I block ClaudeBot?

Add User-agent: ClaudeBot and Disallow: / to your robots.txt. If you need to be certain, a firewall rule will also stop anything that ignores robots.txt.

How can I see when ClaudeBot visits my site?

Connect the Citerank WordPress plugin or Cloudflare Worker and open AI Traffic. It shows each visit from ClaudeBot, which pages it looked at, and when it last came by.

See which AI bots visit your site

AI Traffic shows every visit from ChatGPT, Claude, Perplexity and the rest, and the people who click through from their answers.

Open AI Traffic