Claude-User

When someone asks Claude a question and it decides to look at your page, Claude-User is what fetches it.

Updated

What happens if you block Claude-User

Claude can't open your pages when it's answering someone.

One thing to know: Claude-User fetches a page because a person asked for it, and some vendors do not apply robots.txt to that. Check Anthropic's documentation, and use a firewall rule if you need to be sure.

# Allow Claude-User
User-agent: Claude-User
Allow: /

# Block Claude-User
User-agent: Claude-User
Disallow: /

Add one of these to your robots.txt. If your site is connected to Citerank Deploy, it can add the lines for you and take them out again later.

Other Anthropic bots

Anthropic also uses Claude-SearchBot (search results) and ClaudeBot (model training). Each one has its own line in robots.txt, so you can allow some and block others.

Checking that it's really Claude-User

Anthropic doesn't publish a list of IP addresses for Claude-User, so there's no reliable way to confirm a request really came from them.

Frequently asked questions

What is Claude-User?

When someone asks Claude a question and it decides to look at your page, Claude-User is what fetches it.

Should I block Claude-User?

Claude can't open your pages when it's answering someone. If you want to show up in ChatGPT, Claude or Perplexity answers, keep their search and user-question bots allowed. Training bots are a separate decision.

How do I block Claude-User?

Add User-agent: Claude-User and Disallow: / to your robots.txt. Some vendors do not apply robots.txt to bots that fetch pages for a person, so check Anthropic's documentation, and use a firewall rule to be sure.

How can I see when Claude-User visits my site?

Connect the Citerank WordPress plugin or Cloudflare Worker and open AI Traffic. It shows each visit from Claude-User, which pages it looked at, and when it last came by.

See which AI bots visit your site

AI Traffic shows every visit from ChatGPT, Claude, Perplexity and the rest, and the people who click through from their answers.

Open AI Traffic