Claude-User
When someone asks Claude a question and it decides to look at your page, Claude-User is what fetches it.
Updated
What happens if you block Claude-User
Claude can't open your pages when it's answering someone.
One thing to know: Claude-User fetches a page because a person asked for it, and some vendors do not apply robots.txt to that. Check Anthropic's documentation, and use a firewall rule if you need to be sure.
# Allow Claude-User
User-agent: Claude-User
Allow: /
# Block Claude-User
User-agent: Claude-User
Disallow: /
Add one of these to your robots.txt. If your site is connected to Citerank Deploy, it can add the lines for you and take them out again later.
Other Anthropic bots
Anthropic also uses Claude-SearchBot (search results) and ClaudeBot (model training). Each one has its own line in robots.txt, so you can allow some and block others.
Checking that it's really Claude-User
Anthropic doesn't publish a list of IP addresses for Claude-User, so there's no reliable way to confirm a request really came from them.
Frequently asked questions
What is Claude-User?
When someone asks Claude a question and it decides to look at your page, Claude-User is what fetches it.
Should I block Claude-User?
Claude can't open your pages when it's answering someone. If you want to show up in ChatGPT, Claude or Perplexity answers, keep their search and user-question bots allowed. Training bots are a separate decision.
How do I block Claude-User?
Add
User-agent: Claude-UserandDisallow: /to your robots.txt. Some vendors do not apply robots.txt to bots that fetch pages for a person, so check Anthropic's documentation, and use a firewall rule to be sure.How can I see when Claude-User visits my site?
Connect the Citerank WordPress plugin or Cloudflare Worker and open AI Traffic. It shows each visit from Claude-User, which pages it looked at, and when it last came by.