meta-externalagent

meta-externalagent collects pages for Meta's AI, including training its models.

Updated

What happens if you block meta-externalagent

Meta stops collecting your pages for its AI.

# Allow meta-externalagent
User-agent: meta-externalagent
Allow: /

# Block meta-externalagent
User-agent: meta-externalagent
Disallow: /

Add one of these to your robots.txt. If your site is connected to Citerank Deploy, it can add the lines for you and take them out again later.

Checking that it's really meta-externalagent

Meta doesn't publish a list of IP addresses for meta-externalagent, so there's no reliable way to confirm a request really came from them.

Frequently asked questions

What is meta-externalagent?

meta-externalagent collects pages for Meta's AI, including training its models.

Should I block meta-externalagent?

Meta stops collecting your pages for its AI. If you want to show up in ChatGPT, Claude or Perplexity answers, keep their search and user-question bots allowed. Training bots are a separate decision.

How do I block meta-externalagent?

Add User-agent: meta-externalagent and Disallow: / to your robots.txt. If you need to be certain, a firewall rule will also stop anything that ignores robots.txt.

How can I see when meta-externalagent visits my site?

Connect the Citerank WordPress plugin or Cloudflare Worker and open AI Traffic. It shows each visit from meta-externalagent, which pages it looked at, and when it last came by.

See which AI bots visit your site

AI Traffic shows every visit from ChatGPT, Claude, Perplexity and the rest, and the people who click through from their answers.

Open AI Traffic