Applebot-Extended
Applebot-Extended isn't a crawler. Applebot reads your pages, and this robots.txt setting tells Apple whether it can use them to train its AI models.
Updated
What happens if you block Applebot-Extended
Apple won't use your pages to train its models. Applebot can still show them in Siri and Spotlight.
# Allow Applebot-Extended
User-agent: Applebot-Extended
Allow: /
# Block Applebot-Extended
User-agent: Applebot-Extended
Disallow: /
Add one of these to your robots.txt. If your site is connected to Citerank Deploy, it can add the lines for you and take them out again later.
Checking that it's really Applebot-Extended
Applebot-Extended never visits your site. It's only a line in robots.txt, so there's nothing to check.
Frequently asked questions
What is Applebot-Extended?
Applebot-Extended isn't a crawler. Applebot reads your pages, and this robots.txt setting tells Apple whether it can use them to train its AI models.
Should I block Applebot-Extended?
Apple won't use your pages to train its models. Applebot can still show them in Siri and Spotlight. If you want to show up in ChatGPT, Claude or Perplexity answers, keep their search and user-question bots allowed. Training bots are a separate decision.
How do I block Applebot-Extended?
Add
User-agent: Applebot-ExtendedandDisallow: /to your robots.txt. If you need to be certain, a firewall rule will also stop anything that ignores robots.txt.