Google-Extended

Google-Extended isn't a crawler. Googlebot reads your pages as usual, and this robots.txt setting tells Google whether it can use them for Gemini.

Updated

What happens if you block Google-Extended

Google won't use your pages to train Gemini or to ground its answers. Your Google Search rankings don't change.

# Allow Google-Extended
User-agent: Google-Extended
Allow: /

# Block Google-Extended
User-agent: Google-Extended
Disallow: /

Add one of these to your robots.txt. If your site is connected to Citerank Deploy, it can add the lines for you and take them out again later.

Other Google bots

Google also uses Google-Agent (answering user questions). Each one has its own line in robots.txt, so you can allow some and block others.

Checking that it's really Google-Extended

Google-Extended never visits your site. It's only a line in robots.txt, so there's nothing to check.

Frequently asked questions

What is Google-Extended?

Google-Extended isn't a crawler. Googlebot reads your pages as usual, and this robots.txt setting tells Google whether it can use them for Gemini.

Should I block Google-Extended?

Google won't use your pages to train Gemini or to ground its answers. Your Google Search rankings don't change. If you want to show up in ChatGPT, Claude or Perplexity answers, keep their search and user-question bots allowed. Training bots are a separate decision.

How do I block Google-Extended?

Add User-agent: Google-Extended and Disallow: / to your robots.txt. If you need to be certain, a firewall rule will also stop anything that ignores robots.txt.

See which AI bots visit your site

AI Traffic shows every visit from ChatGPT, Claude, Perplexity and the rest, and the people who click through from their answers.

Open AI Traffic