Bot Documentation

CiterankBot

CiterankBot is Citerank's web crawler, used to audit pages for AI search visibility signals. It only crawls pages that users explicitly submit for analysis.

User-Agent String

CiterankBot/1.0 (+https://citerankscore.com/bot)

Variants

Some tool-specific crawls identify the purpose:

CiterankBot/1.0 JourneySimulator (+https://citerankscore.com/bot) · AI journey simulation
Mozilla/5.0 (compatible; CiterankBot/1.0; +https://citerankscore.com/bot), standard page fetch

What CiterankBot does

Fetches page HTML to check schema markup, meta tags, and structured data
Reads robots.txt and llms.txt for AI crawler access signals
Checks response headers for security and caching configuration
Measures page load performance signals
Compares content between standard and bot user-agents (cloaking detection)

What CiterankBot does NOT do

It does not crawl sites autonomously or build a link index
It only fetches URLs that users explicitly submit in the Citerank dashboard
It does not store or republish your page content
It respects robots.txt directives

Blocking CiterankBot

To block CiterankBot from fetching your pages, add this to your robots.txt:

User-agent: CiterankBot
Disallow: /

Note: blocking CiterankBot will prevent Citerank users from running audits on your pages.

Contact

Questions about CiterankBot? Email us

See how your site looks to AI crawlers

Citerank runs the same analysis CiterankBot performs, and gives you an AI Visibility Score, citation rate, schema gaps, and a fix plan. Free, no card required.

Run Free Audit →