For website owners and administrators
CitationLabBot
CitationLabBot is the crawler behind CitationLab's analyses and checks. This page says when it visits, how to recognise it and how to limit it.
01
In short
CitationLabBot reads a website when its owner has added the site to CitationLab, or when someone runs one of our free checks on it. It identifies itself in its user agent, fetches from the IP addresses listed on this page and follows the rules a robots.txt sets for CitationLabBot.
02
How to recognise it
Every request CitationLabBot makes carries this user agent:
CitationLabBot/1.0 (+https://citationlab.ai/bot)A request is from CitationLabBot when it has this user agent AND comes from one of the IP addresses below. A request that only uses the name can be anyone; treat it as unverified.
03
When it visits
The site's owner asked for it
A business, or the agency working for it, has added its website to CitationLab AI Marketing Manager. CitationLabBot then reads that site for the analyses and monitoring the owner has switched on.
Someone ran a free check
A person has entered the address in one of the free checks on our websites. CitationLabBot reads the pages that check needs, once, and stops.
It does not wander the web. It reads a website only for one of these two reasons.
04
What it does
It does
- Read public pages, sitemaps, feeds and robots.txt
- Check whether pages answer and how quickly
- Read the structured data and metadata a page publishes
It does not
- Log in, fill in or submit forms, or buy anything
- Read anything that requires a password
- Train AI models on your content
- Collect personal data from your visitors
05
Visits in a full browser
Some analyses need to see a page the way a visitor sees it, for example a screenshot or a cookie banner. Those visits are made in a full browser that presents itself as an ordinary browser, because many sites show a bot a different page. They come from the same IP addresses as CitationLabBot, so allowing those addresses covers them too.
06
IP addresses
CitationLabBot fetches from these addresses. The list is updated here when they change.
Loading the current list …
07
Limit or block it with robots.txt
CitationLabBot follows the rules in a robots.txt group named CitationLabBot. To keep it away from the whole site:
User-agent: CitationLabBot
Disallow: /Or keep it away from parts of the site:
User-agent: CitationLabBot
Disallow: /checkout/
Disallow: /account/Rules under User-agent: * do not apply to CitationLabBot. It only visits when the site's owner, or a person checking the site, asked for it, the same principle the large search engines follow for fetches a user triggers. Name CitationLabBot to limit it.
If you are a CitationLab customer: blocking CitationLabBot also stops the analyses of your own site in CitationLab.
08
Allow it through a firewall
If a firewall or bot protection stops CitationLabBot, allow the user agent together with the IP addresses above. Allowing the user agent alone also lets in anyone who borrows the name.
09
Questions or problems
If CitationLabBot causes a problem on your website, or you want us to stop visiting a domain, write to post@citationlab.ai.

