Skip to content

For website owners and administrators

CitationLabBot

CitationLabBot is the crawler behind CitationLab's analyses and checks. This page says when it visits, how to recognise it and how to limit it.

01

In short

CitationLabBot reads a website when its owner has added the site to CitationLab, or when someone runs one of our free checks on it. It identifies itself in its user agent, fetches from the IP addresses listed on this page and follows the rules a robots.txt sets for CitationLabBot.

02

How to recognise it

Every request CitationLabBot makes carries this user agent:

CitationLabBot/1.0 (+https://citationlab.ai/bot)

A request is from CitationLabBot when it has this user agent AND comes from one of the IP addresses below. A request that only uses the name can be anyone; treat it as unverified.

03

When it visits

  • The site's owner asked for it

    A business, or the agency working for it, has added its website to CitationLab AI Marketing Manager. CitationLabBot then reads that site for the analyses and monitoring the owner has switched on.

  • Someone ran a free check

    A person has entered the address in one of the free checks on our websites. CitationLabBot reads the pages that check needs, once, and stops.

It does not wander the web. It reads a website only for one of these two reasons.

04

What it does

It does

  • Read public pages, sitemaps, feeds and robots.txt
  • Check whether pages answer and how quickly
  • Read the structured data and metadata a page publishes

It does not

  • Log in, fill in or submit forms, or buy anything
  • Read anything that requires a password
  • Train AI models on your content
  • Collect personal data from your visitors

05

Visits in a full browser

Some analyses need to see a page the way a visitor sees it, for example a screenshot or a cookie banner. Those visits are made in a full browser that presents itself as an ordinary browser, because many sites show a bot a different page. They come from the same IP addresses as CitationLabBot, so allowing those addresses covers them too.

06

IP addresses

CitationLabBot fetches from these addresses. The list is updated here when they change.

Loading the current list …

Machine-readable list (JSON)

07

Limit or block it with robots.txt

CitationLabBot follows the rules in a robots.txt group named CitationLabBot. To keep it away from the whole site:

User-agent: CitationLabBot
Disallow: /

Or keep it away from parts of the site:

User-agent: CitationLabBot
Disallow: /checkout/
Disallow: /account/

Rules under User-agent: * do not apply to CitationLabBot. It only visits when the site's owner, or a person checking the site, asked for it, the same principle the large search engines follow for fetches a user triggers. Name CitationLabBot to limit it.

If you are a CitationLab customer: blocking CitationLabBot also stops the analyses of your own site in CitationLab.

08

Allow it through a firewall

If a firewall or bot protection stops CitationLabBot, allow the user agent together with the IP addresses above. Allowing the user agent alone also lets in anyone who borrows the name.

09

Questions or problems

If CitationLabBot causes a problem on your website, or you want us to stop visiting a domain, write to post@citationlab.ai.

Last reviewed: 2026-11-15

Your feedback

Was this page helpful?

Did the page help you? Let us know if anything is unclear or missing.