- AI crawlers
- DotBot
DotBot
Moz · SEO tool
DotBot gathers the data behind Moz's Link Explorer and Links API. It reads your robots.txt only when it first reaches your site in each new index crawl, so a change may not reach it until it finds links to your site again.
Fact sheet
- Operator
- Moz
- What it is for
- It crawls for an SEO tool that agencies and competitors use to audit sites.
- Assistant it feeds
- Does not feed any assistant's answers
- Counts towards the Parsigo score
- No. It is an SEO tool, not an AI one.
- Official documentation
- moz.com/help/moz-procedures/crawlers/dotbot
If you block it
You ask the tool to stop analysing your site. It is your call, and your score does not change.
Allow or block
A group of its own makes DotBot ignore the “User-agent: *” rules. If you have Disallow lines there that should still apply to it, repeat them inside its group. To allow it, writing nothing is usually enough.
Allow
User-agent: DotBot Allow: /
Block
User-agent: DotBot Disallow: /
Test it on your site
We run the diagnostic on your site and show you whether DotBot can get in, with the robots.txt line that decides it. Free, no sign-up.
Worth knowing
Feeds Moz's link index. Its site audit uses a separate crawler, rogerbot.