- AI crawlers
- DataForSeoBot
DataForSeoBot
DataForSEO · SEO tool
DataForSeoBot adds the links it finds on your pages to DataForSEO's backlink database, and the company says it collects no other data from your site. Its page has a button that asks it to reload your robots.txt.
Fact sheet
- Operator
- DataForSEO
- What it is for
- It crawls for an SEO tool that agencies and competitors use to audit sites.
- Assistant it feeds
- Does not feed any assistant's answers
- Counts towards the Parsigo score
- No. It is an SEO tool, not an AI one.
- Official documentation
- dataforseo.com/dataforseo-bot
If you block it
You ask the tool to stop analysing your site. It is your call, and your score does not change.
Allow or block
A group of its own makes DataForSeoBot ignore the “User-agent: *” rules. If you have Disallow lines there that should still apply to it, repeat them inside its group. To allow it, writing nothing is usually enough.
Allow
User-agent: DataForSeoBot Allow: /
Block
User-agent: DataForSeoBot Disallow: /
Test it on your site
We run the diagnostic on your site and show you whether DataForSeoBot can get in, with the robots.txt line that decides it. Free, no sign-up.