DuckDuckBot
DuckDuckGo · Another search engine or assistant
DuckDuckBot is the crawler DuckDuckGo uses to improve its search results; the AI-assisted answers use a separate one, DuckAssistBot. DuckDuckGo says it respects robots.txt rules (WWW::RobotRules).
Fact sheet
- Operator
- DuckDuckGo
- What it is for
- It crawls for a search engine or assistant the score does not measure.
- Assistant it feeds
- None of the assistants we measure
- Counts towards the Parsigo score
- No. It crawls for search or answers, but not for any of the assistants we measure.
- Official documentation
- duckduckgo.com/duckduckgo-help-pages/results/duckduckbot
- Official IP ranges
- JSON list
If you block it
You ask for your pages to be left out of the service it crawls for. Your score does not change: it belongs to none of the assistants we measure.
Allow or block
A group of its own makes DuckDuckBot ignore the “User-agent: *” rules. If you have Disallow lines there that should still apply to it, repeat them inside its group. To allow it, writing nothing is usually enough.
Allow
User-agent: DuckDuckBot Allow: /
Block
User-agent: DuckDuckBot Disallow: /
Test it on your site
We run the diagnostic on your site and show you whether DuckDuckBot can get in, with the robots.txt line that decides it. Free, no sign-up.