- AI crawlers
- PerplexityBot
PerplexityBot
Perplexity · Feeds a search index
PerplexityBot finds and links the websites in Perplexity's search results, and Perplexity says it does not collect content for AI foundation models. A robots.txt change can take up to 24 hours to reach it.
Fact sheet
- Operator
- Perplexity
- What it is for
- It crawls the web to build the index the assistant draws its answers from.
- Assistant it feeds
- Perplexity
- Counts towards the Parsigo score
- Yes. It feeds the index of one of the assistants we measure.
- Official documentation
- docs.perplexity.ai/docs/resources/perplexity-crawlers
- Official IP ranges
- JSON list
If you block it
You ask for your pages to be left out of the index the assistant (Perplexity) draws its answers from.
Allow or block
A group of its own makes PerplexityBot ignore the “User-agent: *” rules. If you have Disallow lines there that should still apply to it, repeat them inside its group. To allow it, writing nothing is usually enough.
Allow
User-agent: PerplexityBot Allow: /
Block
User-agent: PerplexityBot Disallow: /
Test it on your site
We run the diagnostic on your site and show you whether PerplexityBot can get in, with the robots.txt line that decides it. Free, no sign-up.