ChatGPT-User
OpenAI · Answers right now
ChatGPT-User visits a page when someone asks ChatGPT or a custom GPT a question; it does not crawl the web automatically. Because a person starts these visits, OpenAI says robots.txt rules may not apply to them.
Fact sheet
- Operator
- OpenAI
- What it is for
- It fetches a page when someone asks the assistant a question, to answer with it.
- Assistant it feeds
- ChatGPT
- Counts towards the Parsigo score
- Yes. It fetches pages for one of the assistants we measure.
- Official documentation
- developers.openai.com/api/docs/bots
- Official IP ranges
- JSON list
If you block it
You ask the assistant (ChatGPT) not to fetch your pages when someone asks it a question. The operator warns that robots.txt may not apply to these requests, because a person starts them.
Allow or block
A group of its own makes ChatGPT-User ignore the “User-agent: *” rules. If you have Disallow lines there that should still apply to it, repeat them inside its group. To allow it, writing nothing is usually enough.
Allow
User-agent: ChatGPT-User Allow: /
Block
User-agent: ChatGPT-User Disallow: /
Test it on your site
We run the diagnostic on your site and show you whether ChatGPT-User can get in, with the robots.txt line that decides it. Free, no sign-up.
Worth knowing
Reads your site live when a user asks for information about it.