- AI crawlers
- Claude-Web
Claude-Web
Anthropic · Retired name
Anthropic no longer lists this name. To ask it not to train on your content, the rule has to name ClaudeBot.
Claude-Web does not appear on Anthropic's crawler page, which lists ClaudeBot, Claude-User and Claude-SearchBot. A rule for Claude-Web reaches none of them: each is blocked by its own name.
Block ClaudeBot
User-agent: ClaudeBot Disallow: /