- AI crawlers
- Meta-ExternalAds
Meta-ExternalAds
Meta · Advertising
Meta-ExternalAds crawls the web for uses such as improving advertising and other business-related products and services. On the same page, Meta names a different crawler, meta-externalagent, for training AI models.
Fact sheet
- Operator
- Meta
- What it is for
- It crawls for the operator's advertising.
- Assistant it feeds
- None of the assistants we measure
- Counts towards the Parsigo score
- No. It crawls for advertising, and the score only counts the search and answer crawlers of the assistants we measure.
- Official documentation
- developers.facebook.com/documentation/sharing/webmasters/web-crawlers
If you block it
You ask it not to crawl your pages for the operator's advertising. Your score does not change: it is not one of the search or answer crawlers we measure.
Allow or block
A group of its own makes Meta-ExternalAds ignore the “User-agent: *” rules. If you have Disallow lines there that should still apply to it, repeat them inside its group. To allow it, writing nothing is usually enough.
Allow
User-agent: Meta-ExternalAds Allow: /
Block
User-agent: Meta-ExternalAds Disallow: /
Test it on your site
We run the diagnostic on your site and show you whether Meta-ExternalAds can get in, with the robots.txt line that decides it. Free, no sign-up.