Crawler directory
Training crawlersUser agent only

Meta

meta-externalagent

About this crawler

Meta crawler for indexing or improving Meta products and AI systems.

Usually means: The crawler is collecting public web content that may be used for model training, datasets, or product improvement.

User agent

meta-externalagent

DataFast matches these as user-agent tokens, not full browser strings. Providers may add surrounding version or product text.

IP verification

User-agent only match

DataFast can identify this crawler from its user-agent token, but no official IP range source is wired for this crawler yet. Treat it as useful signal, not the same confidence as IP-verified traffic.

User agent

Request user agent contains meta-externalagent.

Request IP

The request IP may still be stored with the crawl event.

Range check

No published range source is configured for this crawler.

Discover when bots and AI assistants crawl your website.

Install the server-side tracker to see which AI assistants, search engines, and training crawlers request your pages. It helps you understand what bots are trying to find, including pages that return 404.