Allen AI
AI2Bot
About this crawler
Allen Institute crawler used to find documents for AI research systems.
Usually means: The crawler is collecting public web content that may be used for model training, datasets, or product improvement.
User agent
AI2BotDataFast matches these as user-agent tokens, not full browser strings. Providers may add surrounding version or product text.
IP verification
User-agent only match
DataFast can identify this crawler from its user-agent token, but no official IP range source is wired for this crawler yet. Treat it as useful signal, not the same confidence as IP-verified traffic.
User agent
Request user agent contains AI2Bot.
Request IP
The request IP may still be stored with the crawl event.
Range check
No published range source is configured for this crawler.
Discover when bots and AI assistants crawl your website.
Install the server-side tracker to see which AI assistants, search engines, and training crawlers request your pages. It helps you understand what bots are trying to find, including pages that return 404.