Ask your AI agent about Bot traffic

Bot traffic is now available to your agents

You can now explore and manage Bot traffic through the DataFast API and MCP, using the same data and controls as the dashboard.

For example, ask your agent:

• “Which AI bots crawled my website this week?”
• “Is ChatGPT fetching my pages to answer users?”
• “Has my /llms.txt file been fetched, and by which companies?”
• “Which pages do AI assistants request most?”
• “Turn off Meta crawlers for this website.”

Your agent can also check your allowance, update crawler settings, and create or rotate a request-authentication token. Data-changing actions require confirmation, and your existing API token permissions and website access still apply.

Read the Bot traffic API reference or connect DataFast to your MCP client.

I hope this makes it easier to understand what AI companies are doing on your website ❤️

— Marc