Control AI crawlers and assistants separately in Vercel Firewall

Vercel Firewall introduces a managed ruleset called AI Bots that allows users to log or block requests from AI crawlers and AI assistants independently. This feature enables users to block AI crawlers while permitting AI assistants to access content for answering user queries. The ruleset is updated automatically as new bots are identified, ensuring ongoing relevance without manual intervention.

To configure these controls, users must navigate to their project’s Security section, then Firewall, and finally Rules. Under Bot Management, the AI Bots option can be enabled, and its settings can be accessed via the gear icon. Users can then set distinct actions for AI crawlers and AI assistants, tailoring the behavior to their specific needs.

After configuring the AI Bots ruleset, users can review proposed changes using the vercel firewall diff command. This command displays a summary of the changes before they are applied, allowing for verification. Once confirmed, changes are published using the vercel firewall publish command, activating the new ruleset immediately.

The AI Bots managed ruleset is available across all Vercel plans, including free and paid tiers. Users can learn more about the feature and its configuration in the official Vercel documentation, which provides detailed guidance on setup and management.