Verified bots
A verified bot is a bot that Cloudflare has confirmed as legitimate, such as search engine crawlers and monitoring services.
You can request for your bot to be added to Cloudflare's bots and agents directory by filling out an online application ↗ in the Cloudflare dashboard.
For a bot to be verified, it must meet the following requirements:
- The bot must follow verified bots policy.
- The bot must be verified using one of the following verification methods:
Once Cloudflare approves a verified bot, it should appear on Cloudflare Radar's bots and agents directory ↗.
The bot must be verified using one of the following validation methods:
You can segment your verified bot traffic by its type and purpose by adding the Verified Bot Categories field cf.verified_bot_category as a filter criteria in WAF Custom rules, Advanced Rate Limiting, and Late Transform rules.
Academic research
String value: Academic Research
Definition: Gathers data for scholarly research or academic purposes.
Example: Library of Congress, TurnItInBot, Bibliothèque nationale de France
Accessibility
String value: Accessibility
Definition: Scans websites to identify their accessibility.
Example: Accessible Web Bot
Advertising or marketing
String value: Advertising & Marketing
Definition: Automates marketing tasks including, but not limited to, ad placement and performance tracking.
Example: Google Adsbot
Aggregators
String value: Aggregator
Definition: Collects content from various online sources and consolidates it in one place.
Example: Pinterest, Indeed Jobsbot
AI Assistant
String value: AI Assistant
Definition: Automated AI bot driven by user action.
Example: Perplexity-User, DuckAssistBot
AI Crawler
String value: AI Crawler
Definition: Crawls websites for content that is used for training AI models.
Example: Google Bard, ChatGPT bot
AI Search
String value: AI Search
Definition: Powers AI-driven search experiences.
Example: OAI-SearchBot
Archiver
String value: Archiver
Definition: Saves snapshots of websites to preserve digital content for historical records.
Example: Internet Archive, CommonCrawl
Feed fetcher
String value: Feed Fetcher
Definition: Retrieves updates from feeds to power readers or other applications.
Example: RSS or Podcast feed updaters
Monitoring or analytics
String value: Monitoring & Analytics
Definition: Tracks a website's uptime, performance, and user traffic to gather key monitoring metrics.
Example: Uptime Monitors