Cloudflare AI Crawl Control review: pricing, features & alternatives

developers.cloudflare.com/ai-crawl-control/features/analyze-ai-traffic (read 20 October 2026). The Overview tab gives total and allowed requests, unsuccessful requests, the most common status code and most popular path, and crawlers grouped by operator. The Metrics tab charts requests and data transfer by crawler, category, operator or host, shows status codes from 2xx to 5xx, and compares requested and served content types. A most popular paths table lists requests and referrals per path, with grouping such as /blog/*.

Referral sources, destination patterns and referrals over time are marked as paid-plan features. Data can be downloaded as CSV or pulled through the GraphQL Analytics API.

developers.cloudflare.com/ai-crawl-control/features/manage-ai-crawlers (read 20 October 2026). Each crawler can be set to Allow or Block, and blocking creates or updates a WAF custom rule you can extend. Paid plans can set a custom block response, either 403 or 402 with a message. On the Free plan, crawlers are identified from user-agent strings, so only well-known self-identifying bots are detected; upgrading adds Bot Management detection IDs.

Pay per crawl, where a crawler is charged per successful request, is in closed beta and needs a signup or an Enterprise account executive.

Every row below is a capability we already listed for Cloudflare AI Crawl Control. It is the published feature set for this page, not a guess at an unpublished demo. Compare it with the Promptwatch checklist that follows.

On this listing, Cloudflare AI Crawl Control is a Free checker for Sites already on Cloudflare that want to see and control AI crawler access without adding another tool. What we sourced here: AI crawler requests over time by crawler, category, operator and hostname; Status code distribution, data transfer per crawler and most popular paths, with pattern grouping; Requested versus served content types (Accept and Content-Type headers); Allow or block per crawler, enforced as a Cloudflare WAF custom rule; Robots.txt health and violation tracking, and managed robots.txt status.

If you buy Cloudflare AI Crawl Control for the job above, plan a second tool (or Promptwatch) for the layers this listing does not document. Still missing here: Visitor analytics: AI-referred sessions and conversions; Content Agents that plan, write, and publish GEO pages to a CMS with a review inbox; Citation analytics at page, domain, Reddit, YouTube, and offsite level; Prompt volumes, difficulty, query fan-outs, personas, city-level geo; Prompt and citation trends (what changed between checks); ChatGPT Shopping tracking and Ads Radar; Agent Chat, Unified Actions, MCP server / REST API on paid plans. Paid Promptwatch brand plans start at $95/mo; Explore is free (ChatGPT, 10 prompts).

Cloudflare AI Crawl Control is a snapshot or grader, not a daily operations platform. Promptwatch is the paid measurement stack when you need history, crawler logs, visitor conversions, and content that ships from the same login.

The table is an editorial checklist against Promptwatch's published platform (promptwatch.com/llms.txt, 2026-08-23). It is not a hidden feature list for this vendor. 'Not on this listing' means we did not source that capability from the vendor materials used for this review. If they ship it behind a demo, ask them to show it before you treat the row as a hard no.