Guides

Anti-Bot Technology Compared: What Each Vendor Does

Most large websites now run bot protection, and the products work in very different ways. We read each vendor's own documentation, plus independent research, to compare how 15 products detect bots, what they do about them, and where each falls short.

Major sites with bot protection
64%
Of 179 top US sites we tested[13]
Most common vendor
Akamai
44 of 179 sites; Cloudflare 41[13]
reCAPTCHA v2 images solved by AI
100%
ETH Zurich study[29]
Bot evasion vs. DataDome
52.93%
Average, 20 bot services, academic test[18]
Screen-reader users’ top problem
CAPTCHA
WebAIM survey[42]

Key findings

How bot detection works

Most products combine several of these layers:

Who's most common

Anti-bot vendors detected on 179 major US websites
Marquee Data survey, October 2026. Some sites run more than one[13].
Akamai
44
Cloudflare
41
DataDome
10
Imperva
9
HUMAN
9

Side by side

ProductWhere it runsShows CAPTCHAsAI-bot controlsPricing
CloudflareCDN edgeTurnstile (invisible)Default AI blocking, Pay Per CrawlPlans public[40]; Bot Management custom
AkamaiCDN edge + page scriptChallengesSeparate AI categoriesNot found
HUMANJS sensor + enforcerYes (own challenge)—Not found
DataDomeJS + server moduleWhen neededAgent trust scoreNot found
ImpervaEdge / proxyRarely (vendor claim)—Not found
KasadaEdge, proxy or backendNoWeb Bot Auth supportNot found
F5JS + mobile SDKNo—Not found
AWS WAFAWS edge / regionalYesDefault AI blocking, HTTP 402, Web Bot AuthPublic
reCAPTCHAPage scriptv2 yes, v3 no—Public
hCaptchaPage scriptYes—Public
FastlyCDN edgeChallenges—Sales
NetaceaServer-sideNo—Not found
CequenceNetworkNo—Not found
Friendly CaptchaPage scriptNo (proof-of-work)—Public
Azure WAFFront Door edgeYes—Public[41]

"Not found" means we found no published pricing on the vendor's site.

Vendor by vendor

Cloudflare

CDN edge · Bot Management (Enterprise) · Bot Fight Mode (free) · Super Bot Fight Mode · Turnstile

Scores every request from 1 (almost certainly automated) to 99 (almost certainly human)[1]. A machine-learning engine makes most detections, and a JavaScript engine spots headless browsers[2]. Turnstile is its CAPTCHA alternative, using invisible checks such as proof-of-work and proof-of-space[3].

Strengths

  • Free and low-cost tiers: Bot Fight Mode is free, and Super Bot Fight Mode comes with Pro, Business and Enterprise plans[4][5]
  • Blocks AI crawlers by default since July 2025, and can charge them through Pay Per Crawl[6][7]
  • AI Labyrinth feeds AI-generated decoy pages to unwanted crawlers[8]

Limits

  • TLS fingerprints (JA3/JA4) are available only to Enterprise Bot Management customers[9]
  • Bot Fight Mode can't be adjusted with custom firewall rules[4]
  • A bad Bot Management file caused the November 18, 2025 outage, during which some traffic got a bot score of zero[10]

Akamai

CDN edge · Bot Manager · Content Protector

Bot Manager uses AI models for behavior analysis and browser fingerprinting and acts at Akamai's edge. Its behavior detection works by injecting a script into each monitored page[11]. Content Protector targets scrapers specifically, with headless-browser detection and responses including monitor-and-deny, tarpits and challenges[12].

Strengths

  • The most common vendor in our survey of major sites: 44 of 179[13]
  • Separate AI categories since September 2026: training crawlers, search crawlers, and fetchers and agents, so each can get its own policy[14]
  • Tarpits slow scrapers down instead of only blocking them

Limits

  • No public pricing found
  • Behavior detection depends on a script injected into pages

HUMAN (formerly PerimeterX)

JavaScript sensor + cloud detector + enforcer

A JavaScript sensor in the browser sends data to a cloud detector that scores it with machine learning and behavioral analytics. An enforcer installed on the app, load balancer or CDN then allows, blocks or challenges[15].

Strengths

  • Enforcer can sit on the app, load balancer or CDN, so it isn't tied to one network
  • Combines device, behavior and network data[15]

Limits

  • Needs both a browser sensor and a server-side enforcer
  • No public pricing found

DataDome

JavaScript device check · server modules

Device Check runs JavaScript in the browser to collect hundreds of signals, working like a CAPTCHA without showing one. When it needs more evidence, it escalates to a visible CAPTCHA[16]. It also scores AI agents with a trust score[17].

Strengths

  • Usually invisible to people[16]
  • Per-agent trust scoring for AI traffic[17]

Limits

  • An academic study sent half a million requests from 20 commercial bot services at a test site protected by DataDome, and found an average evasion rate of 52.93%[18]
  • No public pricing found

Imperva (Thales)

Advanced Bot Protection

Combines client checks, behavior analysis, machine learning and connection characteristics[19].

Strengths

  • Says legitimate users don't see a CAPTCHA on 99.999% of requests[19] (vendor claim)
  • Found on 9 of 179 major sites in our survey[13]

Limits

  • No public pricing found

Kasada

Client sensors · edge, proxy or backend integration

Hundreds of hidden sensors look for traces of automation in the browser, and its code runs in an obfuscated virtual machine to prove it really executed. Kasada says it uses no CAPTCHA and classifies sessions in under 2 milliseconds[20].

Strengths

  • No CAPTCHAs and no rules for customers to manage[20]
  • AI Agent Trust supports the Web Bot Auth standard for verified agents[21]

Limits

  • Speed and detection figures are vendor claims
  • No public pricing found

F5 Distributed Cloud Bot Defense (formerly Shape)

JavaScript + mobile SDK

Collects telemetry with JavaScript in browsers and a native SDK in mobile apps, instead of using CAPTCHAs[22].

Strengths

  • Covers mobile apps through its SDK
  • No CAPTCHAs for users

Limits

  • Mobile protection requires building the SDK into the app
  • No public pricing found

AWS WAF Bot Control

AWS WAF managed rules · CloudFront and regional

"Common" level catches bots that identify themselves; "Targeted" adds browser interrogation, fingerprinting and behavior heuristics for bots that don't[23]. A dedicated rule blocks AI bots by default, it accepts cryptographic identity from legitimate AI agents (Web Bot Auth), and it can answer AI bots with HTTP 402 Payment Required[23][24].

Strengths

  • Published pricing: Common includes 10 million requests a month free, Targeted 1 million[25]
  • Clear AI-bot controls, including paid access[24]

Limits

  • AWS documents false positives, for example mobile apps with non-browser user agents[26]
  • Targeted protection needs AWS's JavaScript or mobile SDKs to work well

Google reCAPTCHA

Script on the page · score-based (v3) or challenge (v2)

An invisible, score-based check[27]. reCAPTCHA v3 returns a score where 1.0 is very likely a person and 0.0 very likely a bot, and the site decides what to do[28].

Strengths

  • Free up to 10,000 assessments a month, then $8 flat up to 100,000[27]
  • v3 never interrupts users[28]

Limits

  • Researchers at ETH Zurich solved 100% of reCAPTCHA v2 image challenges with a fine-tuned vision model[29]
  • A 13-month study of over 3,600 users concluded reCAPTCHA v2 has "an immense cost and no security"[30]

hCaptcha

Script on the page · CAPTCHA and enterprise risk scoring

A CAPTCHA service with free, Pro and Enterprise tiers[31].

Strengths

  • Published pricing: Pro at $139 a month (or $99 billed yearly) with 100,000 evaluations, then $0.99 per 1,000[31]

Limits

  • Claims WCAG 2.2 AA accessibility but tells sites to evaluate their own deployment[32]

Fastly Bot Management

CDN edge

Uses TLS client fingerprints (JA3/JA4), edge detection and optional JavaScript checks for headless browsers[33], plus a "defensive maze" that misleads bots[34].

Strengths

  • Runs at the edge with no page changes needed for basic detection
  • Deception options besides blocking

Limits

  • Pricing through sales only

Netacea

Server-side, no client code

Analyzes traffic on the server, with no code in the browser: "Never deploy agents again."[35]

Strengths

  • Nothing for visitors to download or run
  • Works across websites, apps and APIs

Limits

  • Without browser signals it relies on traffic behavior alone
  • No public pricing found

Cequence

Network-based, no client code

Detects bots from network traffic with "no client-side JavaScript or SDK integration". Responses include blocking, rate limiting, header injection and deception[36].

Strengths

  • No changes to web pages or apps
  • Covers APIs as well as websites

Limits

  • No public list pricing found

Friendly Captcha

Proof-of-work CAPTCHA

Has the visitor's device solve a cryptographic puzzle in the background, sets no cookies, and starts at €9 a month[37].

Strengths

  • No puzzles for people and no tracking cookies
  • Low published prices

Limits

  • Proof-of-work raises the cost of automation but doesn't identify who is behind it

Microsoft Azure WAF (Front Door)

Managed bot rules on Front Door Premium

Sorts bots into bad, good and unknown; by default bad bots are blocked, good bots allowed and unknown bots logged[38].

Strengths

  • Simple defaults managed by Microsoft

Limits

  • Its CAPTCHA doesn't work for AJAX or API calls[39]

We couldn't read Radware's or Arkose Labs' product pages reliably, so they aren't included.

The CAPTCHA problem

The AI shift

What it means if you need web data

Methodology

We gathered these facts on November 15, 2026 from each vendor's own product pages and documentation, published pricing, peer-reviewed and preprint research, and our own survey of 200 major websites. Strengths and limits come from documented features, published research and vendor statements, which we label as vendor claims. We didn't test any product ourselves for this article. Products change often, so check the vendor's current documentation.

Sources

  1. https://developers.cloudflare.com/bots/concepts/bot-score/
  2. https://developers.cloudflare.com/bots/concepts/bot-detection-engines/
  3. https://developers.cloudflare.com/turnstile/
  4. https://developers.cloudflare.com/bots/get-started/bot-fight-mode/
  5. https://developers.cloudflare.com/bots/get-started/super-bot-fight-mode/
  6. https://blog.cloudflare.com/content-independence-day-no-ai-crawl-without-compensation/
  7. https://blog.cloudflare.com/introducing-pay-per-crawl/
  8. https://blog.cloudflare.com/ai-labyrinth/
  9. https://developers.cloudflare.com/bots/additional-configurations/ja3-ja4-fingerprint/
  10. https://blog.cloudflare.com/18-november-2025-outage/
  11. https://www.akamai.com/products/bot-manager
  12. https://www.akamai.com/products/content-protector
  13. https://marqueedata.com/guide/anti-bot-protection-survey-2026.html
  14. https://www.akamai.com/blog/security/2026/sep/introducing-more-granular-controls-ai-bot-traffic
  15. https://docs.humansecurity.com/applications-and-accounts/docs/bot-defender
  16. https://docs.datadome.co/docs/device-check
  17. https://docs.datadome.co/docs/agentic-trust-getting-started
  18. https://arxiv.org/abs/2406.07647
  19. https://www.imperva.com/products/advanced-bot-protection-management/
  20. https://www.kasada.io/bot-defense
  21. https://www.kasada.io/kasada-launches-ai-agent-trust-to-secure-agentic-commerce/
  22. https://docs.cloud.f5.com/docs-v2/bot-defense/concepts/about-bot-defense
  23. https://docs.aws.amazon.com/waf/latest/developerguide/aws-managed-rule-groups-bot.html
  24. https://docs.aws.amazon.com/waf/latest/developerguide/waf-bot-control.html
  25. https://aws.amazon.com/waf/pricing/
  26. https://docs.aws.amazon.com/waf/latest/developerguide/waf-bot-control-false-positives.html
  27. https://cloud.google.com/security/products/recaptcha
  28. https://developers.google.com/recaptcha/docs/v3
  29. https://arxiv.org/abs/2409.08831
  30. https://arxiv.org/abs/2311.10911
  31. https://www.hcaptcha.com/pricing
  32. https://hcaptcha.com/accessibility
  33. https://docs.fastly.com/products/bot-management
  34. https://www.fastly.com/products/bot-management
  35. https://netacea.com/bot-protection/
  36. https://www.cequence.ai/products/bot-defense/
  37. https://friendlycaptcha.com/llms.txt
  38. https://learn.microsoft.com/en-us/azure/web-application-firewall/afds/afds-overview
  39. https://learn.microsoft.com/en-us/azure/web-application-firewall/afds/captcha-challenge
  40. https://www.cloudflare.com/plans/
  41. https://azure.microsoft.com/en-us/pricing/details/frontdoor/
  42. https://webaim.org/projects/screenreadersurvey10/
Want this fully-managed?

Marquee Data has built and managed custom web data collection since 2017 — Fortune 500 and hedge-fund clients, 100% US-based senior engineers, fixed fees. You don't pay until you're satisfied with the data.

Tell us about your project or email solutions@marqueedata.com.

← All guides · Web Scraping 101: the complete guide