// scorecard · 48/100
verified 1mo agoAgent-readiness20/35
Agent registration (api_key)6/9
Public API5/5
OpenAPI spec0/9
MCP server9/9
llms.txt0/3
Reliability & performance0/15
Actively maintained—
Production-ready0/4
Updated recently—
Pricing12/13
Itemized public pricing6/6
Free tier / trial4/4
Free-tier generosity2/3
Docs & DX12/12
Docs quality8/8
Public API2/2
Quickstart / examples2/2
Security & compliance0/12
SOC 20/6
ISO 270010/2
GDPR0/2
Security / trust page0/2
Openness4/10
Open source0/6
Open / un-gated API4/4
Company maturity0/3
Company size—
Years operating—
// rankings · cost per standard workload
#11 in Scraping$76.4/ 100k pages
PAYG graduated Standard: 1k@$3 + 10k@$2 + 89k@$0.60 = $76.40/mo (only successful billed)
crawlbase.com/pricing// overview
Crawlbase provides web data infrastructure including Crawling API, Enterprise Crawler, Smart AI Proxy, Cloud Storage, and Crawlbase Web MCP for connecting AI agents to live web data. It enables crawling, scraping, proxying, and storing data from any website with anti-bot bypass and JS rendering. Supports 1M+ websites for e-commerce, generative AI, and other use cases with SDKs and MCP integration for Claude, Cursor, and similar tools.
Best for: developers, enterprises & LLMs needing scalable web crawling/scraping and proxies
// pricing
Free tier · generosity 3/5
Includes: 1000 free requests
Limits: no credit card required
Standard$3.00 per 1000 reqs (0-1k)
- reliable crawling for stable sites
Moderate$0.003 per req
- smart crawling for JS/login/light anti-bot
// security & compliance
✗ SOC 2✗ ISO 27001✗ GDPR✗ HIPAA
// features
- Crawling API with headless rendering and anti-bot bypass
- Enterprise Crawler for large-scale async data extraction
- Smart AI Proxy with residential/datacenter rotation
- Cloud Storage for crawled/scraped data
- Crawlbase Web MCP for AI agents like Claude/Cursor
- SDKs for Python, Node.js, Ruby, PHP, Go, Java, C#/.NET