One API for every web scraping vendor.
Send a URL, get the content. We route it through Firecrawl, Spider Cloud, ZenRows, Brightdata, Zyte, Apify, Oxylabs, and Browserless — cheapest first, escalating only when needed. Pay only for what succeeds.
Built like a router, not a wrapper.
Powered by the open-source gottem library — production-tested routing logic, exposed as a hosted service.
Free local fetch first. Escalates to proxies, headless Chrome, then paid vendors. Stops at the cheapest one that returns valid content.
Firecrawl, Spider Cloud, ZenRows, ScrapingBee, Brightdata, Zyte, Apify, Oxylabs, Browser Use, 2Captcha, Browserbase, Browserless — same request shape across all of them.
Ladder (cheapest-first), race (parallel — fastest wins), hedge (primary + staggered backups). Force a single provider for testing.
Plug in your existing Firecrawl or ZenRows account. We encrypt and pass it through. No vendor markup — just a flat infra fee per request.
After enough samples per (route, domain) the orchestrator skips the ladder warmup and starts at the proven route directly.
spider_firewall pre-filters known malicious URLs (phishing, malware, scams) before any vendor is billed. Defense in depth.
See the response shape.
Every scrape returns the page plus which provider handled it, what tier, and what it cost. Below is a simulated response — the real API returns identical JSON.
Try the request shape (this demo doesn't hit the live API — sign up for that).
{
"url": "https://example.com",
"status": 200,
"provider": "spider",
"route": "spider.fetch",
"adapter": "spider_page",
"tier": 0,
"cost_milli": 0,
"cost_dollars": "0.0000",
"cost_actual_units": 0,
"cost_actual_unit": "credits",
"elapsed_ms": 412,
"attempt": 1,
"content_bytes": 1256,
"content": "<!doctype html>\n<html>\n<head><title>Example Domain</title>..."
}Pay for what works.
Credit-based. 1 credit = $0.0001 (10,000 credits per dollar). Vendor cost × markup is debited per successful fetch. Subscriptions include monthly credit grants. Top up any time.
Try the routing engine. 1,000 credits on signup.
- 1,000 signup credits
- Limited vendors (pooled)
- Playground access
Light production usage — single project, small crawls.
Higher concurrency. Serious data pipelines.
- 1,000,000 credits / mo
- BYOK + per-vendor cost reports
- Priority routing
High-volume, multi-tenant production traffic.
- 5,000,000 credits / mo
- Custom markup negotiation
- Slack support channel
Tiers control rate limits (req/min, req/hr, concurrency). All tiers route through the same vendor pool. BYOK requests bill only a flat infra fee — no markup, no vendor charge on your gottem balance.
Stop wiring up scrapers one at a time.
Sign up, grab a key, and hit POST /scrape. We'll handle the rest.
Get 1,000 free credits