# Spidra

> Spidra is an AI-powered web scraping and crawling platform that turns any website into structured data. No code required. Built for developers, data teams, and businesses.

## What is Spidra?

Spidra is a SaaS platform that provides AI-powered web scraping infrastructure. Users describe what data they want in plain English, and Spidra launches a real headless browser, handles CAPTCHAs automatically, rotates residential proxies, and returns clean structured data — even from JavaScript-heavy or login-protected pages.

## Core Products

- **AI Scraper** (`/products/ai-scraper`): Extract structured data from any website using natural language prompts or CSS/XPath selectors. Handles SPAs, dynamic content, and authentication.
- **AI Crawler** (`/products/ai-crawler`): Domain-wide intelligent crawling. Point Spidra at a domain and describe what to find — it maps the site, filters irrelevant pages, and extracts at scale.
- **CAPTCHA Solver** (`/products/captcha-solver`): Automatic solving of reCAPTCHA v2/v3, hCaptcha, Cloudflare Turnstile, DataDome, and 8 more types. Runs transparently in the background on every job.
- **Proxy Scraping** (`/products/proxy-scraping`): Residential IP rotation across 50+ countries. Enable stealth mode with a single API parameter.
- **Auth Bypass** (`/products/auth-bypass`): Scrape login-protected pages by injecting session cookies. Works with dashboards, paywalls, and member-only content.
- **Spidra API** (`/products/spidra-api`): One REST API that handles scraping and crawling. Send a URL and a prompt, get structured JSON back. Python and Node.js SDKs available.

## Key Capabilities

- Real headless browser (Playwright) — executes JavaScript, handles SPAs and dynamic rendering
- AI extraction using Google Gemini — natural language prompts, anti-hallucination guardrails
- Automatic CAPTCHA solving — reCAPTCHA v2/v3, hCaptcha, Cloudflare Turnstile, DataDome, and more
- Residential proxy network — 50+ countries, geo-targeted requests
- Session cookie injection — scrape authenticated pages without storing credentials
- Output formats — JSON, Markdown, CSV, Screenshots
- Workflow automation — scheduled scrapes via integrations (Slack, Discord, webhooks)
- Browser actions — click, type, scroll, wait for any sequence of interactions

## Use Cases

- **Lead Generation** (`/use-cases/lead-generation`): Build B2B lead databases from directories, marketplaces, and social profiles. Extract emails, phone numbers, and company data at scale.
- **Market Research** (`/use-cases/market-research`): Monitor competitor pricing, extract reviews, track market trends from any web source.
- Price monitoring across e-commerce platforms
- Dataset building for AI/ML training
- Real estate data extraction
- Academic research and paper scraping

## Pricing

Credit-based model. Credits are consumed per operation:
- Base: 2 credits per URL scraped
- AI extraction tokens: additional usage-based cost
- CAPTCHA solving: 10 credits per solve
- Stealth mode (proxies): 5 credits per URL

**Plans:**
- **Free**: $0/month — 300 credits, 1 concurrent request
- **Starter**: $19/month — 5,000 credits, 3 concurrent requests
- **Builder**: $79/month — 25,000 credits, advanced stealth, workflow builder
- **Pro**: $249/month — 125,000 credits, advanced automation, priority support
- **Enterprise**: Custom — millions of credits, dedicated infrastructure, SLA guarantees

## Company

- **Website**: https://spidra.io
- **Documentation**: https://docs.spidra.io
- **App**: https://app.spidra.io
- **Twitter/X**: @spidra_io
- **Founded**: 2024

## Key Pages

- [Home](https://spidra.io): Platform overview and core features
- [Pricing](https://spidra.io/pricing): Plans and credit-based pricing details
- [Blog](https://spidra.io/blog): Guides, tutorials, and scraping best practices
- [About](https://spidra.io/about): Mission, team, and company story
- [FAQs](https://spidra.io/faqs): Common questions about scraping, pricing, and features
- [Contact](https://spidra.io/contact): Reach the Spidra team
- [Changelog](https://spidra.io/changelog): Latest features and updates

## Technical Details

- API base URL: `https://api.spidra.io/api`
- Authentication: Bearer token (API key)
- SDKs: JavaScript/Node.js (`spidra-js`), Python (coming soon)
- Infrastructure: Node.js backend, Playwright + Crawlee, BullMQ job queues, MySQL, Redis, AWS S3
- Scraping engine: Playwright headless browser + Stagehand AI browser

## Compliance & Security

- All data encrypted in transit (TLS) and at rest
- GDPR compliant — data processing agreements available for enterprise
- CCPA acknowledgment
- Session cookies never stored on servers
- Full privacy policy at https://spidra.io/privacy
- Terms of service at https://spidra.io/terms