# Spidra

Spidra is an AI-powered web scraping and crawling platform that turns websites into structured data. It is built for developers, AI agents, data teams, researchers, and businesses that need reliable web data without maintaining scraping infrastructure.

## Primary URLs

- Website: https://spidra.io
- App: https://app.spidra.io
- Documentation: https://docs.spidra.io
- Documentation index: https://docs.spidra.io/llms.txt
- API reference: https://docs.spidra.io/api-reference/introduction
- Blog: https://spidra.io/blog
- Changelog: https://spidra.io/changelog
- Pricing: https://spidra.io/pricing
- Contact: https://spidra.io/contact

## What Spidra Does

Spidra launches a real headless browser, executes JavaScript, handles dynamic pages, solves CAPTCHAs, rotates proxies, follows browser actions, and extracts clean structured output from websites. Users can describe the data they want in plain English or use API-level controls for advanced workflows.

## Core Products

- AI Scraper: Extract structured data from individual pages using natural language prompts, actions, selectors, and output formats such as JSON or Markdown.
- AI Crawler: Discover and crawl relevant pages across a domain, then transform the crawled content into structured data.
- Spidra API: Programmatic scraping and crawling through a REST API and SDKs.
- CAPTCHA Solver: Automated CAPTCHA and anti-bot challenge handling.
- Proxy Scraping: Residential proxy rotation and stealth scraping infrastructure.
- Auth Bypass: Scrape authenticated pages by passing session cookies.

## Common Use Cases

- Lead generation from directories, marketplaces, events, and business listings.
- Market research from reviews, competitor pages, pricing pages, communities, and public datasets.
- Data enrichment by following links from source pages to detail pages and extracting additional fields.
- AI training data collection from web pages, articles, docs, and product catalogs.
- Scheduled monitoring for price changes, job listings, inventory, funding announcements, or competitor changes.
- Custom scraping workflows using browser actions and API integrations.

## Key Capabilities

- JavaScript rendering with a real browser.
- AI extraction from plain-English prompts.
- Browser actions such as click, type, scroll, wait, and navigation.
- CAPTCHA solving and stealth mode.
- Proxy rotation and geo-targeting.
- Session cookie support for authenticated scraping.
- JSON, Markdown, CSV, and screenshot outputs.
- Batch scraping and crawling.
- Saved presets and scheduled integrations.
- Delivery to Slack, Discord, email, Telegram, webhooks, and other workflow destinations.

## API Basics

- API base URL: `https://api.spidra.io/api`
- Authentication: API key
- Documentation: https://docs.spidra.io/api-reference/introduction
- Node SDK docs: https://docs.spidra.io/sdks/node
- Python SDK docs: https://docs.spidra.io/sdks/python
- Go SDK docs: https://docs.spidra.io/sdks/go
- n8n docs: https://docs.spidra.io/sdks/n8n

## Pricing Summary

Spidra uses credit-based pricing. Plans include Free, Starter, Builder, Pro, and Enterprise tiers. See https://spidra.io/pricing for current credit allowances, proxy bandwidth, concurrency limits, integrations, and support options.

## Company

Spidra, Inc. is a Delaware C Corporation incorporated in the United States. Website: https://spidra.io. Contact: https://spidra.io/contact. About: https://spidra.io/about.

## Compliance and Safety

Spidra is a scraping infrastructure provider. Users are responsible for respecting website terms, robots.txt, rate limits, privacy laws, copyright rules, and applicable regulations. For authenticated pages, use session cookies instead of passwords. Privacy policy: https://spidra.io/privacy. Terms: https://spidra.io/terms.