Skip to main content
Search API

Bring web search to your apps and AI agents

Search websites, news, images, videos, research papers, and GitHub with one API.

Using an AI assistant? Connect Spidra MCP
Try
Sources

One request, six places to look

Ask several sources at once and each runs on its own, so an empty one never fails the rest. Pick one to replay its real run.

A real run, replayed
search…
WebNewsImagesVideosResearchGitHub
Each result hastitleurldescriptionposition
Find, read, extract

Finding the page is
only the beginning

Most search APIs stop at links. Spidra also reads the pages and pulls out the fields you need.

01

Find

Results from six sources, each with a title, link, description and position.

sources: ["web", "news"]

02

Read

Ask for page content and the top results come back as clean Markdown, in the same job.

scrapeOptions

03

Extract

Pull exact fields from any result with a prompt or a JSON schema, or turn a PDF result into data.

ScrapeParse

The request

search_with_pages.py
1found = client.search(
2 "posthog before_send config",
3 sources=["web"],
4 limit=3,
5 scrape_options=SearchScrapeOptions(
6 formats=["markdown"],
7 max_results=3,
8 ),
9)
10
11for r in found.data.web:
12 print(r.title, len(r.markdown or ""))

Pages read

Top 3

set by max_results

Time

About a minute

it waits for every page

Cost

1 credit

per page read

A page that can't be read comes back without Markdown. The other results still arrive.

What came back, one page per result

markdownposthog.com/docs/libraries/js/config
1Copy page
2
3# JavaScript web configuration
4
5#### Contents
6
7* Configuration builder
8* Next steps
9* Customize reverse proxy request paths
10* HTML snippet and script versioning
11* Tracing headers
12* Configuring autocapture
13* Configuring rageclick
14* Configuring logs
15* Advanced configuration
16* Disable /flags endpoint
17* Resources dependent on /flags
18
19When calling `posthog.init`, there are various configuration options you can set to customize and control the behavior of PostHog.
20
21## Configuration builder
22
23Use this interactive builder to generate your `posthog.init` configuration. Select the options you need and copy the generated code.
24
25Where is PostHog hosted?
26
27US CloudEU Cloud
28
29Use recommended defaults
30
31Sets defaults to the latest recommended behaviors
32
33Enable autocapture
34
35Automatically capture clicks, form submissions, and other interactions
36
37Single-page app (SPA)
38
39Detect page changes via history API instead of page loads
40
41Enable session recording
42
43Record user sessions for replay
44
45Project token
46
47Show advanced options
48
49Generated configurationReset
50
51posthog-init.js
52
53PostHog AI
54
55`posthog.init('<ph_project_token>', {
56
57 api_host: 'https://us.i.posthog.com',
58
59})
60
61`
62
63### Next steps
64
651. Copy the generated code and add it to your app where PostHog is initialized.
662. See the [full JavaScript SDK docs](/docs/libraries/js) for more features like identifying users, capturing custom events, and using fea…
67
68You can also use the `posthog.set_config` method to change the configuration after initialization.
69
70TypeScript

The page carries on: 102k characters in all.

Filters

Same search, one option added

Pick an option to see the request and what it really returned.

Filters strictly

Results only from the sites you list. Spidra checks each result before returning it. Use excludeDomains to leave sites out instead.

The request

{
"query": "best mechanical keyboard for programming",
"sources": ["web"],
"limit": 6,
"includeDomains": ["reddit.com"]
}

What it returned

1r/mechanicalkeyboards/reddit.com
2r/buildapc/comments/1b2oluw/mechanical_keyboard_is_a_hype_or_useful/reddit.com
3r/MechanicalKeyboards/comments/183ba43/well_after_trying_most_of_the_popular_stabilizers/reddit.com
4r/MechanicalKeyboards/comments/13mhdfc/whats_your_most_expensive_keyboard_build_so_far/reddit.com
5comments/refj1greddit.com
6r/MechanicalKeyboards/comments/19cbmp3/for_45_this_is_awesome/reddit.com
For AI agents

Let your agent search for itself

In Claude, Cursor or VS Code through MCP, or straight from your own agent's code.

New chat

How can I help you today?

In your assistant

Add one URL and sign in

Paste https://mcp.spidra.io/mcp into Claude, Cursor, VS Code, Codex, Copilot or Windsurf. The session shown here is a real one: Claude searched three times, read the best pages, then wrote the plan.

Connect your assistant

In your own agent

Results in the same call

Send wait: true and a plain search answers directly, so your tool call needs no polling loop. If it runs past about 20 seconds, you get a job ID instead.

POST /search
{
"query": "memory leak is:issue repo:vercel/next.js",
"sources": ["developer"],
"limit": 6,
"wait": true
}
That run:completed6 results3.2 s

What it costs

1 credit per 10 results

Per source, rounded up. Reading the pages behind results adds 1 credit per page.

See plans

Costs nothing

  • A source that finds no results
  • A search that fails
  • Checking a search's status

Limits

  • 1 to 20 results per source
  • 6 sources in one request
  • 60 searches a minute on every plan
FAQ

Questions, answered

Search

100 credits: 1 credit per 10 results, per source. Searching two sources at 10 results each is 2 credits. A source that finds nothing costs nothing, and reading the pages behind results adds 1 credit per page.

You build the product.
Spidra handles the data work.

Start with 300 free credits, about 300 pages. No credit card required.