You can now search the web, news, images, videos, academic research, and GitHub issues and pull requests directly from Spidra. Search is available from the dashboard, API, Node.js and Python SDKs, and through the Spidra MCP server.
A normal search returns structured results with the URL, title, description, and metadata available for that source.
const result = await spidra.search({
query: "best things to do in Cape Town in 2026",
sources: ["web"],
});
You can narrow results by domain, country, time range, or file type, and paginate when you need to go beyond the first set of results.
Search and get the page content too
Sometimes finding the right page is only the first step.
Add scrapeOptions and Spidra will fetch the top results and return their cleaned content alongside the search results.
const result = await spidra.search({
query: "latest developments in browser automation",
sources: ["web"],
scrapeOptions: {
formats: ["markdown"],
maxResults: 5,
},
});
This means you don’t need to search first, collect the URLs, and then build a separate scraping workflow for each result.
Search also works with the rest of Spidra. Once you find a useful result, you can scrape the page, crawl the site, interact with it using browser actions, or extract the exact data you need.
For AI agents, Search is available through Spidra MCP, so Claude, Cursor, VS Code, and other MCP clients can find pages themselves instead of requiring a URL upfront.
Search is available now.
