Once a crawl job is done, all the page content is stored on our end. With the new extract endpoint you can run a fresh AI extraction on those stored pages at any time, just by sending a new instruction.
POST /api/crawl/:jobId/extract
{
"transformInstruction": "Extract only the product name, price, and availability from each page"
}
Spidra fetches the saved markdown for every successful page in that job, runs your instruction through the AI, and creates a new job with the results. You poll the returned jobId the same way you would any regular crawl job.
This is useful when you realise you need different fields from a crawl you already ran, or when you want to reformat structured data without touching the site again. Only AI tokens are billed for extract jobs. There is no base URL charge, no stealth cost, and no CAPTCHA charge.
Read more in the Extract from Crawl docs.
