Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.scrapellm.com/llms.txt

Use this file to discover all available pages before exploring further.

Poll the status of an async scrape job submitted via POST /scrapers/{scraper}/jobs. Returns the full scrape result when the job is complete. No authentication required — the job_id is an unguessable UUID v4.

Endpoint

GET https://api.scrapellm.com/jobs/{job_id}

Parameters

job_id
string
required
The UUID returned by POST /scrapers/{scraper}/jobs.

Status values

StatusDescription
pendingJob is queued — the scrape has not completed yet
doneScrape succeeded — result contains the full response
failedAll retry attempts failed — error contains the reason

Example request

curl "https://api.scrapellm.com/jobs/3f7a2b1c-9e4d-4f8a-b2c1-7d6e5f4a3b2c"

Response

Pending

{
  "job_id": "3f7a2b1c-9e4d-4f8a-b2c1-7d6e5f4a3b2c",
  "status": "pending",
  "scraper": "chatgpt",
  "prompt": "What brands do marketers recommend for email automation?",
  "country": "US",
  "created_at": "2026-05-11T12:00:00+00:00"
}

Done

{
  "job_id": "3f7a2b1c-9e4d-4f8a-b2c1-7d6e5f4a3b2c",
  "status": "done",
  "scraper": "chatgpt",
  "prompt": "What brands do marketers recommend for email automation?",
  "country": "US",
  "result": {
    "scraper": "chatgpt",
    "status": "done",
    "result": "Marketers commonly recommend Mailchimp, HubSpot, and Klaviyo...",
    "links": [...],
    "search_queries": [...],
    "credits_used": 3,
    "elapsed_ms": 8243.5,
    "cached": false
  },
  "created_at": "2026-05-11T12:00:00+00:00",
  "completed_at": "2026-05-11T12:00:18+00:00"
}

Failed

{
  "job_id": "3f7a2b1c-9e4d-4f8a-b2c1-7d6e5f4a3b2c",
  "status": "failed",
  "scraper": "chatgpt",
  "error": "execution failed",
  "created_at": "2026-05-11T12:00:00+00:00",
  "completed_at": "2026-05-11T12:01:45+00:00"
}

Response fields

job_id
string
The unique job identifier.
status
string
Current state: pending, done, or failed.
scraper
string
The scraper that processed this job.
result
object
Full scrape response. Present only when status is "done". Schema matches the sync endpoint response for the same scraper.
error
string
Error message. Present only when status is "failed".
created_at
string
ISO 8601 UTC timestamp when the job was submitted.
completed_at
string
ISO 8601 UTC timestamp when the job finished (done or failed). Null while pending.

Job retention

Jobs are retained for 24 hours after creation. After that, the job ID returns HTTP 404.

Error codes

StatusMeaning
404Job not found or expired (jobs are retained for 24 hours)