Datasets

Every successful job stores its output as a dataset. Datasets are private to the user who collected them by default, and can be shared with the rest of the user's company.

Download a job's output directly

The fastest path: download the job's export file.

curl "$NEXQDATA_API/api/scraper-agents/jobs/$JOB_ID/export" \
  -H "X-Api-Key: $NEXQDATA_API_KEY" -o results.csv

The file comes in the format the agent is set up to export — for example CSV, JSON, or Excel. A job that ran in several sessions downloads as one combined zip.

For one run's data only, use GET /api/scraper-agents/runs/{runId}/export.

Open a job as a dataset

To preview or query the data before downloading it, get the job's dataset id:

The response's data.datasetId is what the endpoints below take. For one run, use GET /api/scraper-agents/runs/{runId}/dataset. To find datasets you already have, list them.

Preview

Returns columns, the first rows, and whether the preview was truncated.

Query

Search, filter, sort, and page through a dataset without downloading it.

{
  "search": "Doe",
  "filters": [
    { "column": "status", "operator": "equals", "value": "Open" }
  ],
  "sortColumn": "filed",
  "sortDirection": "desc",
  "page": 1,
  "pageSize": 50
}

Text comparisons ignore case. pageSize defaults to 50, up to 200. The response adds totalMatches, page, and pageSize.

Download

When data isn't available

Retention is set per company or per user; when it lapses, the file is removed but the record that the job produced data is kept.