---
title: "Batch"
description: "Open queue for scraping at scale. Push URLs as they come in, scale workers to match, pull results when the job completes. Regular one-off jobs as a constrained variant."
---
# Batch

> Open queue for scraping at scale. Push URLs as they come in, scale workers to match, pull results when the job completes. Regular one-off jobs as a constrained variant.

## Run large web data jobs reliably .

Process up to 100,000 URLs per job, asynchronously, protected and dynamic pages included, with queues, retries, per-job webhooks, and job observability built in.

What you'd ship without Batch

- Worker pool Spin up, tear down, limit concurrency per domain

- Backoff logic Handle 429s, add jitter, respect crawl delays

- Retry queue Catch transient failures, back off and retry

- Webhook layer Fire on completion, sign payloads, handle drops

- Progress API Track active, delivered, and failed in real time

workers 0 32

## Push more. Workers follow.

Workers spin up when the queue grows. They idle out when it drains. Add up to 10,000 URLs per call, as many calls as it takes to fill the job's 100,000-URL cap.

## Everything else comes with it.

One signed webhook on completion. Retries on transient failure. Failed tasks stay visible. Live status endpoint. No glue code.

## 100,000 URLs a job. As many as needed.

Same workers. Same JSON contract per URL. Up to three active jobs per account (shared with Crawl).

## Or just a list.

One URL per JSONL line. Estimating needs no key. Running uses the same API key as Fetch. The CLI's local safety policy caps how many URLs and estimated credits one run can submit, and stops a bigger run before it is sent; raise the caps with zenrows policy set.

```
{"url":"https://www.scrapingcourse.com/ecommerce/product/abominable-hoodie/"}
{"url":"https://www.scrapingcourse.com/ecommerce/product/adrienne-trek-jacket/"}
{"url":"https://www.scrapingcourse.com/ecommerce/product/aeon-capri/"}
```

```
$ npx -y @zenrows/cli batch estimate jobs.jsonl
valid jobs: 3/3
estimated credits, upper bound: 75
✓ Spec is valid.

$ npx -y @zenrows/cli batch create jobs.jsonl \
    --output markdown --follow
✓ Submitted job · status: completed
  3/3 completed · 3 successful · 0 failed
```

## Push it. We drain it.

A free plan with 5,000 credits every month.

_Canonical HTML: https://www.zenrows.com/products/batch_

## Site Navigation

### Global Hub
- [Home](https://www.zenrows.com/index.md)
- [Pricing](https://www.zenrows.com/pricing.md)
- [Products](https://www.zenrows.com/products.md)
- [Agent Toolkit](https://www.zenrows.com/agents.md)
- [Compare](https://www.zenrows.com/compare.md)
- [Alternatives](https://www.zenrows.com/alternatives.md)
- [Blog](https://www.zenrows.com/blog)
- [Docs](https://docs.zenrows.com)
- [llms.txt](https://www.zenrows.com/llms.txt)
- [Agent skill](https://www.zenrows.com/SKILL.md)

### On This Topic
- [Products overview](https://www.zenrows.com/products.md)
- [Fetch](https://www.zenrows.com/products/fetch.md)
- [Browser](https://www.zenrows.com/products/browser.md)
- [Extract](https://www.zenrows.com/products/extract.md)
- [Crawl](https://www.zenrows.com/products/crawl.md)
- [Search](https://www.zenrows.com/products/search.md)
- [Monitor](https://www.zenrows.com/products/monitor.md)
- [API](https://www.zenrows.com/api.md)
- [SDK](https://www.zenrows.com/sdk.md)
- [MCP Server](https://www.zenrows.com/mcp.md)
- [CLI](https://www.zenrows.com/cli.md)

## Structured data



<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://www.zenrows.com/"},{"@type":"ListItem","position":2,"name":"Products","item":"https://www.zenrows.com/products"},{"@type":"ListItem","position":3,"name":"Batch","item":"https://www.zenrows.com/products/batch"}]}
</script>

<script type="application/ld+json">
{"@context":"https://schema.org","@type":"SoftwareApplication","name":"Zenrows Batch","alternateName":"Batch by Zenrows","softwareVersion":"1.0","applicationCategory":"DeveloperApplication","applicationSubCategory":"Batch scraping API","operatingSystem":"Web","url":"https://www.zenrows.com/products/batch","softwareHelp":{"@type":"CreativeWork","url":"https://docs.zenrows.com/batch/introduction"},"provider":{"@type":"Organization","name":"Zenrows","url":"https://www.zenrows.com"},"description":"Batch is a batch scraping API: submit up to 100,000 URLs as one managed job and get per-URL results, status, and failure accounting back. It queues and paces requests, retries transient failures automatically, and supports failed-only reruns that keep successful results. There is no SLA.","featureList":["Up to 100,000 URLs per job; up to 10,000 URLs per add-tasks call on open jobs","Per-URL final status with the real HTTP code and structured error codes","Automatic retries of transient failures","Failed-only reruns that keep successful results","Pause, resume, or stop a run","Scheduling: one-shot, interval, or calendar, timezone-aware with IANA names","Completion webhooks (a notification; results are fetched from the results endpoint), with optional HMAC signing","CSV upload up to 50 MB or 100,000 rows","GET and POST target fetches, mixable in one job; POST bodies stored verbatim up to 16 KiB","Multi-domain jobs with per-URL parameter overrides","Output formats: HTML, JSON, Markdown, plain text, PDF","Cost estimation before submit; per-run consumption after","Results retained 14 days; download links valid 2 hours"],"offers":{"@type":"Offer","description":"no charge on top of the requests it runs. Billed in credits per successful request at the same pass-through rates as Fetch; only successful requests are charged, and a target that answers counts as successful for billing, including a 404 or 410. The free plan is 5,000 credits every month, no credit card required.","availability":"https://schema.org/OnlineOnly","url":"https://www.zenrows.com/pricing"},"dateModified":"2026-09-17"}
</script>
