---
title: "Competitor price scraping"
description: "Price scraping for competitor price monitoring: selling price, promotions, shipping and stock from Amazon, Walmart, Target and grocery sites, as JSON."
canonical: https://www.zenrows.com/use-cases/price-scraping
updated: 2026-10-18
---

# Competitor price scraping

Price scraping is the automated collection of competitor prices from online stores and marketplaces: selling price, list price, promotion, shipping and stock for every product you track. Zenrows fetches those pages from protected retail sites, returns the fields as JSON, and refreshes your SKU list on a schedule with Batch.

## Sample output: one competitor price point

```json
{
  "your_sku": "AUR-JKT-M-BLK",
  "competitor": "example-outdoor.com",
  "url": "https://www.example-outdoor.com/p/aurora-rider-jacket",
  "price": 119.0,
  "list_price": 149.0,
  "currency": "USD",
  "promotion": "20% off with code FALL20",
  "shipping": 0.0,
  "delivered_price": 119.0,
  "in_stock": true,
  "country": "us",
  "captured_at": "2026-10-17T06:00:00Z",
  "previous": { "price": 129.0, "captured_at": "2026-10-16T06:00:00Z" },
  "change": -10.0
}
```

Illustrative. Fields come from your CSS selectors; `previous` and `change` from diffing with the last run.

## What price monitoring teams collect

Start from your products and the competitor URLs that sell them. Then choose how often to read them and which fields to keep.

| Job | Data you collect | Typical sources |
|---|---|---|
| Competitor price tracking | Selling and list price per SKU | Amazon, Walmart, Target, Best Buy, Home Depot |
| Promotion and markdown tracking | Sale badges, coupons, bundles, dates | Product and deal pages, Amazon Today's Deals |
| Delivered price | Shipping fee, free-shipping threshold, delivery date | Product and cart pages |
| Marketplace offers | Lowest offer, seller count, featured seller | Amazon, Walmart Marketplace, eBay, Mercado Livre |
| Regional and country pricing | Local price and currency | MediaMarkt, Carrefour, Allegro, Flipkart, Amazon country sites |
| Grocery price tracking | Shelf and unit price per store or postcode | Tesco, Sainsbury's, Carrefour, Woolworths, Instacart |
| Price history | Every price, timestamped | Your past runs |

## Why price scraping breaks

Retailers protect prices hardest and change them most. Failures are quiet: a 200 with the price missing, stale or from the wrong market.

| What breaks | What it looks like | How Zenrows handles it |
|---|---|---|
| Bot protection on large retailers | A CAPTCHA inside a 200, or 403s after a few hundred requests | Zenrows' stealth gets through AWS WAF, PerimeterX (HUMAN) and Akamai |
| Price rendered after load | Empty or placeholder price in the raw HTML | Adaptive Stealth Mode renders the page only when the price needs it |
| Price served by an internal API | Price and stock load from a JSON endpoint | Zenrows captures the XHR calls; read the price from the response |
| Wrong market | The US price or currency when you track the UK store | Geotargeting requests from the country you price |
| Store or postcode pricing | A price from another store than your customer's | Set the store per task, by cookie or Browser session |
| Sale price versus list price | The struck-through price instead of the selling one | One CSS selector per field keeps `price` and `list_price` apart |

## How to scrape competitor prices with Zenrows

1. **Match SKUs to competitor URLs**, by GTIN or model number where shown.
2. **Name the fields per retailer**: `price`, `list_price`, `promotion`, `shipping`, `stock`.
3. **Test 20 URLs per retailer** with Adaptive Stealth Mode and check every field comes back.
4. **Schedule the full list in Batch**, daily or hourly, and store each run to diff.

```python Python
# pip install requests
import json
import requests

# Example selectors: write one set per competitor site
fields = {
    "price": ".product-price .sale",
    "list_price": ".product-price .was",
    "promotion": ".promo-badge",
    "shipping": ".shipping-cost",
    "stock": ".availability",
}
params = {
    "apikey": "YOUR_ZENROWS_API_KEY",
    "url": "COMPETITOR_PRODUCT_URL",
    "mode": "auto",
    "proxy_country": "gb",
    "css_extractor": json.dumps(fields),
}
response = requests.get("https://api.zenrows.com/v1/", params=params)
print(response.json())  # {"price": "£119.00", "list_price": "£149.00", ...}
```

```bash cURL
curl -X POST "https://async.api.zenrows.com/v1/jobs" \
  -H "X-API-Key: YOUR_ZENROWS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "type": "regular",
    "status": "closed",
    "zenrows_params": {
      "mode": "auto",
      "css_extractor": "{\"price\":\".product-price .sale\",\"stock\":\".availability\"}"
    },
    "tasks": [
      { "url": "COMPETITOR_URL_1", "external_id": "AUR-JKT-M-BLK" },
      { "url": "COMPETITOR_URL_2", "external_id": "AUR-JKT-L-BLK" }
    ]
  }'
```

```bash CLI
npx -y @zenrows/cli init
zenrows extract COMPETITOR_PRODUCT_URL --proxy-country gb \
  --css '{"price":".product-price .sale","list_price":".product-price .was","stock":".availability"}'
# skus.jsonl: one {"url": "...", "external_id": "YOUR_SKU"} per line
zenrows batch create skus.jsonl --wait
zenrows batch results <job-id> --out prices-today.jsonl
```

```text Claude Code (MCP)
# Connect once
claude mcp add zenrows -e ZENROWS_API_KEY=YOUR_ZENROWS_API_KEY -- npx -y @zenrows/mcp

# Then ask:
Use Zenrows to check the price, list price and stock of this jacket on John Lewis,
Next and ASOS (URLs below), and give me a table sorted by price, with the
difference against our price of £129.
```

## Which Zenrows product fits

| If you need to | Use | Why |
|---|---|---|
| Check one price on demand | [Fetch](/products/fetch) | One request, the page or the price fields |
| Read many store layouts without selectors | [Extract](/products/extract) | Price, stock and product fields as JSON |
| Refresh thousands of SKUs daily | [Batch](/products/batch) | One job; `external_id` carries your SKU |
| Get a price behind a postcode or size choice | [Browser](/products/browser) | Playwright or Puppeteer in a real browser |
| Let an analyst ask for a price check | [MCP Server](/mcp) | Claude calls Zenrows and returns a table |

## What success looks like

| Measure | What good looks like | How to check it |
|---|---|---|
| Match rate | Every SKU matched at every competitor that sells it | SKUs with a live URL, per competitor |
| Price accuracy | The price a local shopper sees | Weekly spot-check from that country |
| Freshness | No price older than one cycle | Alert on a stale `captured_at` |
| Field completeness | A price on nearly every record | Empty `price` rate, per retailer and run |
| Change detection | Drops and promotions flagged within one cycle | Alert time against capture time |
| Run duration | The refresh done before the team starts | Start and end time of each Batch job |

## Price scraping and monitoring FAQ

### What is price scraping?

The automated collection of prices from websites. Retail teams read competitor product pages on a schedule and keep price, promotion, shipping and stock per product, building a price history that feeds pricing decisions.

### Should I use a price monitoring tool or a price scraping API?

A tool gives dashboards and matching for the retailers it supports. An API gives raw prices from any retailer, at your cadence, in your warehouse. Teams with a data engineer build on an API; teams that want a screen buy a tool.

### How often should I scrape competitor prices?

As often as prices move: daily for most categories, every few hours for electronics, marketplaces and grocery promotions. Before Black Friday, raise it for top sellers only.

### How do I match my products to competitor product pages?

By GTIN, UPC, EAN or part number where the page shows one; otherwise by brand and model, checked by hand for top sellers. See product matching .

### Can I scrape prices from Amazon and Walmart?

Yes, through Adaptive Stealth Mode, with geotargeting per marketplace country. For offers, read the offer listing too: the featured price can change seller daily.

### What is price intelligence?

The analysis on top of scraped prices: your price index per competitor, where you are cheapest, promotion depth, and how fast rivals follow you. Scraping supplies the observations; matching and history make it intelligence.

### Can I track grocery prices by store or postcode?

Yes. Price your basket in each competitor store facing your branches, one Batch task per store with its ID in external_id , for a gap per trade area. See retail data .

### Is price scraping legal?

Collecting public prices is common practice in retail. Review each site's terms, keep request rates reasonable, collect product data only, and check your case with your legal team.

## Related use cases

- [MAP monitoring](https://www.zenrows.com/use-cases/map-monitoring.md): Advertised prices and sellers across marketplaces and resellers, with screenshot evidence of every MAP violation.
- [Dynamic pricing data](https://www.zenrows.com/use-cases/dynamic-pricing.md): Live competitor price, stock and demand inputs for a repricing engine, on demand or on a schedule.
- [Web scraping for price comparison](https://www.zenrows.com/use-cases/web-scraping-for-price-comparison.md): Merchant offers, prices, shipping and identifiers for comparison sites and apps, from catalogs without a feed.
- [Product matching](https://www.zenrows.com/use-cases/product-matching.md): GTINs, model numbers, pack sizes and specs from every retailer, so one product resolves to one record.
- [Ecommerce web scraping](https://www.zenrows.com/use-cases/ecommerce-web-scraping.md): Product, price, stock, review and seller data from Amazon, Walmart, eBay and Shopify stores, as JSON.
- [Competitor monitoring](https://www.zenrows.com/use-cases/competitor-monitoring.md): Pricing pages, changelogs, feature pages and job posts on rival sites, snapshotted and diffed on every run.

Start free: https://app.zenrows.com/register. Docs: https://docs.zenrows.com

## Structured data



<script type="application/ld+json">
{"@context":"https://schema.org","@graph":[{"@type":"WebPage","@id":"https://www.zenrows.com/use-cases/price-scraping#webpage","url":"https://www.zenrows.com/use-cases/price-scraping","name":"Competitor price scraping","description":"Price scraping for competitor price monitoring: selling price, promotions, shipping and stock from Amazon, Walmart, Target and grocery sites, as JSON.","isPartOf":{"@id":"https://www.zenrows.com/#website"},"inLanguage":"en","datePublished":"2026-10-18","dateModified":"2026-10-18","about":{"@type":"Thing","name":"price scraping"},"keywords":"price scraping, price monitoring, competitor price monitoring, competitor price tracking, price scraper, price intelligence, price monitoring api, price scraping tools, ecommerce price scraping, grocery price tracker, competitive price monitoring","publisher":{"@type":"Organization","name":"Zenrows","url":"https://www.zenrows.com/"}},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://www.zenrows.com/"},{"@type":"ListItem","position":2,"name":"Use cases","item":"https://www.zenrows.com/use-cases"},{"@type":"ListItem","position":3,"name":"Competitor price scraping","item":"https://www.zenrows.com/use-cases/price-scraping"}]},{"@type":"FAQPage","@id":"https://www.zenrows.com/use-cases/price-scraping#faq","mainEntity":[{"@type":"Question","name":"What is price scraping?","acceptedAnswer":{"@type":"Answer","text":"The automated collection of prices from websites. Retail teams read competitor product pages on a schedule and keep price, promotion, shipping and stock per product, building a price history that feeds pricing decisions."}},{"@type":"Question","name":"Should I use a price monitoring tool or a price scraping API?","acceptedAnswer":{"@type":"Answer","text":"A tool gives dashboards and matching for the retailers it supports. An API gives raw prices from any retailer, at your cadence, in your warehouse. Teams with a data engineer build on an API; teams that want a screen buy a tool."}},{"@type":"Question","name":"How often should I scrape competitor prices?","acceptedAnswer":{"@type":"Answer","text":"As often as prices move: daily for most categories, every few hours for electronics, marketplaces and grocery promotions. Before Black Friday, raise it for top sellers only."}},{"@type":"Question","name":"How do I match my products to competitor product pages?","acceptedAnswer":{"@type":"Answer","text":"By GTIN, UPC, EAN or part number where the page shows one; otherwise by brand and model, checked by hand for top sellers. See product matching ."}},{"@type":"Question","name":"Can I scrape prices from Amazon and Walmart?","acceptedAnswer":{"@type":"Answer","text":"Yes, through Adaptive Stealth Mode, with geotargeting per marketplace country. For offers, read the offer listing too: the featured price can change seller daily."}},{"@type":"Question","name":"What is price intelligence?","acceptedAnswer":{"@type":"Answer","text":"The analysis on top of scraped prices: your price index per competitor, where you are cheapest, promotion depth, and how fast rivals follow you. Scraping supplies the observations; matching and history make it intelligence."}},{"@type":"Question","name":"Can I track grocery prices by store or postcode?","acceptedAnswer":{"@type":"Answer","text":"Yes. Price your basket in each competitor store facing your branches, one Batch task per store with its ID in external_id , for a gap per trade area. See retail data ."}},{"@type":"Question","name":"Is price scraping legal?","acceptedAnswer":{"@type":"Answer","text":"Collecting public prices is common practice in retail. Review each site's terms, keep request rates reasonable, collect product data only, and check your case with your legal team."}}]}]}
</script>
