---
title: "Website content migration"
description: "Website content migration with Crawl: export every page's body, title, meta description, images and URL from a legacy CMS as Markdown or JSON."
canonical: https://www.zenrows.com/use-cases/website-content-migration
updated: 2026-10-18
---

# Website content migration

Website content migration moves every page of an existing site into a new CMS: body copy, headings, metadata, images and the URL structure your redirects depend on. Zenrows Crawl walks the old site and returns each page as Markdown, and Fetch pulls each page's metadata as JSON, giving you an import file instead of weeks of copy and paste.

## Sample output: one page ready for import

```json
{
  "old_url": "https://www.example.com/services/commercial-roofing.aspx",
  "new_path": "/services/commercial-roofing",
  "status": 200,
  "title": "Commercial roofing services | Example Co",
  "meta_description": "Flat and low-slope roof installation and repair for warehouses and offices.",
  "canonical": "https://www.example.com/services/commercial-roofing.aspx",
  "h1": "Commercial roofing",
  "headings": ["Flat roof systems", "Repairs and inspections", "Service area"],
  "body_markdown": "## Flat roof systems\n\nWe install TPO and EPDM membranes on...",
  "word_count": 812,
  "images": [
    { "src": "/media/roof-tpo-install.jpg", "alt": "TPO membrane being installed" }
  ],
  "internal_links": ["/services/roof-repair.aspx", "/contact.aspx"],
  "template": "service-page",
  "crawled_at": "2026-10-17T10:03:51Z"
}
```

Illustrative. Your team adds `new_path` and `template` when mapping; the rest comes from the old site.

## What a migration needs from the old site

Migrations fail on unlisted pages: start with a full inventory, end by checking every old URL landed.

| Job | Data you collect | Typical sources |
|---|---|---|
| Content inventory | Every URL, status, template, word count | A full crawl, compared with sitemap.xml |
| Body content export | Main copy as Markdown with headings, lists, tables, links | WordPress, Drupal, Sitecore, Adobe Experience Manager, custom ASP.NET or PHP |
| SEO metadata capture | Title, meta description, canonical, H1, hreflang, robots | The `<head>` of every page |
| Redirect mapping | Old URL, new URL, status | Crawl inventory joined with the new URL plan |
| Media and file inventory | Image URLs, alt text, PDFs and downloads | `img` and `a` tags on every page |
| Post-launch verification | New URLs, statuses, titles, word counts against the old site | A second crawl after cut-over |

## Why manual content migration breaks

Hand-copying works for twenty pages; past a few hundred, pages vanish, metadata drops and old URLs 404 after launch.

| What breaks | What it looks like | How Zenrows handles it |
|---|---|---|
| No usable export | Tables full of shortcodes and layout markup, or no export | Crawl reads rendered pages: the content visitors see |
| Pages nobody listed | Landing pages outside sitemap and menu, linked only from old posts | Crawl follows every internal link; diff its list against the sitemap |
| JavaScript-rendered content | Tabs, accordions, single-page app routes empty over plain HTTP | Adaptive Stealth Mode renders when a page needs it |
| Header and footer in every body | Navigation, sidebar and footer repeated per page | A CSS selector like `article` or `#main` returns only the content |
| Lost SEO metadata | Titles, descriptions, canonicals vanish; search traffic drops | CSS-selected head fields as JSON per page, ready to map |
| Your own firewall | Cloudflare or a WAF challenges the crawler | Zenrows' stealth gets through Cloudflare and similar, or allowlist the crawl |

## How to run a website content migration

1. **Inventory with Crawl:** start at the homepage with no output format to list every URL, and compare with the sitemap.
2. **Export content as Markdown:** Crawl again with Markdown output, or fetch each URL with a content-container selector.
3. **Capture metadata as JSON:** CSS selectors for title, description, canonical, H1 and images, one row per page.
4. **Map and import:** give each old URL a new path and template, convert the Markdown, and build the redirect map from the same table.
5. **Verify after launch:** crawl the new site, join inventories, fix old URLs with no 301 and pages whose word count dropped.

```bash cURL
curl -X POST "https://api.zenrows.com/v1/crawls" \
  -H "X-API-Key: YOUR_ZENROWS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://www.example.com/",
    "max_items": 5000,
    "exclude_patterns": ["/search", "/cart", "/wp-admin"],
    "output_format": "markdown"
  }'
```

```python Python
# Capture SEO metadata for every URL in the inventory
# pip install requests
import csv, json, requests

EXTRACTOR = {
    "title": "title",
    "description": "meta[name=description] @content",
    "canonical": "link[rel=canonical] @href",
    "h1": "h1",
    "images": "img @src",
}

urls = [line.strip() for line in open("inventory.txt") if line.strip()]
with open("metadata.csv", "w", newline="") as out:
    writer = csv.writer(out)
    writer.writerow(["url", "title", "description", "canonical", "h1", "images"])
    for url in urls:
        data = requests.get("https://api.zenrows.com/v1/", params={
            "apikey": "YOUR_ZENROWS_API_KEY",
            "url": url,
            "mode": "auto",
            "css_extractor": json.dumps(EXTRACTOR),
        }).json()
        writer.writerow([url] + [json.dumps(data.get(k)) for k in EXTRACTOR])
```

```bash CLI
npx -y @zenrows/cli init
zenrows crawl create https://www.example.com/ --max-pages 5000 --output-format markdown --follow
zenrows crawl results CRAWL_ID --out site-export.jsonl
zenrows fetch https://www.example.com/services/commercial-roofing.aspx --output markdown
```

```text Claude Code (MCP)
# Connect once
claude mcp add zenrows -e ZENROWS_API_KEY=YOUR_ZENROWS_API_KEY -- npx -y @zenrows/mcp

# Then ask:
Use Zenrows to crawl www.example.com, then give me a content inventory as a table with each URL, its title, meta description, canonical, H1 and word count, and flag pages that are missing a meta description.
```

## Which Zenrows product fits

| If you need to | Use | Why |
|---|---|---|
| List every URL on the old site | [Crawl](/products/crawl) | Follows internal links; returns the full inventory |
| Export every page body as Markdown | [Crawl](/products/crawl) | Clean Markdown per page in one job |
| Capture titles, descriptions and canonicals per page | [Fetch](/products/fetch) | CSS-selected head fields as JSON |
| Get fields from inconsistent templates | [Extract](/products/extract) | No per-template selectors |
| Spot-check pages from the terminal during mapping | [CLI](/cli) | A page as Markdown in one command, to compare with the new CMS |

## What success looks like

| Measure | What good looks like | How to check it |
|---|---|---|
| URL parity | Each old 200 URL has a new page, a 301 or a deliberate 410 | Join old and new inventories; list unmatched old URLs |
| Redirect accuracy | Each 301 reaches the closest page in one hop | Fetch old URLs after launch; record final URL and hops |
| Content fidelity | New word counts within tolerance of old | Compare per page pair; review the largest drops |
| Metadata retention | Titles, descriptions, canonicals on every page | Re-run the extractor; count empty fields |
| Broken links | No internal link to a 404 | Crawl the new site for internal links with errors |

## Website content migration FAQ

### What is website content migration?

Moving a site's pages, posts, metadata, images and files into a new CMS or platform, alongside design and development; it decides whether the site launches complete. Deliverables: inventory, importable export, redirect map.

### How do I migrate content from one CMS to another?

Crawl the old site, export pages as Markdown or JSON, map old URLs to new paths and templates, and import via the CMS's API or tool. Build redirects from the same table; crawl the new site after launch to confirm nothing is missing.

### How do I keep SEO during a content migration?

Capture title, meta description, canonical, H1 and hreflang before moving anything and carry them over. Keep URLs where you can, 301 changed ones to the closest page, point internal links at final URLs, and compare crawls after launch.

### Can I migrate a site that has no export?

Yes. Crawl reads rendered pages, with no database access or export feature needed: the route for proprietary CMSs, agency sites you lost admin access to, and static sites whose sources are gone.

### How do I find every page on the old site?

Combine the sitemap.xml, a full link-following crawl, and URLs with analytics traffic over the past year. Pages in analytics but not the crawl are often orphaned landing pages needing a decision before launch.

### What belongs on a website migration checklist?

Before launch: URL inventory, content export, metadata, image and file list, mapping table, redirect map. At launch: redirects live, sitemap submitted, internal links final. After: crawl the new site against the old inventory, check 404s and redirect chains, review pages whose word count or metadata changed.

### Does a content migration include images and files?

Collect image URLs with alt text, and linked PDFs or downloads, during the crawl; load them into the new media library and rewrite the Markdown references. Alt text moves with each reference.

### Can I export a website to Markdown?

Yes. Crawl with Markdown output for the whole site, or Fetch for single pages. Markdown keeps headings, lists, links and tables, and most headless CMSs and static site generators import it directly.

## Related use cases

- [Content aggregation](https://www.zenrows.com/use-cases/content-aggregation.md): Articles, events, deals and listings from hundreds of websites, mapped to one schema and kept fresh.
- [Website change monitoring](https://www.zenrows.com/use-cases/website-change-monitoring.md): Pricing pages, policies, stock status and IR pages fetched on a schedule and diffed to catch real changes.
- [LLM web scraping for RAG and agents](https://www.zenrows.com/use-cases/llm-web-scraping.md): Live pages as Markdown or JSON for RAG pipelines, grounding and agent tool calls.
- [Product data scraping](https://www.zenrows.com/use-cases/product-data-scraping.md): Whole product catalogs, variants, specs, images and sellers from marketplaces, normalized into one feed.
- [AI training data](https://www.zenrows.com/use-cases/ai-training-data.md): Web corpora for pre-training and fine-tuning, collected as Markdown JSONL with a source URL on every document.

Start free: https://app.zenrows.com/register. Docs: https://docs.zenrows.com

## Structured data



<script type="application/ld+json">
{"@context":"https://schema.org","@graph":[{"@type":"WebPage","@id":"https://www.zenrows.com/use-cases/website-content-migration#webpage","url":"https://www.zenrows.com/use-cases/website-content-migration","name":"Website content migration","description":"Website content migration with Crawl: export every page's body, title, meta description, images and URL from a legacy CMS as Markdown or JSON.","isPartOf":{"@id":"https://www.zenrows.com/#website"},"inLanguage":"en","datePublished":"2026-10-18","dateModified":"2026-10-18","about":{"@type":"Thing","name":"website content migration"},"keywords":"website content migration, content migration, web content migration, cms migration, migrate website content, content inventory, export website to markdown, website migration checklist","publisher":{"@type":"Organization","name":"Zenrows","url":"https://www.zenrows.com/"}},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://www.zenrows.com/"},{"@type":"ListItem","position":2,"name":"Use cases","item":"https://www.zenrows.com/use-cases"},{"@type":"ListItem","position":3,"name":"Website content migration","item":"https://www.zenrows.com/use-cases/website-content-migration"}]},{"@type":"FAQPage","@id":"https://www.zenrows.com/use-cases/website-content-migration#faq","mainEntity":[{"@type":"Question","name":"What is website content migration?","acceptedAnswer":{"@type":"Answer","text":"Moving a site's pages, posts, metadata, images and files into a new CMS or platform, alongside design and development; it decides whether the site launches complete. Deliverables: inventory, importable export, redirect map."}},{"@type":"Question","name":"How do I migrate content from one CMS to another?","acceptedAnswer":{"@type":"Answer","text":"Crawl the old site, export pages as Markdown or JSON, map old URLs to new paths and templates, and import via the CMS's API or tool. Build redirects from the same table; crawl the new site after launch to confirm nothing is missing."}},{"@type":"Question","name":"How do I keep SEO during a content migration?","acceptedAnswer":{"@type":"Answer","text":"Capture title, meta description, canonical, H1 and hreflang before moving anything and carry them over. Keep URLs where you can, 301 changed ones to the closest page, point internal links at final URLs, and compare crawls after launch."}},{"@type":"Question","name":"Can I migrate a site that has no export?","acceptedAnswer":{"@type":"Answer","text":"Yes. Crawl reads rendered pages, with no database access or export feature needed: the route for proprietary CMSs, agency sites you lost admin access to, and static sites whose sources are gone."}},{"@type":"Question","name":"How do I find every page on the old site?","acceptedAnswer":{"@type":"Answer","text":"Combine the sitemap.xml, a full link-following crawl, and URLs with analytics traffic over the past year. Pages in analytics but not the crawl are often orphaned landing pages needing a decision before launch."}},{"@type":"Question","name":"What belongs on a website migration checklist?","acceptedAnswer":{"@type":"Answer","text":"Before launch: URL inventory, content export, metadata, image and file list, mapping table, redirect map. At launch: redirects live, sitemap submitted, internal links final. After: crawl the new site against the old inventory, check 404s and redirect chains, review pages whose word count or metadata changed."}},{"@type":"Question","name":"Does a content migration include images and files?","acceptedAnswer":{"@type":"Answer","text":"Collect image URLs with alt text, and linked PDFs or downloads, during the crawl; load them into the new media library and rewrite the Markdown references. Alt text moves with each reference."}},{"@type":"Question","name":"Can I export a website to Markdown?","acceptedAnswer":{"@type":"Answer","text":"Yes. Crawl with Markdown output for the whole site, or Fetch for single pages. Markdown keeps headings, lists, links and tables, and most headless CMSs and static site generators import it directly."}}]}]}
</script>
