What is crawl depth?
Crawl depth is the number of link hops between a page and the place a crawl started. The start page is depth 0, pages it links to are depth 1, pages they link to are depth 2, and so on. A depth limit is the maximum number of hops a crawler will follow, and it is the main control over how far a crawl spreads.
In SEO, the same idea is called click depth: how many clicks it takes a visitor, or Googlebot, to reach a page from the homepage. Pages buried deep tend to be crawled less often and rank less well.
How crawl depth is counted
depth 0 /mens/hoodies (start page)
depth 1 /product/blue-hoodie (linked from the start page)
depth 2 /product/grey-hoodie (linked from blue-hoodie as "related")
depth 3 /brand/acme (linked from grey-hoodie)
Depth is measured from the seed URL, so the same limit means different things depending on where you start. A depth of 2 from a homepage barely reaches the catalogue; from a category page it reaches every product and the pages they link to.
Why depth limits matter
- They bound the crawl. Without a limit, a crawler that follows every link can spread across a large site and far beyond, if external links are allowed.
- They defend against traps. A spider trap is an endlessly deep branch, and a depth limit stops the descent.
- They keep results relevant. Pages close to the start are usually the ones you wanted. Each extra hop adds more pages, most of them further from your goal.
Choosing a depth
| Depth | From a listing page, you get | Good for |
|---|---|---|
| 1 | The items linked from the listing | Collecting every product, job or property in a category |
| 2 | Those items plus everything they link to | Related items, variants, seller or brand pages |
| 3 or more | A rapidly growing slice of the site | Broad discovery with tight URL patterns |
Start shallow. Most data jobs need depth 1 or 2 from a well-chosen start page, and going deeper is only useful with include and exclude patterns that keep the extra pages on topic.
Depth and pagination
Pagination needs special handling. Page 2 of a listing is one hop from page 1, and page 20 is nineteen hops away. If pagination counts toward depth, a limit of 3 stops on page 4 and misses most of the catalogue. Good crawlers treat following a listing's pagination as staying at the same level, so every item in the listing has the same depth.
Crawl depth in SEO
For site owners, important pages should be reachable within about three clicks of the homepage. Ways to reduce depth include linking key categories from the main navigation, adding links between related items, using breadcrumbs, and listing pages in an XML sitemap, which gives crawlers a shortcut that does not depend on clicks.
How Zenrows Crawl uses depth
In Zenrows Crawl, depth counts link steps from the start URL. At depth 1, Crawl returns the links on the start page. At depth 2, it also opens those pages and returns their links, and each further level does the same. To walk more pages of a listing, raise depth and use include patterns to keep only the URLs you want. The Crawl introduction explains how a crawl runs.
Frequently asked questions
What is a good crawl depth?
For most data collection, 1 or 2 from a listing or category page. Larger depths are useful for broad discovery but need URL patterns to stay focused.
What is the difference between crawl depth and click depth?
They measure the same thing from different angles. Crawl depth is counted from wherever a crawl starts; click depth is usually counted from the homepage and used in SEO.
Does crawl depth affect SEO?
Indirectly. Pages many clicks from the homepage are discovered later, crawled less often and receive less internal link value.
Does following pagination increase crawl depth?
In a naive crawler, yes, which is a common reason crawls stop early. A crawler that understands pagination treats every page of a list as the same level.
Go deeper on the blog
In the docs
Last updated: Oct 9, 2026