Web Scraping Blog

Learn how to render JavaScript with Scrapy. Check out the best middlewares for that and compare them easily.

Learn how to use Goquery for data parsing in Golang in this step-by-step tutorial.

Learn how to use Scrapy Splash to render dynamic content and pages, as well as avoid getting blocked while web scraping.

Learn how to use Chromedp, one of the most popular headless browsers in Golang to render JavaScript content and pages and interact with them.

Find the best methods to retry Axios requests that failed, learn how to create the retry logic, and implement the best practices.

Create a powerful scraper with Puppeteer with this step-by-step tutorial and do headless browser web scraping.

Discover the real cost of web scraping projects: the different models for data extraction and what factors influence the price.

Compare the popular tools Scrapy vs. Puppeteer for web scraping. Get a clear overview, pros and cons, and understand which one you should choose.

Implement Puppeteer Extra to unlock new headless browsing capabilities to avoid getting blocked while web scraping and for other purposes.

Supercharge your Selenium headless browser with undetected_chromedriver, a complement to avoid getting blocked while web scraping.

Learn how to solve error 403, the most common issue when web scraping a website. Effective and quick solutions inside.

Find out the most effective ways to bypass Sucuri and scrape the website you want in this guide.

Discover how to use superagent-proxy in NodeJS for undetectable web scraping. This guide covers setup and proxy rotation.

Find the best methods to retry failed Python Requests if failed, learn how to create the retry logic, and implement the best practices.

Get inspired by popular web scraping project ideas to gain experience and even build a business around data extraction.

Discover the real Selenium cost: it's free to download but has hidden expenses. Learn how to reduce them and also explore cost-effective alternatives.