Web Scraping Blog

Scrapy Playwright: Complete Tutorial 2025

Learn how to use Scrapy with Playwright so that you can render dynamic content and pages. Also, that'll help you avoid getting blocked while web scraping.

September 18, 2023 · 11 min read

Scrapy Selenium: Complete Tutorial 2025

Implement Scrapy Selenium to render JavaScript-based content and pages and avoid getting blocked while web scraping.

September 11, 2023 · 12 min read

Render JavaScript with Scrapy: 5 Best Middlewares

Learn how to render JavaScript with Scrapy. Check out the best middlewares for that and compare them easily.

September 6, 2023 · 9 min read

Goquery for Data Parsing: Complete Tutorial 2025

Learn how to use Goquery for data parsing in Golang in this step-by-step tutorial.

May 31, 2024 · 9 min read

Scrapy Splash: Tutorial to Render JavaScript in Python [2025]

Learn how to use Scrapy Splash to render dynamic content and pages, as well as avoid getting blocked while web scraping.

August 30, 2023 · 2 min read

Chromedp: Golang Headless Browser Tutorial 2025

Learn how to use Chromedp, one of the most popular headless browsers in Golang to render JavaScript content and pages and interact with them.

August 28, 2023 · 9 min read

Axios: Retry Failed Requests [2025]

Find the best methods to retry Axios requests that failed, learn how to create the retry logic, and implement the best practices.

August 25, 2023 · 8 min read

How to do Web Scraping with Puppeteer and NodeJS

Create a powerful scraper with Puppeteer with this step-by-step tutorial and do headless browser web scraping.

August 23, 2023 · 13 min read

How Much Does Web Scraping Cost?

Discover the real cost of web scraping projects: the different models for data extraction and what factors influence the price.

August 23, 2023 · 6 min read

Scrapy vs Puppeteer: Which One to Choose?

Compare the popular tools Scrapy vs. Puppeteer for web scraping. Get a clear overview, pros and cons, and understand which one you should choose.

August 22, 2023 · 5 min read

Puppeteer Extra: Comprehensive Tutorial 2025

Implement Puppeteer Extra to unlock new headless browsing capabilities to avoid getting blocked while web scraping and for other purposes.

August 18, 2023 · 4 min read

Undetected ChromeDriver in Python Selenium: How to Use for Web Scraping

Supercharge your Selenium headless browser with Undetected ChromeDriver, a popular tool to avoid getting blocked while web scraping.

August 26, 2024 · 8 min read

Error 403 in Web Scraping: 7 Easy Solutions

Learn how to fix Error 403 in web scraping with seven easy techniques to bypass restrictions and continue extracting data efficiently.

Idowu Omisola

September 26, 2024 · 7 min read

How to Bypass Sucuri in 2025

Find out the most effective ways to bypass Sucuri and scrape the website you want in this guide.

August 11, 2023 · 7 min read

How to Use Superagent-Proxy

Discover how to use superagent-proxy in NodeJS for undetectable web scraping. This guide covers setup and proxy rotation.

August 9, 2023 · 3 min read

How to Retry Failed Python Requests [2025]

Learn how to handle failed Python requests with retry mechanisms. Explore methods like using a retry wrapper or coding your own for reliable HTTP requests.

Sergio Nonide

February 13, 2025 · 7 min read

27 Amazing Web Scraping Project Ideas for 2025

Get inspired by popular web scraping project ideas to gain experience and even build a business around data extraction.

August 3, 2023 · 2 min read

How Much Does Selenium Cost? Real Answer 2025

Discover the real Selenium cost: it's free to download but has hidden expenses. Learn how to reduce them and also explore cost-effective alternatives.

August 1, 2023 · 7 min read