Web Scraping Blog

We share everything we know about web scraping and data automation to help you stand out.

Web Scraping With jQuery: A Complete Tutorial

Do web scraping using jQuery with this tutorial. You'll learn how to get content, parse HTML, and extract wanted data. You can scrape any website with Node.js.
September 14, 2022 · 8 min read

How to bypass Akamai

Learn how to bypass Akamai Bot Manager. You'll add evasions to skip blocks by understanding how it works and what sensor data it sends.
By Ander · August 19, 2022 · 11 min read

Web Scraping with PHP: Step-By-Step Tutorial

Web scraping from zero to hero in PHP! Create your web scraper with this step-by-step tutorial. Learn DOM, data parsing, anti-blocking techniques and more
August 10, 2022 · 14 min read

How To Rotate Proxies in Python

Learn how to build a custom proxy rotator using Python to avoid getting blocked when web scraping. Pick at random from an IP pool where each proxy is available and health-checked.
By Ander · June 8, 2022 (Updated: November 1) · 11 min read

Speed Up Web Scraping with Concurrency

Learn how to speed up your web scraping in Python using asyncio and multiprocessing. Concurrency allows you to go much faster by requesting several pages simultaneously.
By Ander · May 17, 2022 · 10 min read

Web Scraping with Python in 2023

Get started with web scraping in Python following this step-by-step tutorial! Learn how to scrape a site with Requests and Beautiful Soup libraries.
January 19, 2022 · 26 min read

DOs and DON'Ts of Web Scraping

Create better web scrapers by following best practices and avoiding common mistakes. Choose the right approach for the job thanks to these tips.
By Ander · December 21, 2021 · 9 min read

Web Scraping with Selenium and Python in 2023

Learn to use Selenium with Python in web scraping to extract dynamic content and avoid getting blocked following this step-by-step tutorial.
November 11, 2021 (Updated: April 4, 2023) · 16 min read

Web Scraping: Intercepting XHR Requests

Take advantage of XHR requests and scrape websites content without any effort. No need for fickle HTML or CSS selectors, API endpoints tend to remain stable.
By Ander · October 27, 2021 · 5 min read

Web Scraping in JavaScript and NodeJS

Learn web scraping in JavaScript and NodeJS with this step-by-step tutorial. From basic scraping to anti-blocking techniques to headless browsers and more.
By Ander · September 1, 2021 (Updated: August 8, 2022) · 12 min read