Web Scraping Blog

We share everything we know about web scraping and data automation to help you stand out.

Web Scraping with PHP: a Step-By-Step Tutorial

Web scraping from zero to hero in PHP! Create your web scraper with this step-by-step tutorial. Learn DOM, data parsing, anti-blocking techniques and more.
August 10, 2022 ยท 14 min read

How To Rotate Proxies in Python

Learn how to build a custom proxy rotator using Python to avoid getting blocked when web scraping. Pick at random from an IP pool where each proxy is available and health-checked.
By Ander ยท June 8, 2022 (Updated: November 1) ยท 11 min read

Speed Up Web Scraping with Concurrency

Learn how to speed up your web scraping in Python using asyncio and multiprocessing. Concurrency allows you to go much faster by requesting several pages simultaneously.
By Ander ยท May 17, 2022 ยท 10 min read

Web Scraping with Python in 2023

Get started with web scraping in Python following this step-by-step tutorial! Learn how to scrape a site with Requests and Beautiful Soup libraries.
January 19, 2022 ยท 26 min read

Web Scraping with Python 101

Learn how to build a web scraper with Python using Requests and BeautifulSoup libraries. We will cover, step-by-step, a scraping process on a job board.
By Ander ยท January 19, 2022 ยท 14 min read

DOs and DON'Ts of Web Scraping

Create better web scrapers by following best practices and avoiding common mistakes. Choose the right approach for the job thanks to these tips.
By Ander ยท December 21, 2021 ยท 9 min read

Web Scraping with Selenium in Python

Tutorial to navigate and scrape websites using Selenium in Python, even dynamic content, thanks to JavaScript Rendering and other available features.
By Ander ยท November 30, 2021 ยท 9 min read

Web Scraping: Intercepting XHR Requests

Take advantage of XHR requests and scrape websites content without any effort. No need for fickle HTML or CSS selectors, API endpoints tend to remain stable.
By Ander ยท October 27, 2021 ยท 5 min read

Web Scraping in JavaScript and NodeJS

Learn web scraping in JavaScript and NodeJS with this step-by-step tutorial. From basic scraping to anti-blocking techniques to headless browsers and more.
By Ander ยท September 1, 2021 (Updated: August 8, 2022) ยท 12 min read

Car Price Prediction in Python

Check correlation from a car dataset and train different linear regression models to predict the price based on data points such as mileage and horsepower.
By Ander ยท July 13, 2021 ยท 7 min read

Exploratory Data Analysis in Python

Import a CSV file into Python and start Exploratory Data Analysis in a few minutes. Learn how to interpret variables and plot them to get insights.
By Ander ยท July 6, 2021 ยท 5 min read