Web Scraping Blog

We share everything we know about web scraping and data automation to help you stand out.

How to bypass Akamai
Bypass
Web Scraping

Learn how to bypass Akamai Bot Manager. You'll add evasions to skip blocks by understanding how it works and what sensor data it sends.
Ander
By Ander ยท August 19, 2022 ยท 11 min read
Read more

How To Rotate Proxies in Python
Python
Web Scraping

Learn how to build a custom proxy rotator using Python to avoid getting blocked when web scraping. Pick at random from an IP pool where each proxy is available and health-checked.
Ander
By Ander ยท June 8, 2022 ยท 8 min read
Read more

Speed Up Web Scraping with Concurrency
Python
Web Scraping

Learn how to speed up your web scraping in Python using asyncio and multiprocessing. Concurrency allows you to go much faster by requesting several pages simultaneously.
Ander
By Ander ยท May 17, 2022 ยท 10 min read
Read more

Web Scraping with Python 101
Python
Web Scraping

Learn how to build a web scraper with Python using Requests and BeautifulSoup libraries. We will cover, step-by-step, a scraping process on a job board.
Ander
By Ander ยท January 19, 2022 ยท 14 min read
Read more

DOs and DON'Ts of Web Scraping
Web Scraping

Create better web scrapers by following best practices and avoiding common mistakes. Choose the right approach for the job thanks to these tips.
Ander
By Ander ยท December 21, 2021 ยท 9 min read
Read more

Web Scraping with Selenium in Python
Python

Tutorial to navigate and scrape websites using Selenium in Python, even dynamic content, thanks to Javascript Rendering and other available features.
Ander
By Ander ยท November 30, 2021 ยท 9 min read
Read more

Web Scraping: Intercepting XHR Requests
Python

Take advantage of XHR requests and scrape websites content without any effort. No need for fickle HTML or CSS selectors, API endpoints tend to remain stable.
Ander
By Ander ยท October 27, 2021 ยท 5 min read
Read more

Web Scraping in Javascript and NodeJS
Javascript
Web Scraping

Learn web scraping in Javascript and NodeJS with this step-by-step tutorial. From basic scraping to anti-blocking techniques to headless browsers and more.
Ander
By Ander ยท September 1, 2021 ยท 12 min read
Read more

Car Price Prediction in Python
Python
Analytics

Check correlation from a car dataset and train different linear regression models to predict the price based on data points such as mileage and horsepower.
Ander
By Ander ยท July 13, 2021 ยท 7 min read
Read more

Exploratory Data Analysis in Python
Python
Analytics

Import a CSV file into Python and start Exploratory Data Analysis in a few minutes. Learn how to interpret variables and plot them to get insights.
Ander
By Ander ยท July 6, 2021 ยท 5 min read
Read more

7 Use Cases For Website Scraping
Web Scraping

How can web scraping help your business grow? From market research to Machine Learning training, extracting knowledge can guide any data-driven decision in any industry sector.
Ander
By Ander ยท July 1, 2021 ยท 4 min read
Read more

How Do YouTube Videos Go Viral
Analytics

YouTube videos data from several top YouTubers to see how their videos grow over time. Some might reach millions of views in a few hours.
Ander
By Ander ยท June 16, 2021 ยท 5 min read
Read more

Collecting Data to Map Housing Prices
Analytics

We collected real estate data to map Bilbao's housing prices by price per square meter. 3000 were collected in under a minute using a ZenRows task.
Ander
By Ander ยท June 7, 2021 ยท 6 min read
Read more

What is Web Scraping? In-Depth Guide
Web Scraping

Web Scraping is the process of automatically collecting web data with specialized software. Every day trillions of GBs are created, making it impossible to keep track...
Aurken
By Aurken ยท March 16, 2021 ยท 7 min read
Read more