Web Scraping Blog

Learn to use a rotating proxy with Axios to avoid being blocked while web scraping. This tutorial covers authentication, environment variables and more.

Discover the techniques to easily avoid bot detection with Selenium while scraping. You'll also discover some useful tools to make your life easier.

Learn why Cloudflare Error 1015 happens and how to avoid it while using automated tools for web scraping.

Learn three effective methods to bypass Cloudflare in Java to scrape any website and get the data you need.

Find out the best free web scraping proxies to help you crawl web pages without getting blocked.

Learn to use Selenium with Python in web scraping to extract dynamic content and avoid getting blocked following this step-by-step tutorial.

Learn to use a proxy with Selenium in Python to avoid being blocked while web scraping. This tutorial covers authentication, rotating proxies and more.

Use Puppeteer Stealth to avoid being blocked while web scraping. Learn everything about the Puppeteer Extra plugin for your headless browser.

Discover the best languages for web scraping and the aspects in which they excel. Also, get to know the main frameworks for data extraction.

Learn how to scrape web pages with Puppeteer headless browser in NodeJS using this step-by-step tutorial and go from zero to hero.

Learn why the User Agent in Python Requests is getting your scraper blocked, how to change it and the steps to randomize it at scale.

cURL is a powerful web scraping tool for those that know how to use it. Learn to extract data and win over blocking challenges in this step-by-step tutorial.

Learn how to bypass CAPTCHA using Playwright and implement the tools that will help you web scrape without getting blocked.

Discover what canvas fingerprinting is and learn how to bypass it for web scraping in this step-by-step tutorial.

Discover the best ways to avoid CAPTCHA and reCAPTCHA while web scraping so that you don't get blocked again. Also, learn more about how this technology works.

Learn how to bypass Cloudflare with Playwright in this step-by-step tutorial and make your web scraping projects smoother.