Web Scraping Blog

Puppeteer Extra: Comprehensive Tutorial 2024

Implement Puppeteer Extra to unlock new headless browsing capabilities to avoid getting blocked while web scraping and for other purposes.

August 18, 2023 · 4 min read

Undetected ChromeDriver in Python Selenium: How to Use for Web Scraping

Supercharge your Selenium headless browser with Undetected ChromeDriver, a popular tool to avoid getting blocked while web scraping.

August 26, 2024 · 8 min read

Error 403 in Web Scraping: 7 Easy Solutions

Learn how to fix Error 403 in web scraping with seven easy techniques to bypass restrictions and continue extracting data efficiently.

Idowu Omisola

September 26, 2024 · 7 min read

How to Bypass Sucuri in 2024

Find out the most effective ways to bypass Sucuri and scrape the website you want in this guide.

August 11, 2023 · 7 min read

How to Use Superagent-Proxy

Discover how to use superagent-proxy in NodeJS for undetectable web scraping. This guide covers setup and proxy rotation.

August 9, 2023 · 3 min read

Python Requests: Retry Failed Requests [2024]

Learn how to handle failed HTTP requests in Python using the Requests library.

Rubén del Campo

October 18, 2024 · 8 min read

27 Amazing Web Scraping Project Ideas for 2024

Get inspired by popular web scraping project ideas to gain experience and even build a business around data extraction.

August 3, 2023 · 2 min read

How Much Does Selenium Cost? Real Answer 2024

Discover the real Selenium cost: it's free to download but has hidden expenses. Learn how to reduce them and also explore cost-effective alternatives.

August 1, 2023 · 7 min read

Scrapy in Python: Web Scraping Tutorial 2024

Learn how to use Scrapy in Python for web scraping and extract all the data you're interested in. Follow this step-by-step tutorial.

May 16, 2024 · 11 min read

How to Use Playwright Stealth for Scraping

Implement Playwright Stealth to web scrape without getting blocked and get access to the data you want. Follow this step-by-step tutorial.

July 27, 2023 · 5 min read

7 Best Scrapy Alternatives in 2024

Have a look at the best Scrapy alternatives, ordered by the overall top and by language. For both beginners and more advanced web scraping developers.

July 26, 2023 · 8 min read

How to Solve Scrapy 403 Forbidden Error

Learn why Scrapy Error 403 is being returned and how to solve this Forbidden error when web scraping. Get access to the data you want.

July 25, 2023 · 7 min read

Scrapy User Agent: How to Change and Tips 2024

Learn how to change the Scrapy User Agent and apply tried-and-tested practices for effective web scraping at scale.

July 24, 2023 · 8 min read

How to Use a Proxy with Pyppeteer in 2024

Discover the secret to using proxies with Pyppeteer in 2023! Learn the easy steps to leverage proxies for web scraping, automation, and staying anonymous online.

July 21, 2023 · 1 min read

Handle the User Agent in NodeJS

Learn how to set and rotate User Agents in NodeJS to successfully web scrape without getting blocked. You'll also find a handy tool to scale up.

July 20, 2023 · 4 min read

Web Crawler in Python: Step-by-Step Tutorial 2024

Learn about web crawling and how to build a Python web crawler through step-by-step examples. Also, dive into more advanced and actionable concepts.

July 19, 2023 · 9 min read

Best Social Media Proxies in 2024

Find out how social media proxies can enhance your scraping workflow, online presence, safeguard your privacy, and increase engagement.

July 18, 2023 · 3 min read

CloudProxy Tutorial to Scrape Websites in 2024

Learn how to use CloudProxy to use proxies for bypassing anti-bot measures. Also, find a more reliable CloudProxy alternative to scrape any website.

July 12, 2023 · 5 min read