Web Scraping Blog
You'll find it easier to scrape any website with our step-by-step tutorials from beginner to pro.
Puppeteer Extra: Comprehensive Tutorial 2024
Implement Puppeteer Extra to unlock new headless browsing capabilities to avoid getting blocked while web scraping and for other purposes.
August 18, 2023
· 4 min read
Undetected ChromeDriver in Python Selenium: How to Use for Web Scraping
Supercharge your Selenium headless browser with Undetected ChromeDriver, a popular tool to avoid getting blocked while web scraping.
August 26, 2024
· 8 min read
Error 403 in Web Scraping: 7 Easy Solutions
Learn how to fix Error 403 in web scraping with seven easy techniques to bypass restrictions and continue extracting data efficiently.
Idowu Omisola
September 26, 2024
· 7 min read
How to Bypass Sucuri in 2024
Find out the most effective ways to bypass Sucuri and scrape the website you want in this guide.
August 11, 2023
· 7 min read
How to Use Superagent-Proxy
Discover how to use superagent-proxy in NodeJS for undetectable web scraping. This guide covers setup and proxy rotation.
August 9, 2023
· 3 min read
Python Requests: Retry Failed Requests [2024]
Learn how to handle failed HTTP requests in Python using the Requests library.
Rubén del Campo
October 18, 2024
· 8 min read
27 Amazing Web Scraping Project Ideas for 2024
Get inspired by popular web scraping project ideas to gain experience and even build a business around data extraction.
August 3, 2023
· 2 min read
How Much Does Selenium Cost? Real Answer 2024
Discover the real Selenium cost: it's free to download but has hidden expenses. Learn how to reduce them and also explore cost-effective alternatives.
August 1, 2023
· 7 min read
Scrapy in Python: Web Scraping Tutorial 2024
Learn how to use Scrapy in Python for web scraping and extract all the data you're interested in. Follow this step-by-step tutorial.
May 16, 2024
· 11 min read
How to Use Playwright Stealth for Scraping
Implement Playwright Stealth to web scrape without getting blocked and get access to the data you want. Follow this step-by-step tutorial.
July 27, 2023
· 5 min read
7 Best Scrapy Alternatives in 2024
Have a look at the best Scrapy alternatives, ordered by the overall top and by language. For both beginners and more advanced web scraping developers.
July 26, 2023
· 8 min read
How to Solve Scrapy 403 Forbidden Error
Learn why Scrapy Error 403 is being returned and how to solve this Forbidden error when web scraping. Get access to the data you want.
July 25, 2023
· 7 min read
Scrapy User Agent: How to Change and Tips 2024
Learn how to change the Scrapy User Agent and apply tried-and-tested practices for effective web scraping at scale.
July 24, 2023
· 8 min read
How to Use a Proxy with Pyppeteer in 2024
Discover the secret to using proxies with Pyppeteer in 2023! Learn the easy steps to leverage proxies for web scraping, automation, and staying anonymous online.
July 21, 2023
· 1 min read
Handle the User Agent in NodeJS
Learn how to set and rotate User Agents in NodeJS to successfully web scrape without getting blocked. You'll also find a handy tool to scale up.
July 20, 2023
· 4 min read
Web Crawler in Python: Step-by-Step Tutorial 2024
Learn about web crawling and how to build a Python web crawler through step-by-step examples. Also, dive into more advanced and actionable concepts.
July 19, 2023
· 9 min read
Best Social Media Proxies in 2024
Find out how social media proxies can enhance your scraping workflow, online presence, safeguard your privacy, and increase engagement.
July 18, 2023
· 3 min read
CloudProxy Tutorial to Scrape Websites in 2024
Learn how to use CloudProxy to use proxies for bypassing anti-bot measures. Also, find a more reliable CloudProxy alternative to scrape any website.
July 12, 2023
· 5 min read