Web Scraping Blog

You'll find it easier to scrape any website with our step-by-step tutorials from beginner to pro.

7 Best Scrapy Alternatives in 2024

Have a look at the best Scrapy alternatives, ordered by the overall top and by language. For both beginners and more advanced web scraping developers.
July 26, 2023 · 8 min read

How to Solve Scrapy 403 Forbidden Error

Learn why Scrapy Error 403 is being returned and how to solve this Forbidden error when web scraping. Get access to the data you want.
July 25, 2023 · 7 min read

How to Use a Proxy with Pyppeteer in 2024

Discover the secret to using proxies with Pyppeteer in 2023! Learn the easy steps to leverage proxies for web scraping, automation, and staying anonymous online.
July 21, 2023 · 1 min read

Handle the User Agent in NodeJS

Learn how to set and rotate User Agents in NodeJS to successfully web scrape without getting blocked. You'll also find a handy tool to scale up.
July 20, 2023 · 4 min read

Best Social Media Proxies in 2024

Find out how social media proxies can enhance your scraping workflow, online presence, safeguard your privacy, and increase engagement.
July 18, 2023 · 3 min read