Web Scraping Blog

How to Set Up a Proxy With MechanicalSoup

Learn how to add a proxy to MechanicalSoup. Build a proxy rotator and discover how to use premium proxies to avoid all blocks and bans.

July 3, 2024 · 8 min read

Playwright in Golang for Web Scraping [Tutorial 2025]

Learn how to use Playwright with Go to scrape the web and successfully bypass all blocks and bans.

July 2, 2024 · 9 min read

How to Solve Jsoup 403 Forbidden Error

Learn how to avoid jsoup 403 forbidden error with custom User Agent, rotating proxies, and a web scraping API.

July 1, 2024 · 8 min read

Web Scraping With PHP vs. Python: Which to Choose?

Should you choose Python or PHP for web scraping? In this article, we’ll compare the two across factors such as popularity, speed, data analysis capabilities, and more.

June 28, 2024 · 17 min read

How to Use Nodriver for Web Scraping

Learn how to scrape the web with nodriver: extract HTML, deal with dynamic content, and avoid all blocks and bans.

June 26, 2024 · 10 min read

How to Use a Proxy With OkHttp [Tutorial 2025]

Learn how to use a single proxy, rotate proxies from a pool, or take advantage of premium proxies while web scraping with OkHttp.

June 25, 2024 · 8 min read

Playwright in C# for Web Scraping: Step-by-Step Tutorial

Learn to automate web scraping using Playwright in C# with this detailed guide, covering installation, setup, and data extraction.

June 24, 2024 · 12 min read

Axios vs. Got vs. Fetch: Which Should You Choose

Should you use Axios, Got, or Fetch API for your project? This article compares the three tools based on factors such as performance, popularity, and browser support.

June 21, 2024 · 10 min read

How to Bypass Akamai With Playwright

Learn how to bypass Akamai when web scraping with Playwright with three methods: stealth plugin, web scraping API, and premium proxies.

June 20, 2024 · 8 min read

How to Take a Screenshot With Watir: Tutorial [2025]

Learn how to take screenshots of the viewport, full page, and specific elements using the Ruby library Watir.

June 19, 2024 · 7 min read

Puppeteer in PHP for Web Scraping: Step-by-Step Tutorial

Learn how to use Puppeteer PHP for web scraping and interacting with web pages in a browser while avoiding all blocks and bans.

June 18, 2024 · 12 min read

How to Set Up User Agent With Net/http in Golang

Learn how to implement and rotate multiple user agents in Golang, enhancing the stealth of your web scraping tools.

Sergio Nonide

January 29, 2025 · 8 min read

5 Best Rust HTML Parsers for Web Scraping

Choose the best Rust HTML parser for your project. Review the top options based on their performance, ease of use, popularity, and more.

June 13, 2024 · 10 min read

How to Bypass DataDome With Selenium

Explore five surefire ways of bypassing DataDome with Selenium, including stealth plugin, premium proxies, or a web scraping API.

June 11, 2024 · 10 min read

The 4 Best C# Headless Browsers [2025]

Looking for the best C# headless browser? This article reviews 5 top browsers across their popularity, ease of use, speed, and success rate of avoiding blocks.

June 10, 2024 · 9 min read

How to Take Screenshots With Chromedp: Tutorial [2025]

Learn how to take different screenshot types with Chromedp while avoiding all blocks and bans.

June 6, 2024 · 8 min read

How to Use AutoScraper in Python for Web Scraping

Learn how to use AutoScraper to extract content without CSS selectors and automate your web scraping tasks.

June 5, 2024 · 4 min read

Superagent vs. Axios: Which Is Better for Your Project?

Superagent vs. Axios showdown: Check out this comparison of the two popular HTTP clients and decide which is better for your next web scraping project.

June 4, 2024 · 9 min read