Web Scraping Blog

How to Set Up a Proxy in AIOHTTP

Learn how to set up AIOHTTP proxies: add a proxy to your script, build a proxy rotator, and discover how to use premium proxies to avoid blocks and bans.

July 11, 2024 · 7 min read

How to Use Curl_cffi for Web Scraping

Learn how to use curl_cffi for web scraping, from the basics to more advanced techniques such as concurrent requests and session handling.

July 10, 2024 · 7 min read

How to Bypass CAPTCHA With Selenium in Ruby

Learn how to bypass CAPTCHA with Selenium in Ruby by using Undetected ChromeDriver or a web scraping API.

July 9, 2024 · 7 min read

Nokogiri Tutorial: Best HTML Parser for Ruby

Learn how to efficiently parse HTML with Ruby and Nokogiri, from extracting data all the way to CSV export.

July 8, 2024 · 8 min read

How to Use Ferret for Web Scraping: Tutorial [2026]

Learn how to take advantage of Golang's scraping power without writing a Go program and use Ferret for web scraping.

July 4, 2024 · 10 min read

Playwright in Golang for Web Scraping [Tutorial 2026]

Learn how to use Playwright with Go to scrape the web and successfully bypass all blocks and bans.

July 2, 2024 · 9 min read

How to Solve Jsoup 403 Forbidden Error

Learn how to avoid jsoup 403 forbidden error with custom User Agent, rotating proxies, and a web scraping API.

July 1, 2024 · 8 min read

How to Use Nodriver for Web Scraping

Learn how to scrape the web with nodriver: extract HTML, deal with dynamic content, and avoid all blocks and bans.

June 26, 2024 · 10 min read

How to Use a Proxy With OkHttp [Tutorial 2026]

Learn how to use a single proxy, rotate proxies from a pool, or take advantage of premium proxies while web scraping with OkHttp.

June 25, 2024 · 8 min read

Playwright in C# for Web Scraping: Step-by-Step Tutorial

Learn to automate web scraping using Playwright in C# with this detailed guide, covering installation, setup, and data extraction.

June 24, 2024 · 12 min read

Axios vs. Got vs. Fetch: Which Should You Choose

Axios vs Got vs Fetch API: Compare performance, popularity, browser support to choose the right tool for your project.

June 21, 2024 · 10 min read

How to Bypass Akamai With Playwright

Learn how to bypass Akamai when web scraping with Playwright with three methods: stealth plugin, web scraping API, and premium proxies.

June 20, 2024 · 8 min read

Puppeteer in PHP for Web Scraping: Step-by-Step Tutorial

Learn how to use Puppeteer PHP for web scraping and interacting with web pages in a browser while avoiding all blocks and bans.

June 18, 2024 · 12 min read

How to Set Up User Agent With Net/http in Golang

Learn how to implement and rotate multiple user agents in Golang, enhancing the stealth of your web scraping tools.

Sergio Nonide

January 29, 2025 · 8 min read

5 Best Rust HTML Parsers for Web Scraping

Choose the best Rust HTML parser for your project. Review the top options based on their performance, ease of use, popularity, and more.

June 13, 2024 · 10 min read

How to Bypass DataDome With Selenium

Explore five surefire ways of bypassing DataDome with Selenium, including stealth plugin, premium proxies, or a web scraping API.

June 11, 2024 · 10 min read

The 4 Best C# Headless Browsers [2026]

Best C# headless browser? Review 5 top options comparing popularity, ease of use, speed, and success at avoiding blocks.

June 10, 2024 · 9 min read

How to Take Screenshots With Chromedp: Tutorial [2026]

Learn how to take different screenshot types with Chromedp while avoiding all blocks and bans.

June 6, 2024 · 8 min read