Web Scraping Blog

You'll find it easier to scrape any website with our step-by-step tutorials from beginner to pro.

How to Solve Axios 403 Forbidden Error

Learn to overcome Axios 403 errors in web scraping with proven strategies for bypassing server restrictions and effective data extraction.

How to Set Postman User Agent

Learn to set a custom Postman User Agent with our easy guide. Avoid blocks and enhance scraping with user agent rotation techniques.

How to Set a Proxy in Selenium C#

Master Selenium C# proxy settings with this guide: Set up, authenticate, and rotate proxies for effective web scraping.

HttpClient User Agent in C#: How to Set It

Learn how to set and rotate the User Agent in C#'s HttpClient to avoid getting blocked while web scraping.

C# HTML Parser: Best Options to Parse Content

Discover the top C# HTML parsers to extract the data you care about from web pages. Find reviews and a speed benchmark for the ranked tools.

Concurrency in C#: Step-by-Step Tutorial 2023

Master concurrency in C#: Learn to improve performance and handle complex tasks efficiently with threads, tasks, and the Task Parallel Library.

PuppeteerSharp Proxy: How to Get and Set It in 2023

Master web scraping in C# with a PuppeteerSharp proxy. Learn the easy setup and configuration for seamless, efficient data scraping.

HTML Agility Pack: How to Parse Data (Tutorial 2023)

Learn how to use HTML Agility Pack in C# to parse the data you want to extract from web pages. Follow this step-by-step tutorial.

Set a Urllib3 Proxy: Tutorial 2023

Learn to use a proxy with Urllib3 to avoid being blocked while web scraping. This tutorial covers authentication, rotating proxies and more.

7 Best No-Code Web Scrapers You Must Know

Discover the best no-code web scraper for you, and start your first automation with a step-by-step tutorial for data extraction.

PuppeteerSharp: Tutorial for Puppeteer in C# [2023]

Learn how to implement and use PuppeteerSharp (Puppeteer in C#) for your web scraping purposes: JavaScript rendering and avoid getting blocked.

Set Wget User Agent: How-to & Best Practices

Learn how to set a custom User Agent in Wget to avoid getting blocked while web scraping. You can get the data you want.

Puppeteer in Golang: Your Best Option in 2023

Learn how to use Golang with Puppeteer, one of the most recommended headless browsers to render JavaScript content and pages and interact with them.

Change Playwright User Agent: Steps & Best Practices

Learn how to set up a custom User Agent in Playwright to avoid being blocked while web scraping. Get the data you care about.

Web Scraping in Perl: Tutorial 2023

Get started with web scraping in Perl following this step-by-step tutorial! Learn how to scrape a site with the HTML::Tiny and HTTP::TreeBuilder libraries.

Web Scraping with C in 2023

Get started with web scraping in C following this step-by-step tutorial! Learn how to scrape a site with the libcurl and libxml2 libraries.