Web Scraping Blog

How to Solve Axios 403 Forbidden Error

Learn to overcome Axios 403 errors in web scraping with proven strategies for bypassing server restrictions and effective data extraction.

November 27, 2023 · 6 min read

How to Set Postman User Agent

Learn to set a custom Postman User Agent with our easy guide. Avoid blocks and enhance scraping with user agent rotation techniques.

November 24, 2023 · 7 min read

How to Set a Proxy in Selenium C#

Master Selenium C# proxy settings with this guide: Set up, authenticate, and rotate proxies for effective web scraping.

November 22, 2023 · 5 min read

HttpClient User Agent in C#: How to Set It

Learn how to set and rotate the User Agent in C#'s HttpClient to avoid getting blocked while web scraping.

November 17, 2023 · 6 min read

C# HTML Parser: Best Options to Parse Content

Discover the top C# HTML parsers to extract the data you care about from web pages. Find reviews and a speed benchmark for the ranked tools.

November 15, 2023 · 15 min read

Concurrency in C#: Step-by-Step Tutorial 2024

Master concurrency in C#: Learn to improve performance and handle complex tasks efficiently with threads, tasks, and the Task Parallel Library.

November 13, 2023 · 11 min read

PuppeteerSharp Proxy: How to Get and Set It in 2024

Master web scraping in C# with a PuppeteerSharp proxy. Learn the easy setup and configuration for seamless, efficient data scraping.

November 9, 2023 · 6 min read

HTML Agility Pack: How to Parse Data (Tutorial 2024)

Learn how to use HTML Agility Pack in C# to parse the data you want to extract from web pages. Follow this step-by-step tutorial.

June 1, 2024 · 9 min read

Set a Urllib3 Proxy: Tutorial 2024

Learn to use a proxy with Urllib3 to avoid being blocked while web scraping. This tutorial covers authentication, rotating proxies and more.

November 6, 2023 · 4 min read

7 Best No-Code Web Scrapers You Must Know

Discover the best no-code web scraper for you, and start your first automation with a step-by-step tutorial for data extraction.

November 3, 2023 · 7 min read

PuppeteerSharp: Tutorial for Puppeteer in C# [2024]

Learn how to implement and use PuppeteerSharp (Puppeteer in C#) for your web scraping purposes: JavaScript rendering and avoid getting blocked.

October 30, 2023 · 9 min read

Set Wget User Agent: How-to & Best Practices

Learn how to set a custom User Agent in Wget to avoid getting blocked while web scraping. You can get the data you want.

October 25, 2023 · 5 min read

Puppeteer in Golang: Your Best Option in 2024

Learn how to use Golang with Puppeteer, one of the most recommended headless browsers to render JavaScript content and pages and interact with them.

October 23, 2023 · 5 min read

How to Bypass PerimeterX in 2024: The 4 Best Methods

Learn 4 effective methods to bypass PerimeterX protection in this in-depth guide. Get practical tips for seamless web scraping.

Yuvraj Chandra

November 11, 2024 · 13 min read

Change Playwright User Agent: Steps & Best Practices

Learn how to set up a custom User Agent in Playwright to avoid being blocked while web scraping. Get the data you care about.

October 19, 2023 · 5 min read

Web Scraping in Perl: Tutorial 2024

Get started with web scraping in Perl following this step-by-step tutorial! Learn how to scrape a site with the HTML::Tiny and HTTP::TreeBuilder libraries.

June 1, 2024 · 7 min read

Web Scraping with C in 2024

Get started with web scraping in C following this step-by-step tutorial! Learn how to scrape a site with the libcurl and libxml2 libraries.