The C# Webscraping Library

Name: IronWebScraper
Brand: Iron Software
Availability: InStock
Rating: 4.72 (37 reviews)

Go beyond basic HTML parsing. Get automated web scraping for .NET 10 with multithreading that extracts and exports structured data at scale.

Start Free Trial Licensing

Scrape using CSS selectors, XPath & JavaScript rendering
Multithreading with hundreds of simultaneous requests
Support throttling, proxies, user agents, & robots.txt
Free 30-day trial, full features, no credit card

C# Web Scraper

using IronWebScraper;

public class Program
{
    private static void Main(string[] args)
    {
        var ScrapeJob = new BlogScraper();
        ScrapeJob.Start();
    }
}

public class BlogScraper : WebScraper
{
    public override void Init()
    {
        LoggingLevel = LogLevel.All;
        Request("https://www.zyte.com/blog/", Parse);
    }

    public override void Parse(Response response)
    {
        foreach (HtmlNode title_link in response.Css(".oxy-post-title"))
        {
            string strTitle = title_link.TextContentClean;
            Scrape(new ScrapedData() { { "Title", strTitle } });
        }

        if (response.CssExists("div.oxy-easy-posts-pages > a[href]"))
        {
            string next_page = response.Css("div.oxy-easy-posts-pages > a[href]")[0].Attributes["href"];
            Request(next_page, Parse);
        }
    }
}

using IronWebScraper;

public class Program
{
    private static void Main(string[] args)
    {
        var ScrapeJob = new BlogScraper();
        ScrapeJob.Start();
    }
}

public class BlogScraper : WebScraper
{
    public override void Init()
    {
        LoggingLevel = LogLevel.All;
        Request("https://www.zyte.com/blog/", Parse);
    }

    public override void Parse(Response response)
    {
        foreach (HtmlNode title_link in response.Css(".oxy-post-title"))
        {
            string strTitle = title_link.TextContentClean;
            Scrape(new ScrapedData() { { "Title", strTitle } });
        }

        if (response.CssExists("div.oxy-easy-posts-pages > a[href]"))
        {
            string next_page = response.Css("div.oxy-easy-posts-pages > a[href]")[0].Attributes["href"];
            Request(next_page, Parse);
        }
    }
}

Imports IronWebScraper

Public Class Program
    Private Shared Sub Main(args As String())
        Dim ScrapeJob = New BlogScraper()
        ScrapeJob.Start()
    End Sub
End Class

Public Class BlogScraper
    Inherits WebScraper

    Public Overrides Sub Init()
        LoggingLevel = LogLevel.All
        Request("https://www.zyte.com/blog/", AddressOf Parse)
    End Sub

    Public Overrides Sub Parse(response As Response)
        For Each title_link As HtmlNode In response.Css(".oxy-post-title")
            Dim strTitle As String = title_link.TextContentClean
            Scrape(New ScrapedData() From {{"Title", strTitle}})
        Next

        If response.CssExists("div.oxy-easy-posts-pages > a[href]") Then
            Dim next_page As String = response.Css("div.oxy-easy-posts-pages > a[href]")(0).Attributes("href")
            Request(next_page, AddressOf Parse)
        End If
    End Sub
End Class

PM >Install-Package IronWebScraper

Install-Package IronWebScraper

See what’s new:Changelog

Cross Platform Support

Designed for C#, F#, & VB.NET running on .NET 10, 9, 8, 7, 6, 5, Core, Standard, or Framework

Why IronWebScraper

Scrape thousands of pages from a single C# class. CSS selectors, XPath, JavaScript rendering, virtual identities, and politeness controls in one library.

Broad scraping capabilities

Parse with CSS selectors or XPath expressions; jQuery-style syntax.
Render JavaScript pages, not just static HTML.
Output to C# class instances, JSON, or downloaded files.

Outcome: One library covers every scraping workflow your app will need.

Up & running in 5 mins

PM > Install-Package IronWebScraper
```
Install-Package IronWebScraper
```
→ 5-minute quick starts.
Simple API: Request(url, Parse), response.Css(".selector"), Scrape(data).
Smart defaults: multithreading, politeness, and caching handled by the framework.

Outcome: Ship a scraper this sprint, not next quarter.

Enterprise performance

.NET 10, Core, Standard, or Framework
C#, VB.NET, F# supported. DigiCert signed binaries.
Deploys anywhere: Windows, Linux, macOS, Docker, Azure, AWS.

Outcome: Scale from a single blog crawl to millions of pages without rewriting your threading model.

Polite, resilient, and audit-friendly

Throttling, proxy support, user agents, and robots.txt compliance built in.
Virtual user identities: per-request User Agent, cookies, logins, and IP.
Auto-saved jobs resume after exceptions, crashes, or power outages.

View Code Examples

Developer-first support & licensing

Perpetual license: buy once, use forever. Optional updates and renewals.
24/5 engineer support (24/7 in Premium). Real humans, median chat response <1 min.
30-day money-back guarantee. Not the right fit? Full refund, no questions.

Chat With an Engineer

For builders

Features you'll actually use:
- CSS selectors & XPath
- multithreaded crawling
- proxy & user agent rotation
- virtual user identities
- auto-resume on crash
- JavaScript rendering
- throttling & politeness
- robots.txt compliance
- action replay (offline)
- JSON or class output
Works everywhere: Windows, Linux, macOS, Docker, Azure, AWS.

(30 days, fully-functional product)

For buyers

Trusted by millions of engineers across the Iron Suite.
Built for real workloads: system migrations, competitive analysis, search indexing, data mining.
Procurement-friendly: perpetual license, optional renewals, invoice available, multiple payment options (incl. local: Amazon Pay, Alipay, Apple Pay, iDEAL, SEPA, ACH).
30-day money-back guarantee.

See Licensing

Trusted by millions of engineers worldwide

Get started: C# code examples

C# Web Scraper

using IronWebScraper;

public class Program
{
    private static void Main(string[] args)
    {
        var ScrapeJob = new BlogScraper();
        ScrapeJob.Start();
    }
}

public class BlogScraper : WebScraper
{
    public override void Init()
    {
        LoggingLevel = LogLevel.All;
        Request("https://www.zyte.com/blog/", Parse);
    }

    public override void Parse(Response response)
    {
        foreach (HtmlNode title_link in response.Css(".oxy-post-title"))
        {
            string strTitle = title_link.TextContentClean;
            Scrape(new ScrapedData() { { "Title", strTitle } });
        }

        if (response.CssExists("div.oxy-easy-posts-pages > a[href]"))
        {
            string next_page = response.Css("div.oxy-easy-posts-pages > a[href]")[0].Attributes["href"];
            Request(next_page, Parse);
        }
    }
}

Imports IronWebScraper

Public Class Program
    Private Shared Sub Main(args As String())
        Dim ScrapeJob = New BlogScraper()
        ScrapeJob.Start()
    End Sub
End Class

Public Class BlogScraper
    Inherits WebScraper

    Public Overrides Sub Init()
        LoggingLevel = LogLevel.All
        Request("https://www.zyte.com/blog/", AddressOf Parse)
    End Sub

    Public Overrides Sub Parse(response As Response)
        For Each title_link As HtmlNode In response.Css(".oxy-post-title")
            Dim strTitle As String = title_link.TextContentClean
            Scrape(New ScrapedData() From {{"Title", strTitle}})
        Next

        If response.CssExists("div.oxy-easy-posts-pages > a[href]") Then
            Dim next_page As String = response.Css("div.oxy-easy-posts-pages > a[href]")(0).Attributes("href")
            Request(next_page, AddressOf Parse)
        End If
    End Sub
End Class

PM > Install-Package IronWebScraper

Install-Package IronWebScraper

IronWebScraper provides a powerful framework to extract data and files from websites using C# code.

Install IronWebScraper to your Project using NuGet.
Create a Class Extending WebScraper.
Create an Init method that uses the Request method to parse at least one URL.
Create a Parse method to process the requests, and indeed Request more pages. Use response.Css to work with HTML elements using jQuery style CSS selectors.
In your application, create an instance of your web scraping class and call the Start(); method.
Read our C# web scraping tutorials to learn how to create advanced web crawlers using IronWebScraper.

Discover How to Scrape Online Movie Websites with C#

Human Support Directly From Our Development Team

Whether it's product, integration or licensing queries, the Iron product development team is on hand to support all of your questions. Get in touch and start a dialog with Iron to make the most of our library in your project.

Ask a Question

Powerful Scraping Engine Under Your Control

Just write a single C# web-scraper class to scrape thousands or even millions of web pages into C# Class Instances, JSON or Downloaded Files. IronWebScraper allows you to code concise, linear workflows simulating human browsing behavior. IronWebScraper will run your code as a swarm of virtual web browsers, massively paralleled, yet polite and fault tolerant.

Get Started with Documentation

Simple, Flexible Logic

IronWebScraper must be programmed to know how to handle each “type” of page it encounters. This is achieved in a very concise manner using CSS Selectors or XPath expressions and can be fully customized in C#. This freedom allows you to decide which pages to scrape within a website, and what to do with the data extracted. Each method can be debugged and watched neatly in Visual Studio.

Follow a Tutorial

Fast and Polite Behavior

IronWebScraper deals with multithreading and web-requests to allow for hundreds of concurrent threads without the developer needing to manage them. Politeness can be set to throttle requests, so reducing risk of excessive load on target web servers.

Up and Running with WebScraper

Create virtual user Identities

IronWebScraper can use one or multiple “identities” - sessions that simulate real world human requests. Each request may programmatically or randomly assign its own Identity, User Agent, Cookies, Logins and even IP addresses. Requests are set as auto-unique with a combination of URL, parse method and post variables.

See API Reference

Action Replay

IronWebScraper uses advanced caching to allow developers to change their code “on the fly” and replay every previous request without contacting the internet. Every scrape job is autosaved and can be resumed in the event of an exception or power outage.

WebScraper Setup Instructions

Visual Studio Library for PDF Creation and Content Editing.

Rapid Installation with Microsoft Visual Studio

IronWebScraper puts Web Scraping tools in your own hands quickly with a Visual Studio installer. Whether installing directly from NuGet within visual studio or downloading the DLL, you’ll be setup in no time. Just one DLL and no dependencies.

PM > Install-Package IronWebScraper Download DLL

Supports:

.NET Webscraping Community Tutorials

Tutorial + Code Examples Webscraping in .NET | VB.NET & ASP.NET PDF

VBC#ASP.NET

Web Scraping in C# and VB.NET Projects

See how Ahmed uses IronWebScraper in his projects to migrate content from one site to another. Sample Projects and Code provided for scraping ecommerce and blog websites