The C# Web Scraping Library

IronWebScraper makes it easy to find and read content from websites in C#
It makes Web Scraping in C# easy, providing a tool for you to scrape the content of websites.

C# WebScraper

Web Scraping in C# or .Net

IronWebScraper is an advanced web scraping library written in C#. It uses web scraping algorithms to read structured content from websites. This is ideal for scraping content from multiple existing websites or intranet applications to build the content for your web application or archive. IronWebScraper can provide the tool you need to index your content for use by your search application or cataloging system. IronWebScraper uses C# to provide a reliable, enterprise class web scrpaer in an easy to use DLL library.

The IronWebScraper API is easy to use. Most C# developers will be up and running in no time using the Nuget installer for Visual Studio.     Install Now »

C# Website Migration

Migrating Websites to Databases

IronWebScraper provides the tools and methods to allow you to re-engineer your websites back into structured databases.   This technology is useful when migrating content from legacy websites and intranets into your new C# application.

C# Web Scraping

IronWebScraper is an ideal tool to scrape content for your search index.   A search application such as IronSearch can read structured content from IronWebScraper to build a powerful enterprise search system.

Start scraping your web content today

How To Install the IronWebScraper C# Web Scraping Library into Visual Studio

Install IronWebScraper into your .Net Project

The easiest way to install IronWebScraper is using NuGet Package Manager for Visual-Studio:

  1. The package name is "IronWebScraper"
  2. If NuGet is unfamiliar to you… read this tutorial
  3. If you would prefer to download IronWebScraper as a dll and install manually.
C# WebScraper Example Code Demo

Get Scraping

IronWebScraper has a very simple API:

using IronWebScraper;

    public class MyScraper : WebScraper
        public override void Init()
            this.HttpConnectionLimit = 100;
            UserAgent = "My Crawler 1.292";
            BannedUrls.Add("*.zip", "*.exe", "*.gz", "*.pdf");
            this.Request("", this.Parse);

        public override void Parse(Response response)

            Yield(new MyPage() { title = response.querySelector("title").InnerText.Trim(), url = new Uri(response.FinalUrl) });

            var links = (response.Css("a[href]")).Select(link => link.Attributes["href"]);

            Request(response.ToAbsoluteUrl(links), Parse);
Imports IronWebScraper

Public Class MyScraper
    Inherits WebScraper
    Public Overrides Sub Init()
        Me.HttpConnectionLimit = 100
        UserAgent = "My Crawler 1.292"
        BannedUrls.Add("*.zip", "*.exe", "*.gz", "*.pdf")
        Me.Request("", AddressOf Me.Parse)
    End Sub

    Public Overrides Sub Parse(response As Response)

        Yield(New MyPage() With { _
            Key .title = response.querySelector("title").InnerText.Trim(), _
            Key .url = New Uri(response.FinalUrl) _

        Dim links = (response.Css("a[href]")).[Select](Function(link) link.Attributes("href"))

        Request(response.ToAbsoluteUrl(links), AddressOf Parse)
    End Sub
End Class

Reliable Web-Scraping tools for C# developers

C# Web Scraper Documentation

Well Documented

Clear online manuals in plain English.

Read Docs
C# Web Scraper Library Licensing

Flexibly Licensed

Free Development. Commercial from $299.

Explore Licenses
C# PDF Open-Source Examples

Human Support

Talk directly with our development team

Ask a Question
visual studio Install C# Web Scraper by IronWebScraper

1 Minute Setup

Use Nuget Package Manager to install in under a minute.