Parsing HTML Documents with the Html Agility Pack
Introduction
Screen scraping is the process of programmatically accessing and processing information from an external website. For example, a price comparison website might screen scrape a variety of online retailers to build a database of products and what various retailers are selling them for. Typically, screen scraping is performed by mimicking the behavior of a browser – namely, by making an HTTP request from code and then parsing and analyzing the returned HTML.