WebScraper class

High-level web scraper that combines HTML fetching and data parsing.

This class provides a simplified interface for web scraping by combining the Scraper (for fetching HTML) and WebParser (for extracting data) into a single, easy-to-use API.

Example usage:

final scraper = WebScraper();
final configMap = {
  'example.com': [ScraperConfig(...)]
};

final data = await scraper.scrape(
  url: Uri.parse('https://example.com'),
  scraperConfigMap: configMap,
);

Constructors

WebScraper()

Properties

hashCode → int

The hash code for this object.

no setter, inherited

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

canScrape({required Uri url, required ScraperConfigMap scraperConfigMap}) → bool

Checks if the given URL can be scraped with the provided configuration.

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

scrape({required Uri url, ScraperConfig? scraperConfig, ScraperConfigMap? scraperConfigMap, bool debug = false, String? html, Map<String, String>? overrideCookies, Map<String, String>? overrideHeaders, String? overrideUserAgent, ProxyAPIConfig? overrideProxyAPIConfig}) → Future<Map<String, Object>>

Performs complete web scraping including HTML fetching and data extraction.

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited