AdaptiveScrapingStrategy class
Generates adaptive scraping strategies based on site reputation and error patterns
Constructors
- AdaptiveScrapingStrategy.new({SiteReputationTracker? reputationTracker, ScrapingStrategy? defaultStrategy})
- Creates a new AdaptiveScrapingStrategy
Properties
- hashCode → int
-
The hash code for this object.
no setterinherited
- reputationTracker → SiteReputationTracker
-
Gets the site reputation tracker
no setter
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
Methods
-
getStrategyForUrl(
String url) → ScrapingStrategy - Gets the optimal strategy for the given URL
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
recordFailure(
String url, String errorMessage) → void - Records a failed scrape for the given URL with the error message
-
recordSuccess(
String url) → void - Records a successful scrape for the given URL
-
selectOptimalProxy(
String url, List< Proxy> availableProxies, String? lastErrorMessage) → Proxy? - Gets the optimal proxy for the given URL and error pattern
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited