ScrapingStrategy class
Defines the strategy for scraping a website
Constructors
-
ScrapingStrategy.new({required int retries, required int timeout, required Map<
String, String> headers, required int initialBackoff, required double backoffMultiplier, required int maxBackoff, required bool useRandomUserAgent, required bool rotateProxiesOnRetry, required bool validateProxies}) - Creates a new ScrapingStrategy
Properties
- backoffMultiplier → double
-
The backoff multiplier
final
- hashCode → int
-
The hash code for this object.
no setterinherited
-
headers
→ Map<
String, String> -
The headers to use
final
- initialBackoff → int
-
The initial backoff in milliseconds
final
- maxBackoff → int
-
The maximum backoff in milliseconds
final
- retries → int
-
The number of retries to use
final
- rotateProxiesOnRetry → bool
-
Whether to rotate proxies on each retry
final
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
- timeout → int
-
The timeout in milliseconds
final
- useRandomUserAgent → bool
-
Whether to use a random user agent
final
- validateProxies → bool
-
Whether to validate proxies before using them
final
Methods
-
copyWith(
{int? retries, int? timeout, Map< String, String> ? headers, int? initialBackoff, double? backoffMultiplier, int? maxBackoff, bool? useRandomUserAgent, bool? rotateProxiesOnRetry, bool? validateProxies}) → ScrapingStrategy - Creates a copy of this strategy with the given parameters
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited