WebScraperExtension extension
Extension methods for WebScraper to enhance error handling and retry logic
- on
Methods
-
fetchFromProblematicSite(
{required String url, Map< String, String> ? headers, int? timeout = 60000, int? retries = 5}) → Future<String> -
Available on WebScraper, provided by the WebScraperExtension extension
Fetches HTML content from a problematic site using specialized techniques -
fetchHtmlWithRetry(
{required String url, Map< String, String> ? headers, int? timeout, int? retries, int initialBackoffMs = 500, double backoffMultiplier = 1.5, int maxBackoffMs = 10000}) → Future<String> -
Available on WebScraper, provided by the WebScraperExtension extension
Fetches HTML content with enhanced error handling and retry logic