toMap method
Converts the ScraperConfig instance to a Map.
This method is used for serializing the configuration to JSON or other map-based formats.
Returns:
- Map containing all configuration data
Implementation
Map<String, dynamic> toMap() {
  return {
    'pathPatterns': pathPatterns,
    'requiresHtml': requiresHtml,
    'urlCleaner': urlCleaner?.toMap(),
    'parsers': parsers.map((parser) => parser.toMap()).toList(),
    'proxyAPIConfig': proxyAPIConfig?.toMap(),
    'cookies': cookies,
    'headers': headers,
    'forceRefresh': forceRefresh,
    'userAgent': userAgent.toString().split('.').last,
  };
}