dart_spider library

Classes

AbstractOptional
Cleaner
Cleaner cleans URLs based on configuration in Target.
Config
Top-Level Config object.
HttpOptional
Optional
Parser
Definition of a parser.
SiblingOptional
Spider
SpiderError
Spider Error Model.
StrBtwOptional
TableOptional
Target
Target to target specific type of URL.

Functions

cleanURL(Map<String, Config> masterConfig, String? url) String?
fetchTarget(List<Target> targets, String url) Target?
generateUserAgent(UserAgentDevice type) String
getConfig(Map<String, Config> masterConfig, String url, Extract extract, {Map<String, Config> priceConfig = const {}}) Config?
randomNumber(int min, int max) int
runCleaner(String url, Cleaner? cleaner) String