CrawlbergBridge class

Constructors

CrawlbergBridge()

Properties

hashCode → int

The hash code for this object.

no setter, inherited

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited

Static Methods

batchCrawl(CrawlEngineHandle engine, List<String> urls) → Future<BatchCrawlResults>

Crawl multiple seed URLs concurrently, each following links to configured depth. throws CrawlError on failure

batchCrawlStream(CrawlEngineHandle crawlEngineHandle, BatchCrawlStreamRequest req) → Stream<CrawlEvent>

batchScrape(CrawlEngineHandle engine, List<String> urls) → Future<BatchScrapeResults>

Scrape multiple URLs concurrently. throws CrawlError on failure

crawl(CrawlEngineHandle engine, String url) → Future<CrawlResult>

Crawl a website starting from url, following links up to the configured depth. throws CrawlError on failure

crawlStream(CrawlEngineHandle crawlEngineHandle, CrawlStreamRequest req) → Stream<CrawlEvent>

createEngine({CrawlConfig? config}) → Future<CrawlEngineHandle>

Create a new crawl engine with the given configuration.

generateCitations(String markdown) → Future<CitationResult>

Convert markdown links to numbered citations.

interact(CrawlEngineHandle engine, String url, List<PageAction> actions) → Future<InteractionResult>

Execute browser actions on a single page. throws CrawlError on failure

mapUrls(CrawlEngineHandle engine, String url) → Future<MapResult>

Discover all pages on a website by following links and sitemaps. throws CrawlError on failure

scrape(CrawlEngineHandle engine, String url) → Future<ScrapeResult>

Scrape a single URL, returning extracted page data. throws CrawlError on failure