CrawlerInspector class

Tools for crawling, previewing, and inspecting web endpoints. Call close when finished if this instance created its own HTTP client.

Constructors

CrawlerInspector({Client? client, SsrfGuard ssrfGuard = const SsrfGuard(), Duration timeout = const Duration(seconds: 10), Duration totalTimeout = const Duration(seconds: 30), int maxResponseSizeBytes = 2 * 1024 * 1024, int maxRedirects = 5})

Properties

client → Client
final
hashCode → int
The hash code for this object.
no setterinherited
maxRedirects → int
Maximum number of validated redirects (default five, hard cap ten).
final
maxResponseSizeBytes → int
Maximum bytes read from a crawler response body (default 2 MiB).
final
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
ssrfGuard → SsrfGuard
final
timeout → Duration
final
totalTimeout → Duration
Maximum wall-clock time for DNS checks, redirects, headers and body.
final

Methods

close() → void
Closes the internally created transport. Injected clients remain caller-owned.
inspectUrl(String targetUrl) → Future<UrlInspectionReport>
Inspects targetUrl using raw HTTP GET without running JavaScript.
noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited