RobotsTxtRules class
A class for representing robots.txt rules
Constructors
- RobotsTxtRules.empty()
- Creates a new empty RobotsTxtRules
- RobotsTxtRules.parse(String content)
-
Parses robots.txt content into rules
factory
Properties
- hashCode → int
-
The hash code for this object.
no setterinherited
- runtimeType → Type
-
A representation of the runtime type of the object.
no setterinherited
Methods
-
getCrawlDelay(
String userAgent) → int? - Gets the crawl delay for a user agent in milliseconds
-
isAllowed(
String path, String userAgent) → bool - Checks if a path is allowed for a user agent
-
isExpired(
int expirationMs) → bool - Checks if the rules are expired
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a nonexistent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited