CrawlerRule class

Regra de um grupo User-agent no robots.txt.

Modela a política para um bot específico (buscador tradicional ou crawler de IA), permitindo allowlist/blocklist por agente.

Constructors

CrawlerRule({required String userAgent, List<String> allow = const ['/'], List<String> disallow = const [], int? crawlDelay})

const

CrawlerRule.block(String userAgent)

Bloqueia todo o site para este agente (construtor const).

const

Properties

allow → List<String>

Caminhos permitidos.

final

crawlDelay → int?

Crawl-delay em segundos (Bing/Yandex respeitam; Google ignora).

final

disallow → List<String>

Caminhos bloqueados.

final

hashCode → int

The hash code for this object.

no setter, inherited

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

userAgent → String

Token do agente (ex.: Googlebot, GPTBot, PerplexityBot, *).

final

Methods

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited