AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfiguration constructor
const
AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfiguration({})
Creates a new AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfiguration.
crawlerLimits Configuration of crawl limits for the web URLs. See crawlerLimits block for details.
exclusionFilters List of one or more exclusion regular expression patterns to exclude certain object types that adhere to the pattern.
inclusionFilters List of one or more inclusion regular expression patterns to include certain object types that adhere to the pattern.
scope Scope of what is crawled for your URLs.
userAgent String used for identifying the crawler or a bot when it accesses a web server. Default value is bedrockbot_UUID.
Implementation
const AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfiguration({
this.crawlerLimits,
this.exclusionFilters,
this.inclusionFilters,
this.scope,
this.userAgent,
});