robotsTxtState property

String? robotsTxtState
getter/setter pair

Whether or not the page is blocked to Google by a robots.txt rule. Possible string values are:

  • "ROBOTS_TXT_STATE_UNSPECIFIED" : Unknown robots.txt state, typically because the page wasn't fetched or found, or because robots.txt itself couldn't be reached.
  • "ALLOWED" : Crawl allowed by robots.txt.
  • "DISALLOWED" : Crawl blocked by robots.txt.

Implementation

core.String? robotsTxtState;