tokens property

List<Token>? tokens

Tokens, along with their syntactic information, in the input document.

Populated if the user enables AnnotateTextRequest.Features.extract_syntax.

Implementation

core.List<Token>? tokens;