copyText property
Indicates whether {@link CommonToken#setText} should be called after
constructing tokens to explicitly set the text. This is useful for cases
where the input stream might not be able to provide arbitrary substrings
of text from the input after the lexer creates a token (e.g. the
implementation of {@link CharStream#getText} in
UnbufferedCharStream throws an
UnsupportedOperationException). Explicitly setting the token text
allows {@link Token#getText} to be called at any time regardless of the
input stream implementation.
The default value is [false] to avoid the performance and memory overhead of copying text for every token unless explicitly requested.
Implementation
final bool copyText;