ids property

List<int> ids

Token ids, including any special tokens (BOS/EOS or CLS/SEP) the tokenizer's convention adds. Never truncated: TokenEmbeddingPass refuses ids longer than the graph takes (EmbeddingInputTooLongException), and a static-shape graph pads them in runTokens.

Implementation

final List<int> ids;