sequenceBatchSize property

@override int get sequenceBatchSize

Sequence batch size for encoding. Used by GPU only. Number of input tokens to process at a time for batch processing. Setting this value to 1 means both the encoding and decoding share the same graph of sequence length of 1. Setting this value to 0 means the batch size will be optimized programmatically.

Implementation

@override
int get sequenceBatchSize => throw UnimplementedError();