batchStrategy property
Specifies the number of records to include in a mini-batch for an HTTP inference request. A record is a single unit of input data that inference can be made on. For example, a single line in a CSV file is a record.
To enable the batch strategy, you must set SplitType
to
Line
, RecordIO
, or TFRecord
.
Implementation
final BatchStrategy? batchStrategy;