batchSize property

String? batchSize

Number of records per batch, defaults to 64.

The service will buffer batch_size number of records in memory before invoking one Tensorflow prediction call internally. So take the record size and memory available into consideration when setting this parameter.

Optional.

Implementation

core.String? batchSize;