Skip to content
v2.274.0

BatchStrategy Enum ​

Specifies the number of records to include in a mini-batch for an HTTP inference request.

Members ​

MemberDescription
MULTI_RECORDFits multiple records in a mini-batch.
SINGLE_RECORDUse a single record when making an invocation request.

Referenced by ​