InvokeModelTokensRequest¶
Structure Class¶
dataclass
¶
The body of an InvokeModel API request for token counting. This
structure mirrors the input format for the InvokeModel operation,
allowing you to count tokens for raw text inference requests.
Attributes¶
class-attribute
instance-attribute
¶
body: bytes = field(repr=False)
The request body to count tokens for, formatted according to the model's expected input format. To learn about the input format for different models, see Model inference parameters and responses.