CustomModelUnits
A CustomModelUnit
(CMU) is an abstract view of the hardware utilization that Amazon Bedrock needs to host
a single copy of your custom model. A model copy represents a single instance of your imported model that
is ready to serve inference requests. Amazon Bedrock determines the number of custom
model units that a model copy needs when you import the custom model.
You can use CustomModelUnits
to estimate the cost of running
your custom model. For more information, see Calculate the cost of running a custom model.
Contents
- customModelUnitsPerModelCopy
-
The number of custom model units used to host a model copy.
Type: Integer
Required: No
- customModelUnitsVersion
-
The version of the custom model unit. Use to determine the billing rate for the custom model unit.
Type: String
Pattern:
^v\d+.\d+$
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following: