create_inference_profile¶
Operation¶
async
¶
create_inference_profile(input: CreateInferenceProfileInput, plugins: list[Plugin] | None = None) -> CreateInferenceProfileOutput
Creates an application inference profile to track metrics and costs when invoking a model. To create an application inference profile for a foundation model in one region, specify the ARN of the model in that region. To create an application inference profile for a foundation model across multiple regions, specify the ARN of the system-defined inference profile that contains the regions that you want to route requests to. For more information, see Increase throughput and resilience with cross-region inference in Amazon Bedrock. in the Amazon Bedrock User Guide.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
input
|
CreateInferenceProfileInput
|
An instance of |
required |
plugins
|
list[Plugin] | None
|
A list of callables that modify the configuration dynamically. Changes made by these plugins only apply for the duration of the operation execution and will not affect any other operation invocations. |
None
|
Returns:
| Type | Description |
|---|---|
CreateInferenceProfileOutput
|
An instance of |
Input¶
dataclass
¶
Dataclass for CreateInferenceProfileInput structure.
Attributes¶
class-attribute
instance-attribute
¶
client_request_token: str | None = None
A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error. For more information, see Ensuring idempotency.
class-attribute
instance-attribute
¶
description: str | None = field(repr=False, default=None)
A description for the inference profile.
class-attribute
instance-attribute
¶
inference_profile_name: str | None = None
A name for the inference profile.
class-attribute
instance-attribute
¶
model_source: InferenceProfileModelSource | None = None
The foundation model or system-defined inference profile that the inference profile will track metrics and costs for.
class-attribute
instance-attribute
¶
tags: list[Tag] | None = None
An array of objects, each of which contains a tag and its value. For more information, see Tagging resources in the Amazon Bedrock User Guide.
Output¶
dataclass
¶
Dataclass for CreateInferenceProfileOutput structure.
Attributes¶
instance-attribute
¶
inference_profile_arn: str
The ARN of the inference profile that you created.
class-attribute
instance-attribute
¶
status: InferenceProfileStatus | None = None
The status of the inference profile. ACTIVE means that the inference
profile is ready to be used.