Package software.amazon.awssdk.services.sagemakergatewayruntime
Use the Amazon SageMaker Gateway Runtime API to run inference through a Global Inference Gateway. A Global Inference Gateway routes each request to an inference gateway that serves the model named in the request.
The request body is an OpenAI-compatible JSON object, sent with Content-Type: application/json, and the
model is selected by the model key in that body. The content of the body is passed to the model server
unchanged, except for the stream flag, which each operation sets.
Requests are signed with Signature Version 4 under the sagemaker signing name. IAM actions are in the
sagemaker namespace, for example sagemaker:InvokeGlobalInferenceGateway. The default
regional endpoint is gateway-runtime.sagemaker.{region}.amazonaws.com.
-
ClassDescriptionService client for accessing Amazon SageMaker Gateway Runtime asynchronously.A builder for creating an instance of
SageMakerGatewayRuntimeAsyncClient.This includes configuration specific to Amazon SageMaker Gateway Runtime that is supported by bothSageMakerGatewayRuntimeClientBuilderandSageMakerGatewayRuntimeAsyncClientBuilder.Service client for accessing Amazon SageMaker Gateway Runtime.A builder for creating an instance ofSageMakerGatewayRuntimeClient.Class to expose the service client settings to the user.A builder for creating aSageMakerGatewayRuntimeServiceClientConfiguration