Amazon SageMaker Unified Studio is in preview release and is subject to change.
Find serverless models with the Amazon Bedrock model catalog
The Amazon Bedrock IDE model catalog is where you can find the serverless Amazon Bedrock foundation models that you have access to. You can group models by their modality or by their provider. The modality of a model represents the type of input data that the model is trained on and is able to process, such as text or image data. For more information, see Supported foundation models in Amazon Bedrock.
If you can't find a specific model, ask your administrator if you have permissions to access the model.
To find out information about a model, such as supported use cases, select the model tile in the model catalog. When choosing a model, consider the following:
-
Amazon Bedrock models support differing inference parameters and capabilities. For more information, see Amazon Bedrock foundation model information in the Amazon Bedrock user guide.
-
Amazon Bedrock IDE supports Amazon Bedrock foundation models with on-demand throughput and On-demand Cross-region inference (CRIT).
Models that support (CRIT) throughput can increase throughput and improve resiliency by sending requests to different AWS regions during peak utilization bursts. In the model catalog (and the model selector in app configuration), the text CRIT identifies such a model.
-
Amazon Bedrock IDE doesn't support Provisioned throughput, custom models or imported models.
If the model is suitable for your needs, you can choose the menu button to start using the model. Depending on the model, you can choose from the following actions:
-
Build chat agent app – Create an app in which users can chat with a model.
-
Build flow app – Visually create the workflow for an app.
-
Build prompt – Create resuable prompts for use in a flow app.
-
Evaluate model – Evaluate the performance of a model for your use case.
The following procedure shows how to open the model catalog from the Amazon Bedrock IDE playground. You can also access the model catalog from your projects. Your administrator might give you access to different models in your projects. To check the models that you can access in a project, open or create a project, and then select Models in the navigation pane to open the model catalog.
To open the model catalog in the playground
-
Navigate to the Amazon SageMaker Unified Studio landing page by using the URL from your admininstrator.
-
Access Amazon SageMaker Unified Studio using your IAM or single sign-on (SSO) credentials. For more information, see Access Amazon SageMaker Unified Studio.
-
At the top of the page, choose Discover.
-
Under Data and model catalog, choose Amazon Bedrock models. The Amazon Bedrock IDE playground opens at the model catalog.
-
(Optional) Choose Group by: Modality and select Provider to sort the list by model provider.
Choose a model to get information about the model.
-
If you're ready to build with the app, choose Action and select the appropriate action. You can also choose an action from the model tile on the model catalog page.
Choose Amazon Bedrock model catalog to go back to the model catalog page.