Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”

Preferences
Contact Us
Feedback
AWS Documentation
Create an AWS Account

Inference Requests With a Deployed Service

PDF
RSS
Focus mode
Inference Requests With a Deployed Service - Amazon SageMaker AI

If you have followed instructions in Deploy a Model, you should have a SageMaker AI endpoint set up and running. Regardless of how you deployed your Neo-compiled model, there are three ways you can submit inference requests:

Topics

Related resources

Amazon SageMaker AI API Reference
AWS CLI commands for Amazon SageMaker AI
SDKs & Tools 

Related resources

Amazon SageMaker AI API Reference
AWS CLI commands for Amazon SageMaker AI
SDKs & Tools 
PrivacySite termsCookie preferences
© 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved.