TransformS3DataSource
Describes the S3 data source.
Contents
- S3DataType
-
If you choose
S3Prefix,S3Uriidentifies a key name prefix. Amazon SageMaker uses all objects with the specified key name prefix for batch transform.If you choose
ManifestFile,S3Uriidentifies an object that is a manifest file containing a list of object keys that you want Amazon SageMaker to use for batch transform.The following values are compatible:
ManifestFile,S3PrefixThe following value is not compatible:
AugmentedManifestFileType: String
Valid Values:
ManifestFile | S3Prefix | AugmentedManifestFileRequired: Yes
- S3Uri
-
Depending on the value specified for the
S3DataType, identifies either a key name prefix or a manifest. For example:-
A key name prefix might look like this:
s3://bucketname/exampleprefix/. -
A manifest might look like this:
s3://bucketname/example.manifestThe manifest is an S3 object which is a JSON file with the following format:
[ {"prefix": "s3://customer_bucket/some/prefix/"},"relative/path/to/custdata-1","relative/path/custdata-2",..."relative/path/custdata-N"]The preceding JSON matches the following
S3Uris:s3://customer_bucket/some/prefix/relative/path/to/custdata-1s3://customer_bucket/some/prefix/relative/path/custdata-2...s3://customer_bucket/some/prefix/relative/path/custdata-NThe complete set of
S3Urisin this manifest constitutes the input data for the channel for this datasource. The object that eachS3Urispoints to must be readable by the IAM role that Amazon SageMaker uses to perform tasks on your behalf.
Type: String
Length Constraints: Maximum length of 1024.
Pattern:
^(https|s3)://([^/]+)/?(.*)$Required: Yes
-
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following:
