Class: Aws::SageMaker::Types::ProcessingS3Input
- Inherits:
-
Struct
- Object
- Struct
- Aws::SageMaker::Types::ProcessingS3Input
- Defined in:
- gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb
Overview
Configuration for downloading input data from Amazon S3 into the processing container.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#local_path ⇒ String
The local path in your container where you want Amazon SageMaker to write input data to.
-
#s3_compression_type ⇒ String
Whether to GZIP-decompress the data in Amazon S3 as it is streamed into the processing container.
-
#s3_data_distribution_type ⇒ String
Whether to distribute the data from Amazon S3 to all processing instances with
FullyReplicated
, or whether the data from Amazon S3 is shared by Amazon S3 key, downloading one shard of data to each processing instance. -
#s3_data_type ⇒ String
Whether you use an
S3Prefix
or aManifestFile
for the data type. -
#s3_input_mode ⇒ String
Whether to use
File
orPipe
input mode. -
#s3_uri ⇒ String
The URI of the Amazon S3 prefix Amazon SageMaker downloads data required to run a processing job.
Instance Attribute Details
#local_path ⇒ String
The local path in your container where you want Amazon SageMaker to
write input data to. LocalPath
is an absolute path to the input
data and must begin with /opt/ml/processing/
. LocalPath
is a
required parameter when AppManaged
is False
(default).
37061 37062 37063 37064 37065 37066 37067 37068 37069 37070 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37061 class ProcessingS3Input < Struct.new( :s3_uri, :local_path, :s3_data_type, :s3_input_mode, :s3_data_distribution_type, :s3_compression_type) SENSITIVE = [] include Aws::Structure end |
#s3_compression_type ⇒ String
Whether to GZIP-decompress the data in Amazon S3 as it is streamed
into the processing container. Gzip
can only be used when Pipe
mode is specified as the S3InputMode
. In Pipe
mode, Amazon
SageMaker streams input data from the source directly to your
container without using the EBS volume.
37061 37062 37063 37064 37065 37066 37067 37068 37069 37070 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37061 class ProcessingS3Input < Struct.new( :s3_uri, :local_path, :s3_data_type, :s3_input_mode, :s3_data_distribution_type, :s3_compression_type) SENSITIVE = [] include Aws::Structure end |
#s3_data_distribution_type ⇒ String
Whether to distribute the data from Amazon S3 to all processing
instances with FullyReplicated
, or whether the data from Amazon S3
is shared by Amazon S3 key, downloading one shard of data to each
processing instance.
37061 37062 37063 37064 37065 37066 37067 37068 37069 37070 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37061 class ProcessingS3Input < Struct.new( :s3_uri, :local_path, :s3_data_type, :s3_input_mode, :s3_data_distribution_type, :s3_compression_type) SENSITIVE = [] include Aws::Structure end |
#s3_data_type ⇒ String
Whether you use an S3Prefix
or a ManifestFile
for the data type.
If you choose S3Prefix
, S3Uri
identifies a key name prefix.
Amazon SageMaker uses all objects with the specified key name prefix
for the processing job. If you choose ManifestFile
, S3Uri
identifies an object that is a manifest file containing a list of
object keys that you want Amazon SageMaker to use for the processing
job.
37061 37062 37063 37064 37065 37066 37067 37068 37069 37070 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37061 class ProcessingS3Input < Struct.new( :s3_uri, :local_path, :s3_data_type, :s3_input_mode, :s3_data_distribution_type, :s3_compression_type) SENSITIVE = [] include Aws::Structure end |
#s3_input_mode ⇒ String
Whether to use File
or Pipe
input mode. In File mode, Amazon
SageMaker copies the data from the input source onto the local ML
storage volume before starting your processing container. This is
the most commonly used input mode. In Pipe
mode, Amazon SageMaker
streams input data from the source directly to your processing
container into named pipes without using the ML storage volume.
37061 37062 37063 37064 37065 37066 37067 37068 37069 37070 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37061 class ProcessingS3Input < Struct.new( :s3_uri, :local_path, :s3_data_type, :s3_input_mode, :s3_data_distribution_type, :s3_compression_type) SENSITIVE = [] include Aws::Structure end |
#s3_uri ⇒ String
The URI of the Amazon S3 prefix Amazon SageMaker downloads data required to run a processing job.
37061 37062 37063 37064 37065 37066 37067 37068 37069 37070 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37061 class ProcessingS3Input < Struct.new( :s3_uri, :local_path, :s3_data_type, :s3_input_mode, :s3_data_distribution_type, :s3_compression_type) SENSITIVE = [] include Aws::Structure end |