Class: Aws::Glue::Types::S3IcebergDirectTarget

Inherits:

Struct

• Object
• Struct
• Aws::Glue::Types::S3IcebergDirectTarget

Defined in:

gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb

Overview

Specifies a target that writes to an Iceberg data source in Amazon S3.

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #additional_options ⇒ Hash<String,String>

  Provides additional configuration options for customizing the Iceberg table behavior.

• #auto_data_quality ⇒ Types::AutoDataQuality

  Specifies configuration options for automatic data quality evaluation in Glue jobs.

• #compression ⇒ String

  Specifies the compression codec used for Iceberg table files in S3.

• #format ⇒ String

  Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).

• #inputs ⇒ Array<String>

  Defines the single input source that provides data to this Iceberg target.

• #name ⇒ String

  Specifies the unique identifier for the Iceberg target node in your data pipeline.

• #number_target_partitions ⇒ String

  Sets the number of target partitions for distributing Iceberg table files across S3.

• #output_schemas ⇒ Array<Types::GlueSchema>

  Specifies the data schema for the S3 Iceberg direct target.

• #partition_keys ⇒ Array<Array<String>>

  Specifies the columns used to partition the Iceberg table data in S3.

• #path ⇒ String

  Defines the S3 location where the Iceberg table data will be stored.

• #schema_change_policy ⇒ Types::DirectSchemaChangePolicy

  Defines how schema changes are handled when writing data to the Iceberg table.

Instance Attribute Details

#additional_options ⇒ Hash<String,String>

Provides additional configuration options for customizing the Iceberg table behavior.

Returns:

• (Hash<String,String>)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#auto_data_quality ⇒ Types::AutoDataQuality

Specifies configuration options for automatic data quality evaluation in Glue jobs. This structure enables automated data quality checks and monitoring during ETL operations, helping to ensure data integrity and reliability without manual intervention.

Returns:

• (Types::AutoDataQuality)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#compression ⇒ String

Specifies the compression codec used for Iceberg table files in S3.

Returns:

• (String)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#format ⇒ String

Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).

Returns:

• (String)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#inputs ⇒ Array<String>

Defines the single input source that provides data to this Iceberg target.

Returns:

• (Array<String>)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#name ⇒ String

Specifies the unique identifier for the Iceberg target node in your data pipeline.

Returns:

• (String)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#number_target_partitions ⇒ String

Sets the number of target partitions for distributing Iceberg table files across S3.

Returns:

• (String)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#output_schemas ⇒ Array<Types::GlueSchema>

Specifies the data schema for the S3 Iceberg direct target.

Returns:

• (Array<Types::GlueSchema>)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#partition_keys ⇒ Array<Array<String>>

Specifies the columns used to partition the Iceberg table data in S3.

Returns:

• (Array<Array<String>>)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#path ⇒ String

Defines the S3 location where the Iceberg table data will be stored.

Returns:

• (String)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#schema_change_policy ⇒ Types::DirectSchemaChangePolicy

Defines how schema changes are handled when writing data to the Iceberg table.

Returns:

• (Types::DirectSchemaChangePolicy)

# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 27087

class S3IcebergDirectTarget < Struct.new(
  :name,
  :inputs,
  :partition_keys,
  :path,
  :format,
  :additional_options,
  :schema_change_policy,
  :auto_data_quality,
  :compression,
  :number_target_partitions,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end