Class: Aws::Firehose::Types::IcebergDestinationConfiguration

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb

Overview

Specifies the destination configure settings for Apache Iceberg Table.

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#buffering_hintsTypes::BufferingHints

Describes hints for the buffering to perform before delivering data to the destination. These options are treated as hints, and therefore Firehose might choose to use different values when it is optimal. The SizeInMBs and IntervalInSeconds parameters are optional. However, if specify a value for one of them, you must also provide a value for the other.



2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#catalog_configurationTypes::CatalogConfiguration

Configuration describing where the destination Apache Iceberg Tables are persisted.



2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#cloud_watch_logging_optionsTypes::CloudWatchLoggingOptions

Describes the Amazon CloudWatch logging options for your Firehose stream.



2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#destination_table_configuration_listArray<Types::DestinationTableConfiguration>

Provides a list of DestinationTableConfigurations which Firehose uses to deliver data to Apache Iceberg Tables. Firehose will write data with insert if table specific configuration is not provided here.



2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#processing_configurationTypes::ProcessingConfiguration

Describes a data processing configuration.



2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#retry_optionsTypes::RetryOptions

The retry behavior in case Firehose is unable to deliver data to a destination.

Returns:



2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#role_arnString

The Amazon Resource Name (ARN) of the IAM role to be assumed by Firehose for calling Apache Iceberg Tables.

Returns:

  • (String)


2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#s3_backup_modeString

Describes how Firehose will backup records. Currently,S3 backup only supports FailedDataOnly.

Returns:

  • (String)


2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#s3_configurationTypes::S3DestinationConfiguration

Describes the configuration of a destination in Amazon S3.



2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#schema_evolution_configurationTypes::SchemaEvolutionConfiguration

Amazon Data Firehose is in preview release and is subject to change.



2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#table_creation_configurationTypes::TableCreationConfiguration

Amazon Data Firehose is in preview release and is subject to change.



2916
2917
2918
2919
2920
2921
2922
2923
2924
2925
2926
2927
2928
2929
2930
# File 'gems/aws-sdk-firehose/lib/aws-sdk-firehose/types.rb', line 2916

class IcebergDestinationConfiguration < Struct.new(
  :destination_table_configuration_list,
  :schema_evolution_configuration,
  :table_creation_configuration,
  :buffering_hints,
  :cloud_watch_logging_options,
  :processing_configuration,
  :s3_backup_mode,
  :retry_options,
  :role_arn,
  :catalog_configuration,
  :s3_configuration)
  SENSITIVE = []
  include Aws::Structure
end