IcebergDestinationConfiguration

Configuration describing where the destination Apache Iceberg Tables are persisted.

Type: CatalogConfiguration object

Required: Yes

The Amazon Resource Name (ARN) of the IAM role to be assumed by Firehose for calling Apache Iceberg Tables.

Type: String

Length Constraints: Minimum length of 1. Maximum length of 512.

Pattern: arn:.*:iam::\d{12}:role/[a-zA-Z_0-9+=,.@\-_/]+

Required: Yes

Describes the configuration of a destination in Amazon S3.

Type: S3DestinationConfiguration object

Required: Yes

Describes whether all incoming data for this delivery stream will be append only (inserts only and not for updates and deletes) for Iceberg delivery. This feature is only applicable for Apache Iceberg Tables.

The default value is false. If you set this value to true, Firehose automatically increases the throughput limit of a stream based on the throttling levels of the stream. If you set this parameter to true for a stream with updates and deletes, you will see out of order delivery.

Type: Boolean

Required: No

Describes hints for the buffering to perform before delivering data to the destination. These options are treated as hints, and therefore Firehose might choose to use different values when it is optimal. The SizeInMBs and IntervalInSeconds parameters are optional. However, if specify a value for one of them, you must also provide a value for the other.

Type: BufferingHints object

Required: No

Describes the Amazon CloudWatch logging options for your Firehose stream.

Type: CloudWatchLoggingOptions object

Required: No

Provides a list of DestinationTableConfigurations which Firehose uses to deliver data to Apache Iceberg Tables. Firehose will write data with insert if table specific configuration is not provided here.

Type: Array of DestinationTableConfiguration objects

Required: No

Describes a data processing configuration.

Type: ProcessingConfiguration object

Required: No

The retry behavior in case Firehose is unable to deliver data to a destination.

Type: RetryOptions object

Required: No

Describes how Firehose will backup records. Currently,S3 backup only supports FailedDataOnly.

Type: String

Valid Values: FailedDataOnly | AllData

Required: No

The configuration to enable automatic schema evolution.

Amazon Data Firehose is in preview release and is subject to change.

Type: SchemaEvolutionConfiguration object

Required: No

The configuration to enable automatic table creation.

Amazon Data Firehose is in preview release and is subject to change.

Type: TableCreationConfiguration object

Required: No